Jun 02 19:00:55.758473 ip-10-0-141-177 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 02 19:00:55.758599 ip-10-0-141-177 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 02 19:00:55.758613 ip-10-0-141-177 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 02 19:00:55.758928 ip-10-0-141-177 systemd[1]: Failed to start Kubernetes Kubelet. Jun 02 19:01:05.811312 ip-10-0-141-177 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 02 19:01:05.811329 ip-10-0-141-177 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 97c84237aa7044d8b80723f51a75974e -- Jun 02 19:03:15.905547 ip-10-0-141-177 systemd[1]: Starting Kubernetes Kubelet... Jun 02 19:03:16.337177 ip-10-0-141-177 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 19:03:16.337177 ip-10-0-141-177 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 19:03:16.337177 ip-10-0-141-177 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 19:03:16.337177 ip-10-0-141-177 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 19:03:16.337177 ip-10-0-141-177 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 19:03:16.340195 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.340078 2557 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 19:03:16.342938 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.342923 2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 19:03:16.342938 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.342939 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 19:03:16.342998 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.342942 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 19:03:16.342998 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.342945 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 19:03:16.342998 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.342950 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 19:03:16.342998 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.342953 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 19:03:16.342998 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.342956 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 19:03:16.342998 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.342959 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 19:03:16.342998 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.342961 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 19:03:16.342998 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.342965 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 19:03:16.342998 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.342967 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 19:03:16.342998 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.342970 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 19:03:16.342998 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.342972 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 19:03:16.342998 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.342976 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 19:03:16.342998 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.342978 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 19:03:16.342998 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.342981 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 19:03:16.342998 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.342984 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 19:03:16.342998 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.342986 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 19:03:16.342998 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.342989 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 19:03:16.342998 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.342991 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 19:03:16.342998 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.342994 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 19:03:16.342998 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.342996 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 19:03:16.343487 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.342999 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 19:03:16.343487 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343002 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 19:03:16.343487 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343005 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 19:03:16.343487 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343008 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 19:03:16.343487 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343010 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 19:03:16.343487 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343015 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 19:03:16.343487 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343018 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 19:03:16.343487 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343021 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 19:03:16.343487 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343024 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 19:03:16.343487 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343028 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 19:03:16.343487 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343031 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 19:03:16.343487 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343034 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 19:03:16.343487 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343036 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 19:03:16.343487 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343039 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 19:03:16.343487 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343041 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 19:03:16.343487 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343044 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 19:03:16.343487 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343046 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 19:03:16.343487 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343049 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 02 19:03:16.343487 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343051 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 19:03:16.343487 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343054 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 19:03:16.343968 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343056 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 19:03:16.343968 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343059 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 19:03:16.343968 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343061 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 19:03:16.343968 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343064 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 19:03:16.343968 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343067 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 19:03:16.343968 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343069 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 19:03:16.343968 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343072 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 19:03:16.343968 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343074 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 19:03:16.343968 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343077 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 19:03:16.343968 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343079 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 19:03:16.343968 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343081 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 19:03:16.343968 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343084 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 19:03:16.343968 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343086 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 19:03:16.343968 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343090 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 19:03:16.343968 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343092 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 19:03:16.343968 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343095 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 19:03:16.343968 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343097 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 19:03:16.343968 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343100 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 19:03:16.343968 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343102 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 19:03:16.344483 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343105 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 19:03:16.344483 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343108 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 19:03:16.344483 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343110 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 19:03:16.344483 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343113 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 19:03:16.344483 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343116 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 19:03:16.344483 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343118 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 19:03:16.344483 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343120 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 19:03:16.344483 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343123 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 19:03:16.344483 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343125 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 19:03:16.344483 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343128 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 19:03:16.344483 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343130 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 19:03:16.344483 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343134 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 19:03:16.344483 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343136 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 19:03:16.344483 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343140 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 19:03:16.344483 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343144 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 19:03:16.344483 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343147 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 19:03:16.344483 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343149 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 19:03:16.344483 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343153 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 19:03:16.344483 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343157 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 19:03:16.344939 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343161 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 19:03:16.344939 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343164 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 19:03:16.344939 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343167 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 19:03:16.344939 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343169 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 19:03:16.344939 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343172 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 19:03:16.344939 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343174 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 19:03:16.344939 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343570 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 19:03:16.344939 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343577 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 19:03:16.344939 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343580 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 19:03:16.344939 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343583 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 19:03:16.344939 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343587 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 19:03:16.344939 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343590 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 19:03:16.344939 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343592 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 19:03:16.344939 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343595 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 19:03:16.344939 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343598 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 19:03:16.344939 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343601 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 19:03:16.344939 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343604 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 19:03:16.344939 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343607 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 19:03:16.344939 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343609 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 19:03:16.344939 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343612 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 19:03:16.345421 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343614 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 19:03:16.345421 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343617 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 19:03:16.345421 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343619 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 19:03:16.345421 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343622 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 19:03:16.345421 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343624 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 19:03:16.345421 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343627 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 19:03:16.345421 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343630 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 19:03:16.345421 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343633 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 19:03:16.345421 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343637 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 19:03:16.345421 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343640 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 19:03:16.345421 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343643 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 19:03:16.345421 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343646 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 19:03:16.345421 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343648 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 19:03:16.345421 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343651 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 19:03:16.345421 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343653 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 19:03:16.345421 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343655 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 19:03:16.345421 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343658 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 19:03:16.345421 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343661 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 19:03:16.345421 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343663 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 19:03:16.345421 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343667 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 19:03:16.345937 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343670 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 19:03:16.345937 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343673 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 19:03:16.345937 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343675 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 19:03:16.345937 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343678 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 19:03:16.345937 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343680 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 19:03:16.345937 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343683 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 19:03:16.345937 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343686 2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 19:03:16.345937 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343688 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 19:03:16.345937 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343691 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 19:03:16.345937 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343693 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 19:03:16.345937 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343695 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 19:03:16.345937 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343698 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 19:03:16.345937 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343700 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 19:03:16.345937 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343704 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 19:03:16.345937 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343706 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 19:03:16.345937 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343708 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 19:03:16.345937 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343711 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 19:03:16.345937 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343714 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 19:03:16.345937 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343716 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 02 19:03:16.345937 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343719 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 19:03:16.346441 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343721 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 19:03:16.346441 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343724 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 19:03:16.346441 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343726 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 19:03:16.346441 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343729 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 19:03:16.346441 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343732 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 19:03:16.346441 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343734 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 19:03:16.346441 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343737 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 19:03:16.346441 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343739 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 19:03:16.346441 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343742 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 19:03:16.346441 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343744 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 19:03:16.346441 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343747 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 19:03:16.346441 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343750 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 19:03:16.346441 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343752 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 19:03:16.346441 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343755 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 19:03:16.346441 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343758 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 19:03:16.346441 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343761 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 19:03:16.346441 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343763 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 19:03:16.346441 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343766 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 19:03:16.346441 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343768 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 19:03:16.346918 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343773 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 19:03:16.346918 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343776 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 19:03:16.346918 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343779 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 19:03:16.346918 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343781 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 19:03:16.346918 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343784 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 19:03:16.346918 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343787 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 19:03:16.346918 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343790 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 19:03:16.346918 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343793 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 19:03:16.346918 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343795 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 19:03:16.346918 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343798 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 19:03:16.346918 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343800 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 19:03:16.346918 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343803 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 19:03:16.346918 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.343805 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 19:03:16.346918 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345040 2557 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 19:03:16.346918 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345055 2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 19:03:16.346918 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345062 2557 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 19:03:16.346918 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345066 2557 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 19:03:16.346918 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345070 2557 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 19:03:16.346918 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345074 2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 19:03:16.346918 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345078 2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 19:03:16.347420 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345083 2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 19:03:16.347420 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345087 2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 19:03:16.347420 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345090 2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 19:03:16.347420 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345094 2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 19:03:16.347420 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345098 2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 19:03:16.347420 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345101 2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 19:03:16.347420 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345104 2557 flags.go:64] FLAG: --cgroup-root="" Jun 02 19:03:16.347420 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345107 2557 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 19:03:16.347420 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345110 2557 flags.go:64] FLAG: --client-ca-file="" Jun 02 19:03:16.347420 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345113 2557 flags.go:64] FLAG: --cloud-config="" Jun 02 19:03:16.347420 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345116 2557 flags.go:64] FLAG: --cloud-provider="external" Jun 02 19:03:16.347420 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345118 2557 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 19:03:16.347420 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345123 2557 flags.go:64] FLAG: --cluster-domain="" Jun 02 19:03:16.347420 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345125 2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 19:03:16.347420 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345129 2557 flags.go:64] FLAG: --config-dir="" Jun 02 19:03:16.347420 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345132 2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 19:03:16.347420 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345135 2557 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 19:03:16.347420 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345139 2557 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 19:03:16.347420 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345142 2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 19:03:16.347420 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345145 2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 19:03:16.347420 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345148 2557 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 19:03:16.347420 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345152 2557 flags.go:64] FLAG: --contention-profiling="false" Jun 02 19:03:16.347420 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345154 2557 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 19:03:16.347420 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345157 2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 19:03:16.348006 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345160 2557 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 19:03:16.348006 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345163 2557 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 19:03:16.348006 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345168 2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 19:03:16.348006 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345171 2557 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 19:03:16.348006 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345173 2557 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 19:03:16.348006 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345176 2557 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 19:03:16.348006 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345179 2557 flags.go:64] FLAG: --enable-server="true" Jun 02 19:03:16.348006 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345183 2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 19:03:16.348006 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345187 2557 flags.go:64] FLAG: --event-burst="100" Jun 02 19:03:16.348006 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345191 2557 flags.go:64] FLAG: --event-qps="50" Jun 02 19:03:16.348006 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345194 2557 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 19:03:16.348006 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345197 2557 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 19:03:16.348006 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345200 2557 flags.go:64] FLAG: --eviction-hard="" Jun 02 19:03:16.348006 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345204 2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 19:03:16.348006 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345207 2557 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 19:03:16.348006 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345210 2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 19:03:16.348006 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345213 2557 flags.go:64] FLAG: --eviction-soft="" Jun 02 19:03:16.348006 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345215 2557 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 19:03:16.348006 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345218 2557 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 19:03:16.348006 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345221 2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 19:03:16.348006 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345224 2557 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 19:03:16.348006 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345227 2557 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 19:03:16.348006 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345230 2557 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 19:03:16.348006 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345233 2557 flags.go:64] FLAG: --feature-gates="" Jun 02 19:03:16.348006 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345237 2557 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 19:03:16.348615 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345240 2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 19:03:16.348615 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345243 2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 19:03:16.348615 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345246 2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 19:03:16.348615 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345249 2557 flags.go:64] FLAG: --healthz-port="10248" Jun 02 19:03:16.348615 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345252 2557 flags.go:64] FLAG: --help="false" Jun 02 19:03:16.348615 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345255 2557 flags.go:64] FLAG: --hostname-override="ip-10-0-141-177.ec2.internal" Jun 02 19:03:16.348615 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345257 2557 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 19:03:16.348615 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345261 2557 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 19:03:16.348615 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345264 2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 19:03:16.348615 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345267 2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 19:03:16.348615 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345270 2557 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 19:03:16.348615 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345273 2557 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 19:03:16.348615 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345276 2557 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 19:03:16.348615 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345278 2557 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 19:03:16.348615 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345285 2557 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 19:03:16.348615 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345288 2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 19:03:16.348615 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345291 2557 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 19:03:16.348615 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345294 2557 flags.go:64] FLAG: --kube-reserved="" Jun 02 19:03:16.348615 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345298 2557 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 19:03:16.348615 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345300 2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 19:03:16.348615 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345303 2557 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 19:03:16.348615 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345317 2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 19:03:16.348615 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345320 2557 flags.go:64] FLAG: --lock-file="" Jun 02 19:03:16.348615 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345323 2557 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 19:03:16.349210 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345326 2557 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 19:03:16.349210 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345329 2557 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 19:03:16.349210 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345334 2557 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 19:03:16.349210 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345337 2557 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 19:03:16.349210 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345340 2557 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 19:03:16.349210 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345343 2557 flags.go:64] FLAG: --logging-format="text" Jun 02 19:03:16.349210 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345346 2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 19:03:16.349210 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345349 2557 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 19:03:16.349210 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345352 2557 flags.go:64] FLAG: --manifest-url="" Jun 02 19:03:16.349210 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345355 2557 flags.go:64] FLAG: --manifest-url-header="" Jun 02 19:03:16.349210 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345359 2557 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 19:03:16.349210 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345362 2557 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 19:03:16.349210 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345366 2557 flags.go:64] FLAG: --max-pods="110" Jun 02 19:03:16.349210 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345369 2557 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 19:03:16.349210 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345372 2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 19:03:16.349210 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345375 2557 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 19:03:16.349210 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345378 2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 19:03:16.349210 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345381 2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 19:03:16.349210 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345383 2557 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 19:03:16.349210 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345386 2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 19:03:16.349210 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345393 2557 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 19:03:16.349210 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345396 2557 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 19:03:16.349210 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345401 2557 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 19:03:16.349210 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345404 2557 flags.go:64] FLAG: --pod-cidr="" Jun 02 19:03:16.349828 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345407 2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 19:03:16.349828 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345412 2557 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 19:03:16.349828 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345415 2557 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 19:03:16.349828 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345418 2557 flags.go:64] FLAG: --pods-per-core="0" Jun 02 19:03:16.349828 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345421 2557 flags.go:64] FLAG: --port="10250" Jun 02 19:03:16.349828 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345424 2557 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 19:03:16.349828 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345427 2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00c1fc9aae03c3995" Jun 02 19:03:16.349828 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345431 2557 flags.go:64] FLAG: --qos-reserved="" Jun 02 19:03:16.349828 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345434 2557 flags.go:64] FLAG: --read-only-port="10255" Jun 02 19:03:16.349828 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345437 2557 flags.go:64] FLAG: --register-node="true" Jun 02 19:03:16.349828 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345439 2557 flags.go:64] FLAG: --register-schedulable="true" Jun 02 19:03:16.349828 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345442 2557 flags.go:64] FLAG: --register-with-taints="" Jun 02 19:03:16.349828 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345446 2557 flags.go:64] FLAG: --registry-burst="10" Jun 02 19:03:16.349828 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345449 2557 flags.go:64] FLAG: --registry-qps="5" Jun 02 19:03:16.349828 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345452 2557 flags.go:64] FLAG: --reserved-cpus="" Jun 02 19:03:16.349828 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345454 2557 flags.go:64] FLAG: --reserved-memory="" Jun 02 19:03:16.349828 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345458 2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 19:03:16.349828 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345461 2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 19:03:16.349828 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345465 2557 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 19:03:16.349828 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345468 2557 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 19:03:16.349828 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345471 2557 flags.go:64] FLAG: --runonce="false" Jun 02 19:03:16.349828 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345474 2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 19:03:16.349828 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345477 2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 19:03:16.349828 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345480 2557 flags.go:64] FLAG: --seccomp-default="false" Jun 02 19:03:16.349828 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345483 2557 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 19:03:16.350553 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345486 2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 19:03:16.350553 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345489 2557 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 19:03:16.350553 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345492 2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 19:03:16.350553 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345495 2557 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 19:03:16.350553 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345497 2557 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 19:03:16.350553 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345500 2557 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 19:03:16.350553 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345504 2557 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 19:03:16.350553 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345507 2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 19:03:16.350553 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345512 2557 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 19:03:16.350553 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345515 2557 flags.go:64] FLAG: --system-cgroups="" Jun 02 19:03:16.350553 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345518 2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 19:03:16.350553 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345523 2557 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 19:03:16.350553 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345526 2557 flags.go:64] FLAG: --tls-cert-file="" Jun 02 19:03:16.350553 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345529 2557 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 19:03:16.350553 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345533 2557 flags.go:64] FLAG: --tls-min-version="" Jun 02 19:03:16.350553 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345535 2557 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 19:03:16.350553 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345538 2557 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 19:03:16.350553 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345541 2557 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 19:03:16.350553 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345544 2557 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 19:03:16.350553 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345547 2557 flags.go:64] FLAG: --v="2" Jun 02 19:03:16.350553 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345551 2557 flags.go:64] FLAG: --version="false" Jun 02 19:03:16.350553 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345555 2557 flags.go:64] FLAG: --vmodule="" Jun 02 19:03:16.350553 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345559 2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 19:03:16.350553 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.345562 2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 19:03:16.350553 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345649 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 19:03:16.351154 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345654 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 19:03:16.351154 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345658 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 19:03:16.351154 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345661 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 19:03:16.351154 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345664 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 19:03:16.351154 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345667 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 19:03:16.351154 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345670 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 19:03:16.351154 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345673 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 19:03:16.351154 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345676 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 19:03:16.351154 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345678 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 19:03:16.351154 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345681 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 19:03:16.351154 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345684 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 19:03:16.351154 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345686 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 19:03:16.351154 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345689 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 19:03:16.351154 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345693 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 19:03:16.351154 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345695 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 19:03:16.351154 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345698 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 19:03:16.351154 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345701 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 19:03:16.351154 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345703 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 19:03:16.351154 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345706 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 19:03:16.351648 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345709 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 19:03:16.351648 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345711 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 19:03:16.351648 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345714 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 19:03:16.351648 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345716 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 19:03:16.351648 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345719 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 19:03:16.351648 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345722 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 19:03:16.351648 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345724 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 19:03:16.351648 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345726 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 19:03:16.351648 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345729 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 19:03:16.351648 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345731 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 19:03:16.351648 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345734 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 19:03:16.351648 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345737 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 19:03:16.351648 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345739 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 19:03:16.351648 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345750 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 19:03:16.351648 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345752 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 19:03:16.351648 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345755 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 19:03:16.351648 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345758 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 19:03:16.351648 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345760 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 19:03:16.351648 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345762 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 19:03:16.351648 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345765 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 19:03:16.352166 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345767 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 19:03:16.352166 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345770 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 19:03:16.352166 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345772 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 02 19:03:16.352166 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345775 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 19:03:16.352166 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345777 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 19:03:16.352166 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345794 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 19:03:16.352166 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345799 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 19:03:16.352166 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345803 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 19:03:16.352166 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345806 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 19:03:16.352166 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345809 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 19:03:16.352166 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345812 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 19:03:16.352166 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345815 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 19:03:16.352166 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345819 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 19:03:16.352166 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345822 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 19:03:16.352166 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345824 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 19:03:16.352166 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345827 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 19:03:16.352166 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345829 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 19:03:16.352166 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345832 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 19:03:16.352166 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345835 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 19:03:16.352166 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345837 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 19:03:16.352166 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345840 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 19:03:16.352750 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345842 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 19:03:16.352750 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345845 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 19:03:16.352750 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345847 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 19:03:16.352750 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345850 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 19:03:16.352750 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345855 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 19:03:16.352750 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345859 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 19:03:16.352750 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345862 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 19:03:16.352750 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345864 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 19:03:16.352750 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345867 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 19:03:16.352750 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345870 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 19:03:16.352750 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345873 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 19:03:16.352750 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345875 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 19:03:16.352750 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345878 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 19:03:16.352750 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345881 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 19:03:16.352750 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345883 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 19:03:16.352750 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345886 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 19:03:16.352750 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345888 2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 19:03:16.352750 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345892 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 19:03:16.352750 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345894 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 19:03:16.353475 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345897 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 19:03:16.353475 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345900 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 19:03:16.353475 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345902 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 19:03:16.353475 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345905 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 19:03:16.353475 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345908 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 19:03:16.353475 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.345910 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 19:03:16.353475 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.346538 2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 19:03:16.354392 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.354375 2557 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 19:03:16.354392 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.354392 2557 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 19:03:16.354461 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354437 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 19:03:16.354461 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354442 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 19:03:16.354461 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354446 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 19:03:16.354461 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354449 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 19:03:16.354461 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354452 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 19:03:16.354461 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354455 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 19:03:16.354461 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354458 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 19:03:16.354461 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354461 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 19:03:16.354461 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354464 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 19:03:16.354681 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354467 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 19:03:16.354681 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354470 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 19:03:16.354681 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354473 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 19:03:16.354681 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354476 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 19:03:16.354681 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354478 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 19:03:16.354681 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354481 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 19:03:16.354681 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354483 2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 19:03:16.354681 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354486 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 19:03:16.354681 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354489 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 19:03:16.354681 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354491 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 19:03:16.354681 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354494 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 19:03:16.354681 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354497 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 19:03:16.354681 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354500 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 19:03:16.354681 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354503 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 19:03:16.354681 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354505 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 19:03:16.354681 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354508 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 19:03:16.354681 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354510 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 19:03:16.354681 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354513 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 19:03:16.354681 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354515 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 19:03:16.354681 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354518 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 19:03:16.355172 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354520 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 19:03:16.355172 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354523 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 19:03:16.355172 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354525 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 19:03:16.355172 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354528 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 19:03:16.355172 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354530 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 19:03:16.355172 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354533 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 19:03:16.355172 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354535 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 19:03:16.355172 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354538 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 19:03:16.355172 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354542 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 19:03:16.355172 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354546 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 19:03:16.355172 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354549 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 19:03:16.355172 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354552 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 19:03:16.355172 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354554 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 19:03:16.355172 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354558 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 19:03:16.355172 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354560 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 19:03:16.355172 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354563 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 19:03:16.355172 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354566 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 19:03:16.355172 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354570 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 19:03:16.355172 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354574 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 19:03:16.355672 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354577 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 19:03:16.355672 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354580 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 19:03:16.355672 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354583 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 19:03:16.355672 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354586 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 19:03:16.355672 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354589 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 19:03:16.355672 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354592 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 19:03:16.355672 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354595 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 19:03:16.355672 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354597 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 19:03:16.355672 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354600 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 19:03:16.355672 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354602 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 19:03:16.355672 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354605 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 19:03:16.355672 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354607 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 19:03:16.355672 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354610 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 19:03:16.355672 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354613 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 19:03:16.355672 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354615 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 19:03:16.355672 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354618 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 19:03:16.355672 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354621 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 19:03:16.355672 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354623 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 19:03:16.355672 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354625 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 19:03:16.356131 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354628 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 19:03:16.356131 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354630 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 19:03:16.356131 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354633 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 19:03:16.356131 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354636 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 19:03:16.356131 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354638 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 02 19:03:16.356131 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354641 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 19:03:16.356131 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354643 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 19:03:16.356131 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354646 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 19:03:16.356131 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354648 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 19:03:16.356131 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354651 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 19:03:16.356131 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354654 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 19:03:16.356131 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354656 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 19:03:16.356131 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354659 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 19:03:16.356131 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354661 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 19:03:16.356131 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354664 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 19:03:16.356131 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354666 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 19:03:16.356131 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354668 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 19:03:16.356131 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354671 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 19:03:16.356131 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354673 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 19:03:16.356713 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.354679 2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 19:03:16.356713 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354768 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 19:03:16.356713 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354773 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 19:03:16.356713 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354776 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 19:03:16.356713 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354778 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 19:03:16.356713 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354781 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 19:03:16.356713 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354783 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 19:03:16.356713 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354786 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 19:03:16.356713 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354789 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 19:03:16.356713 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354791 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 19:03:16.356713 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354794 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 19:03:16.356713 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354796 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 19:03:16.356713 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354799 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 19:03:16.356713 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354801 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 19:03:16.356713 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354804 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 19:03:16.357112 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354806 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 19:03:16.357112 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354809 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 19:03:16.357112 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354811 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 19:03:16.357112 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354814 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 19:03:16.357112 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354816 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 19:03:16.357112 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354819 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 19:03:16.357112 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354822 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 19:03:16.357112 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354824 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 19:03:16.357112 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354829 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 19:03:16.357112 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354833 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 19:03:16.357112 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354835 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 19:03:16.357112 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354838 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 19:03:16.357112 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354841 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 19:03:16.357112 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354843 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 19:03:16.357112 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354846 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 19:03:16.357112 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354848 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 19:03:16.357112 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354851 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 19:03:16.357112 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354853 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 19:03:16.357112 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354856 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 19:03:16.357584 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354858 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 19:03:16.357584 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354861 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 19:03:16.357584 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354863 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 19:03:16.357584 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354865 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 19:03:16.357584 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354868 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 19:03:16.357584 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354870 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 19:03:16.357584 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354873 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 19:03:16.357584 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354875 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 19:03:16.357584 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354878 2557 feature_gate.go:328] unrecognized feature gate: Example Jun 02 19:03:16.357584 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354880 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 19:03:16.357584 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354883 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 19:03:16.357584 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354885 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 19:03:16.357584 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354889 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 19:03:16.357584 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354892 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 19:03:16.357584 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354894 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 19:03:16.357584 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354897 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 19:03:16.357584 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354900 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 19:03:16.357584 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354902 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 19:03:16.357584 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354905 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 19:03:16.358041 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354908 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 19:03:16.358041 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354910 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 19:03:16.358041 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354913 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 19:03:16.358041 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354916 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 19:03:16.358041 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354919 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 19:03:16.358041 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354921 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 19:03:16.358041 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354924 2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 19:03:16.358041 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354926 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 19:03:16.358041 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354929 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 19:03:16.358041 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354931 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 19:03:16.358041 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354933 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 19:03:16.358041 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354936 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 19:03:16.358041 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354938 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 19:03:16.358041 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354941 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 19:03:16.358041 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354943 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 19:03:16.358041 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354946 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 19:03:16.358041 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354948 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 19:03:16.358041 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354951 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 19:03:16.358041 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354953 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 19:03:16.358041 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354956 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 19:03:16.358547 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354958 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 19:03:16.358547 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354961 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 19:03:16.358547 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354963 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 19:03:16.358547 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354966 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 19:03:16.358547 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354968 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 19:03:16.358547 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354971 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 19:03:16.358547 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354973 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 19:03:16.358547 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354976 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 19:03:16.358547 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354979 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 19:03:16.358547 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354981 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 19:03:16.358547 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354984 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 19:03:16.358547 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354986 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 19:03:16.358547 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354989 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 19:03:16.358547 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:16.354992 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 19:03:16.358547 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.354997 2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 19:03:16.358925 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.355808 2557 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 19:03:16.360133 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.360120 2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 19:03:16.361030 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.361018 2557 server.go:1019] "Starting client certificate rotation" Jun 02 19:03:16.361141 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.361123 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 19:03:16.361194 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.361170 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 19:03:16.383968 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.383948 2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 19:03:16.387406 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.387388 2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 19:03:16.396942 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.396928 2557 log.go:25] "Validated CRI v1 runtime API" Jun 02 19:03:16.406906 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.406892 2557 log.go:25] "Validated CRI v1 image API" Jun 02 19:03:16.408785 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.408768 2557 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 19:03:16.411708 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.411690 2557 fs.go:135] Filesystem UUIDs: map[3f7c81f1-6e0d-48d2-ab3c-7f12b9aefef6:/dev/nvme0n1p3 75eb275a-669f-4b17-918f-716c7f32e30c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 02 19:03:16.411750 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.411709 2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 19:03:16.415996 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.415896 2557 manager.go:217] Machine: {Timestamp:2026-06-02 19:03:16.415412878 +0000 UTC m=+0.390314426 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100007 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2282adb92781ecf570777eee4fafe4 SystemUUID:ec2282ad-b927-81ec-f570-777eee4fafe4 BootID:97c84237-aa70-44d8-b807-23f51a75974e Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:77:38:1d:e2:7b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:77:38:1d:e2:7b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:7e:90:06:ad:63 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 19:03:16.415996 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.415996 2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 19:03:16.416104 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.416062 2557 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 19:03:16.417258 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.417235 2557 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 19:03:16.417436 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.417260 2557 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-177.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 19:03:16.417530 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.417453 2557 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 19:03:16.417530 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.417466 2557 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 19:03:16.417530 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.417476 2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 19:03:16.417530 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.417488 2557 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 19:03:16.420132 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.420119 2557 state_mem.go:36] "Initialized new in-memory state store" Jun 02 19:03:16.420263 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.420252 2557 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 19:03:16.420662 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.420647 2557 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 19:03:16.422389 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.422376 2557 kubelet.go:491] "Attempting to sync node with API server" Jun 02 19:03:16.422447 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.422395 2557 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 19:03:16.422447 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.422410 2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 19:03:16.422447 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.422422 2557 kubelet.go:397] "Adding apiserver pod source" Jun 02 19:03:16.422447 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.422433 2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 19:03:16.423454 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.423441 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 19:03:16.423523 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.423464 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 19:03:16.426742 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.426728 2557 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 19:03:16.428540 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.428526 2557 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 19:03:16.430228 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.430215 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 19:03:16.430228 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.430231 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 19:03:16.430341 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.430237 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 19:03:16.430341 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.430243 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 19:03:16.430341 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.430252 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 19:03:16.430341 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.430258 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 19:03:16.430341 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.430264 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 19:03:16.430341 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.430269 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 19:03:16.430341 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.430276 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 19:03:16.430341 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.430282 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 19:03:16.430341 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.430292 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 19:03:16.430341 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.430301 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 19:03:16.431904 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.431891 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 19:03:16.431904 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.431905 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 19:03:16.434818 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.434804 2557 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 19:03:16.434882 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.434839 2557 server.go:1295] "Started kubelet" Jun 02 19:03:16.434959 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.434921 2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 19:03:16.435653 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.435299 2557 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 19:03:16.435727 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.435672 2557 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 19:03:16.435686 ip-10-0-141-177 systemd[1]: Started Kubernetes Kubelet. Jun 02 19:03:16.436065 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:16.436016 2557 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 19:03:16.436065 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.436042 2557 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-177.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 19:03:16.436197 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:16.436108 2557 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-177.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 19:03:16.437079 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.437051 2557 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 19:03:16.438453 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.438439 2557 server.go:317] "Adding debug handlers to kubelet server" Jun 02 19:03:16.440992 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.440966 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 19:03:16.441145 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:16.440323 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-177.ec2.internal.18b558eb8f0352f2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-177.ec2.internal,UID:ip-10-0-141-177.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-177.ec2.internal,},FirstTimestamp:2026-06-02 19:03:16.434817778 +0000 UTC m=+0.409719306,LastTimestamp:2026-06-02 19:03:16.434817778 +0000 UTC m=+0.409719306,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-177.ec2.internal,}" Jun 02 19:03:16.441569 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.441553 2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 19:03:16.443428 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:16.443404 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found" Jun 02 19:03:16.443542 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.443522 2557 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 19:03:16.443542 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.443543 2557 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 19:03:16.443674 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.443662 2557 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 19:03:16.443723 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.443708 2557 reconstruct.go:97] "Volume reconstruction finished" Jun 02 19:03:16.443723 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.443716 2557 reconciler.go:26] "Reconciler: start to sync state" Jun 02 19:03:16.444223 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.444206 2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 19:03:16.444356 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.444343 2557 factory.go:55] Registering systemd factory Jun 02 19:03:16.444445 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.444437 2557 factory.go:223] Registration of the systemd container factory successfully Jun 02 19:03:16.444729 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:16.444705 2557 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 19:03:16.444829 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.444752 2557 factory.go:153] Registering CRI-O factory Jun 02 19:03:16.444829 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.444767 2557 factory.go:223] Registration of the crio container factory successfully Jun 02 19:03:16.444829 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.444790 2557 factory.go:103] Registering Raw factory Jun 02 19:03:16.444829 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.444806 2557 manager.go:1196] Started watching for new ooms in manager Jun 02 19:03:16.445387 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.445374 2557 manager.go:319] Starting recovery of all containers Jun 02 19:03:16.452557 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:16.452534 2557 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 02 19:03:16.452557 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:16.452539 2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-177.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 02 19:03:16.456140 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.456043 2557 manager.go:324] Recovery completed Jun 02 19:03:16.457690 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:16.457672 2557 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 02 19:03:16.460535 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.460524 2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 19:03:16.462133 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.462114 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientMemory" Jun 02 19:03:16.462204 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.462145 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 19:03:16.462204 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.462155 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientPID" Jun 02 19:03:16.462615 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.462601 2557 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 19:03:16.462615 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.462615 2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 19:03:16.462699 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.462631 2557 state_mem.go:36] "Initialized new in-memory state store" Jun 02 19:03:16.464243 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:16.464182 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-177.ec2.internal.18b558eb90a41b7d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-177.ec2.internal,UID:ip-10-0-141-177.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-177.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-177.ec2.internal,},FirstTimestamp:2026-06-02 19:03:16.462132093 +0000 UTC m=+0.437033621,LastTimestamp:2026-06-02 19:03:16.462132093 +0000 UTC m=+0.437033621,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-177.ec2.internal,}" Jun 02 19:03:16.465067 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.465056 2557 policy_none.go:49] "None policy: Start" Jun 02 19:03:16.465102 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.465072 2557 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 19:03:16.465102 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.465082 2557 state_mem.go:35] "Initializing new in-memory state store" Jun 02 19:03:16.467468 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.467454 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q8rbd" Jun 02 19:03:16.474711 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.474694 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q8rbd" Jun 02 19:03:16.476812 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:16.476760 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-177.ec2.internal.18b558eb90a46098 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-177.ec2.internal,UID:ip-10-0-141-177.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-177.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-177.ec2.internal,},FirstTimestamp:2026-06-02 19:03:16.462149784 +0000 UTC m=+0.437051312,LastTimestamp:2026-06-02 19:03:16.462149784 +0000 UTC m=+0.437051312,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-177.ec2.internal,}" Jun 02 19:03:16.508853 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.508836 2557 manager.go:341] "Starting Device Plugin manager" Jun 02 19:03:16.519300 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:16.508875 2557 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 19:03:16.519300 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.508888 2557 server.go:85] "Starting device plugin registration server" Jun 02 19:03:16.519300 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.509074 2557 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 19:03:16.519300 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.509085 2557 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 19:03:16.519300 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.509614 2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 19:03:16.519300 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.509688 2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 19:03:16.519300 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.509695 2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 19:03:16.519300 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:16.510125 2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 19:03:16.519300 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:16.510165 2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-177.ec2.internal\" not found" Jun 02 19:03:16.548137 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.548115 2557 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 19:03:16.549253 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.549237 2557 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 19:03:16.549253 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.549254 2557 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 19:03:16.549399 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.549268 2557 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 19:03:16.549399 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.549274 2557 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 19:03:16.549399 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:16.549320 2557 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 19:03:16.551167 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.551153 2557 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 19:03:16.610832 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.610787 2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 19:03:16.611490 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.611473 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientMemory" Jun 02 19:03:16.611627 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.611496 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 19:03:16.611627 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.611508 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientPID" Jun 02 19:03:16.611627 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.611530 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-177.ec2.internal" Jun 02 19:03:16.619923 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.619909 2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-177.ec2.internal" Jun 02 19:03:16.619994 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:16.619927 2557 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-177.ec2.internal\": node \"ip-10-0-141-177.ec2.internal\" not found" Jun 02 19:03:16.639821 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:16.639800 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found" Jun 02 19:03:16.650090 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.650052 2557 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal"] Jun 02 19:03:16.650170 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.650131 2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 19:03:16.651389 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.651375 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientMemory" Jun 02 19:03:16.651455 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.651399 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 19:03:16.651455 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.651408 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientPID" Jun 02 19:03:16.652584 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.652572 2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 19:03:16.652783 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.652766 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" Jun 02 19:03:16.652822 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.652798 2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 19:03:16.653168 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.653155 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientMemory" Jun 02 19:03:16.653224 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.653176 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 19:03:16.653224 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.653188 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientPID" Jun 02 19:03:16.653224 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.653212 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientMemory" Jun 02 19:03:16.653328 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.653230 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 19:03:16.653328 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.653240 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientPID" Jun 02 19:03:16.654414 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.654400 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal" Jun 02 19:03:16.654473 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.654422 2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 19:03:16.655069 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.655046 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientMemory" Jun 02 19:03:16.655069 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.655071 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 19:03:16.655198 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.655084 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeHasSufficientPID" Jun 02 19:03:16.678943 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:16.678925 2557 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-177.ec2.internal\" not found" node="ip-10-0-141-177.ec2.internal" Jun 02 19:03:16.683178 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:16.683164 2557 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-177.ec2.internal\" not found" node="ip-10-0-141-177.ec2.internal" Jun 02 19:03:16.740279 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:16.740260 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found" Jun 02 19:03:16.840828 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:16.840804 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found" Jun 02 19:03:16.845062 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.845047 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4669e9fdc58fcc49647e48b529e468a8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal\" (UID: \"4669e9fdc58fcc49647e48b529e468a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" Jun 02 19:03:16.845105 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.845071 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4669e9fdc58fcc49647e48b529e468a8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal\" (UID: \"4669e9fdc58fcc49647e48b529e468a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" Jun 02 19:03:16.845105 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.845088 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/00ab6e9e70b3869b45a8dbd4d89dd58d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-177.ec2.internal\" (UID: \"00ab6e9e70b3869b45a8dbd4d89dd58d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal" Jun 02 19:03:16.941506 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:16.941455 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found" Jun 02 19:03:16.945827 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.945809 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4669e9fdc58fcc49647e48b529e468a8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal\" (UID: \"4669e9fdc58fcc49647e48b529e468a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" Jun 02 19:03:16.945899 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.945842 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4669e9fdc58fcc49647e48b529e468a8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal\" (UID: \"4669e9fdc58fcc49647e48b529e468a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" Jun 02 19:03:16.945899 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.945870 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/00ab6e9e70b3869b45a8dbd4d89dd58d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-177.ec2.internal\" (UID: \"00ab6e9e70b3869b45a8dbd4d89dd58d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal" Jun 02 19:03:16.945985 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.945902 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4669e9fdc58fcc49647e48b529e468a8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal\" (UID: \"4669e9fdc58fcc49647e48b529e468a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" Jun 02 19:03:16.945985 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.945909 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4669e9fdc58fcc49647e48b529e468a8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal\" (UID: \"4669e9fdc58fcc49647e48b529e468a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" Jun 02 19:03:16.945985 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.945920 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/00ab6e9e70b3869b45a8dbd4d89dd58d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-177.ec2.internal\" (UID: \"00ab6e9e70b3869b45a8dbd4d89dd58d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal" Jun 02 19:03:16.981932 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.981915 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" Jun 02 19:03:16.986471 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:16.986416 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal" Jun 02 19:03:17.042093 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:17.042072 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found" Jun 02 19:03:17.142551 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:17.142533 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found" Jun 02 19:03:17.243080 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:17.243016 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found" Jun 02 19:03:17.343421 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:17.343402 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found" Jun 02 19:03:17.360786 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:17.360764 2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 19:03:17.360938 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:17.360920 2557 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 19:03:17.441085 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:17.441057 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 19:03:17.444244 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:17.444227 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found" Jun 02 19:03:17.453934 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:17.453896 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4669e9fdc58fcc49647e48b529e468a8.slice/crio-b5f983f646754ff7f376631a8b3322b91c16d78372c504e375bb9e9231d9637d WatchSource:0}: Error finding container b5f983f646754ff7f376631a8b3322b91c16d78372c504e375bb9e9231d9637d: Status 404 returned error can't find the container with id b5f983f646754ff7f376631a8b3322b91c16d78372c504e375bb9e9231d9637d Jun 02 19:03:17.456383 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:17.456365 2557 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 19:03:17.457446 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:17.457422 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00ab6e9e70b3869b45a8dbd4d89dd58d.slice/crio-5d9e083ff27c4e9a23f95a80ca9025e38d3c48cc279cc0d149678fb63bff8cdb WatchSource:0}: Error finding container 5d9e083ff27c4e9a23f95a80ca9025e38d3c48cc279cc0d149678fb63bff8cdb: Status 404 returned error can't find the container with id 5d9e083ff27c4e9a23f95a80ca9025e38d3c48cc279cc0d149678fb63bff8cdb Jun 02 19:03:17.458273 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:17.458257 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 19:03:17.477560 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:17.477535 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 18:58:16 +0000 UTC" deadline="2028-01-09 00:38:00.93910373 +0000 UTC" Jun 02 19:03:17.477560 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:17.477559 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14045h34m43.461547494s" Jun 02 19:03:17.480444 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:17.480428 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8rvh9" Jun 02 19:03:17.487929 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:17.487917 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8rvh9" Jun 02 19:03:17.544693 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:17.544644 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found" Jun 02 19:03:17.551512 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:17.551480 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal" event={"ID":"00ab6e9e70b3869b45a8dbd4d89dd58d","Type":"ContainerStarted","Data":"5d9e083ff27c4e9a23f95a80ca9025e38d3c48cc279cc0d149678fb63bff8cdb"} Jun 02 19:03:17.552434 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:17.552416 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" event={"ID":"4669e9fdc58fcc49647e48b529e468a8","Type":"ContainerStarted","Data":"b5f983f646754ff7f376631a8b3322b91c16d78372c504e375bb9e9231d9637d"} Jun 02 19:03:17.644718 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:17.644695 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found" Jun 02 19:03:17.745161 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:17.745134 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found" Jun 02 19:03:17.747742 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:17.747727 2557 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 19:03:17.846144 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:17.846093 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-177.ec2.internal\" not found" Jun 02 19:03:17.846498 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:17.846487 2557 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 19:03:17.862245 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:17.862228 2557 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 19:03:17.943593 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:17.943573 2557 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" Jun 02 19:03:17.957928 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:17.957912 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 19:03:17.958774 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:17.958763 2557 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal" Jun 02 19:03:17.966648 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:17.966634 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 19:03:18.423860 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.423830 2557 apiserver.go:52] "Watching apiserver" Jun 02 19:03:18.432666 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.432639 2557 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 19:03:18.434557 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.434529 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-rtm24","openshift-network-diagnostics/network-check-target-pzkk4","kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal","openshift-multus/multus-additional-cni-plugins-jr7p2","openshift-network-operator/iptables-alerter-4sslh","openshift-ovn-kubernetes/ovnkube-node-hstll","kube-system/konnectivity-agent-pclcs","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwhv6","openshift-cluster-node-tuning-operator/tuned-whmqd","openshift-image-registry/node-ca-6ddrs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal","openshift-multus/multus-ncxcn"] Jun 02 19:03:18.435926 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.435908 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:18.436020 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:18.435977 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtm24" podUID="c06cfb25-324b-408a-a07f-63de6128d0f3" Jun 02 19:03:18.436926 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.436909 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:03:18.437012 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:18.436963 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pzkk4" podUID="4d905ff7-fad0-4198-a83a-4256a1106d7d" Jun 02 19:03:18.438940 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.438912 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jr7p2" Jun 02 19:03:18.440139 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.439860 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4sslh" Jun 02 19:03:18.440139 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.439936 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pclcs" Jun 02 19:03:18.441375 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.441300 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwhv6" Jun 02 19:03:18.444175 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.442621 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 19:03:18.444175 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.442827 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 19:03:18.444175 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.442922 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 19:03:18.444175 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.443250 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-j2zm2\"" Jun 02 19:03:18.444175 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.443251 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 19:03:18.444175 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.443371 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 19:03:18.444175 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.443599 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 19:03:18.444175 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.443678 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 19:03:18.444175 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.443949 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 19:03:18.444175 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.444129 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 19:03:18.444677 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.444303 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cpmww\"" Jun 02 19:03:18.444731 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.444696 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ldlpd\"" Jun 02 19:03:18.445227 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.444857 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 19:03:18.445227 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.445138 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 19:03:18.445227 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.445166 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 19:03:18.445227 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.445172 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 19:03:18.445931 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.445912 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.446514 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.446497 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xkdwx\"" Jun 02 19:03:18.447550 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.447532 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6ddrs" Jun 02 19:03:18.448447 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.448373 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lsm8p\"" Jun 02 19:03:18.448447 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.448435 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 19:03:18.448864 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.448846 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.449452 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.449434 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 19:03:18.449932 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.449755 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nzqhn\"" Jun 02 19:03:18.450058 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.450044 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 19:03:18.450122 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.450084 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 19:03:18.450182 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.450122 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.450232 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.450046 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 19:03:18.451119 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.451062 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dfzcz\"" Jun 02 19:03:18.451223 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.451127 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 19:03:18.452820 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.452800 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 19:03:18.452910 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.452892 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 19:03:18.452973 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.452893 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 19:03:18.452973 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.452917 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 19:03:18.452973 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.452918 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nfhq6\"" Jun 02 19:03:18.452973 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.452805 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 19:03:18.453486 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.453470 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-etc-systemd\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.453573 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.453497 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-run\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.453573 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.453522 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sczk\" (UniqueName: \"kubernetes.io/projected/4d905ff7-fad0-4198-a83a-4256a1106d7d-kube-api-access-2sczk\") pod \"network-check-target-pzkk4\" (UID: \"4d905ff7-fad0-4198-a83a-4256a1106d7d\") " pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:03:18.453684 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.453569 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8fa3d670-e63b-43c3-ad81-5c43997d083b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dwhv6\" (UID: \"8fa3d670-e63b-43c3-ad81-5c43997d083b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwhv6" Jun 02 19:03:18.453684 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.453595 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c06cfb25-324b-408a-a07f-63de6128d0f3-metrics-certs\") pod \"network-metrics-daemon-rtm24\" (UID: \"c06cfb25-324b-408a-a07f-63de6128d0f3\") " pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:18.453684 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.453622 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8fa3d670-e63b-43c3-ad81-5c43997d083b-socket-dir\") pod \"aws-ebs-csi-driver-node-dwhv6\" (UID: \"8fa3d670-e63b-43c3-ad81-5c43997d083b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwhv6" Jun 02 19:03:18.453684 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.453653 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8fa3d670-e63b-43c3-ad81-5c43997d083b-registration-dir\") pod \"aws-ebs-csi-driver-node-dwhv6\" (UID: \"8fa3d670-e63b-43c3-ad81-5c43997d083b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwhv6" Jun 02 19:03:18.453684 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.453676 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8fa3d670-e63b-43c3-ad81-5c43997d083b-etc-selinux\") pod \"aws-ebs-csi-driver-node-dwhv6\" (UID: \"8fa3d670-e63b-43c3-ad81-5c43997d083b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwhv6" Jun 02 19:03:18.453941 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.453699 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8fa3d670-e63b-43c3-ad81-5c43997d083b-sys-fs\") pod \"aws-ebs-csi-driver-node-dwhv6\" (UID: \"8fa3d670-e63b-43c3-ad81-5c43997d083b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwhv6" Jun 02 19:03:18.453941 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.453721 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-lib-modules\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.453941 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.453822 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-etc-tuned\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.453941 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.453862 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-sys\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.453941 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.453885 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-var-lib-kubelet\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.453941 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.453909 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0d46be99-6b62-4c3d-8106-257edfbba1ac-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jr7p2\" (UID: \"0d46be99-6b62-4c3d-8106-257edfbba1ac\") " pod="openshift-multus/multus-additional-cni-plugins-jr7p2" Jun 02 19:03:18.453941 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.453926 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x85pb\" (UniqueName: \"kubernetes.io/projected/8fa3d670-e63b-43c3-ad81-5c43997d083b-kube-api-access-x85pb\") pod \"aws-ebs-csi-driver-node-dwhv6\" (UID: \"8fa3d670-e63b-43c3-ad81-5c43997d083b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwhv6" Jun 02 19:03:18.453941 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.453941 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-etc-kubernetes\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.454321 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.453956 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-host\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.454321 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.453976 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-tmp\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.454321 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.453990 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8sg5\" (UniqueName: \"kubernetes.io/projected/0d46be99-6b62-4c3d-8106-257edfbba1ac-kube-api-access-c8sg5\") pod \"multus-additional-cni-plugins-jr7p2\" (UID: \"0d46be99-6b62-4c3d-8106-257edfbba1ac\") " pod="openshift-multus/multus-additional-cni-plugins-jr7p2" Jun 02 19:03:18.454321 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.454005 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1fca4d91-f894-4c30-a0df-583ee61b5f2e-konnectivity-ca\") pod \"konnectivity-agent-pclcs\" (UID: \"1fca4d91-f894-4c30-a0df-583ee61b5f2e\") " pod="kube-system/konnectivity-agent-pclcs" Jun 02 19:03:18.454321 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.454024 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddkv6\" (UniqueName: \"kubernetes.io/projected/10a30f16-e658-4abd-bed5-f0521177b19f-kube-api-access-ddkv6\") pod \"iptables-alerter-4sslh\" (UID: \"10a30f16-e658-4abd-bed5-f0521177b19f\") " pod="openshift-network-operator/iptables-alerter-4sslh" Jun 02 19:03:18.454321 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.454058 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 19:03:18.454321 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.454060 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-etc-sysctl-d\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.454321 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.454103 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0d46be99-6b62-4c3d-8106-257edfbba1ac-os-release\") pod \"multus-additional-cni-plugins-jr7p2\" (UID: \"0d46be99-6b62-4c3d-8106-257edfbba1ac\") " pod="openshift-multus/multus-additional-cni-plugins-jr7p2" Jun 02 19:03:18.454321 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.454126 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntrcd\" (UniqueName: \"kubernetes.io/projected/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-kube-api-access-ntrcd\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.454321 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.454216 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d46be99-6b62-4c3d-8106-257edfbba1ac-system-cni-dir\") pod \"multus-additional-cni-plugins-jr7p2\" (UID: \"0d46be99-6b62-4c3d-8106-257edfbba1ac\") " pod="openshift-multus/multus-additional-cni-plugins-jr7p2" Jun 02 19:03:18.454321 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.454235 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0d46be99-6b62-4c3d-8106-257edfbba1ac-cnibin\") pod \"multus-additional-cni-plugins-jr7p2\" (UID: \"0d46be99-6b62-4c3d-8106-257edfbba1ac\") " pod="openshift-multus/multus-additional-cni-plugins-jr7p2" Jun 02 19:03:18.454321 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.454282 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0d46be99-6b62-4c3d-8106-257edfbba1ac-cni-binary-copy\") pod \"multus-additional-cni-plugins-jr7p2\" (UID: \"0d46be99-6b62-4c3d-8106-257edfbba1ac\") " pod="openshift-multus/multus-additional-cni-plugins-jr7p2" Jun 02 19:03:18.454867 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.454341 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0d46be99-6b62-4c3d-8106-257edfbba1ac-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jr7p2\" (UID: \"0d46be99-6b62-4c3d-8106-257edfbba1ac\") " pod="openshift-multus/multus-additional-cni-plugins-jr7p2" Jun 02 19:03:18.454867 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.454366 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0d46be99-6b62-4c3d-8106-257edfbba1ac-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jr7p2\" (UID: \"0d46be99-6b62-4c3d-8106-257edfbba1ac\") " pod="openshift-multus/multus-additional-cni-plugins-jr7p2" Jun 02 19:03:18.454867 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.454388 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10a30f16-e658-4abd-bed5-f0521177b19f-host-slash\") pod \"iptables-alerter-4sslh\" (UID: \"10a30f16-e658-4abd-bed5-f0521177b19f\") " pod="openshift-network-operator/iptables-alerter-4sslh" Jun 02 19:03:18.454867 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.454411 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8fa3d670-e63b-43c3-ad81-5c43997d083b-device-dir\") pod \"aws-ebs-csi-driver-node-dwhv6\" (UID: \"8fa3d670-e63b-43c3-ad81-5c43997d083b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwhv6" Jun 02 19:03:18.454867 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.454441 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-etc-sysconfig\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.454867 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.454465 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt6wd\" (UniqueName: \"kubernetes.io/projected/c06cfb25-324b-408a-a07f-63de6128d0f3-kube-api-access-mt6wd\") pod \"network-metrics-daemon-rtm24\" (UID: \"c06cfb25-324b-408a-a07f-63de6128d0f3\") " pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:18.454867 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.454512 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1fca4d91-f894-4c30-a0df-583ee61b5f2e-agent-certs\") pod \"konnectivity-agent-pclcs\" (UID: \"1fca4d91-f894-4c30-a0df-583ee61b5f2e\") " pod="kube-system/konnectivity-agent-pclcs" Jun 02 19:03:18.454867 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.454535 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/10a30f16-e658-4abd-bed5-f0521177b19f-iptables-alerter-script\") pod \"iptables-alerter-4sslh\" (UID: \"10a30f16-e658-4abd-bed5-f0521177b19f\") " pod="openshift-network-operator/iptables-alerter-4sslh" Jun 02 19:03:18.454867 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.454588 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-etc-modprobe-d\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.454867 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.454618 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-etc-sysctl-conf\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.488459 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.488437 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 18:58:17 +0000 UTC" deadline="2027-11-12 08:23:39.644211867 +0000 UTC" Jun 02 19:03:18.488459 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.488459 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12661h20m21.155756884s" Jun 02 19:03:18.545322 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.545287 2557 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 19:03:18.554840 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.554813 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fa99b71f-8897-4e26-97f1-40619c45e006-env-overrides\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.554951 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.554854 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-cni-binary-copy\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.554951 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.554878 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-host-run-netns\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.554951 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.554937 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-host-var-lib-kubelet\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.555107 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.554976 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-etc-openvswitch\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.555107 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555008 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8fa3d670-e63b-43c3-ad81-5c43997d083b-sys-fs\") pod \"aws-ebs-csi-driver-node-dwhv6\" (UID: \"8fa3d670-e63b-43c3-ad81-5c43997d083b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwhv6" Jun 02 19:03:18.555107 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555034 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-etc-tuned\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.555107 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555059 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-host-cni-bin\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.555107 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555083 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-sys\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.555107 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555107 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-host-var-lib-cni-bin\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.555359 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555131 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-etc-kubernetes\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.555359 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555162 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x85pb\" (UniqueName: \"kubernetes.io/projected/8fa3d670-e63b-43c3-ad81-5c43997d083b-kube-api-access-x85pb\") pod \"aws-ebs-csi-driver-node-dwhv6\" (UID: \"8fa3d670-e63b-43c3-ad81-5c43997d083b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwhv6" Jun 02 19:03:18.555359 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555186 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-host\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.555359 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555207 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-tmp\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.555359 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555231 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b0840a32-3528-4cef-aec6-d62b0f977e98-serviceca\") pod \"node-ca-6ddrs\" (UID: \"b0840a32-3528-4cef-aec6-d62b0f977e98\") " pod="openshift-image-registry/node-ca-6ddrs" Jun 02 19:03:18.555359 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555257 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1fca4d91-f894-4c30-a0df-583ee61b5f2e-konnectivity-ca\") pod \"konnectivity-agent-pclcs\" (UID: \"1fca4d91-f894-4c30-a0df-583ee61b5f2e\") " pod="kube-system/konnectivity-agent-pclcs" Jun 02 19:03:18.555359 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555282 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-system-cni-dir\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.555359 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555320 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-host-run-multus-certs\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.555359 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555347 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-systemd-units\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.555713 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555369 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-log-socket\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.555713 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555403 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ntrcd\" (UniqueName: \"kubernetes.io/projected/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-kube-api-access-ntrcd\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.555713 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555426 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-cnibin\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.555713 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555448 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-multus-conf-dir\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.555713 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555486 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-multus-daemon-config\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.555713 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555510 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxsx6\" (UniqueName: \"kubernetes.io/projected/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-kube-api-access-dxsx6\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.555713 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555534 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-run-openvswitch\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.555713 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555559 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0d46be99-6b62-4c3d-8106-257edfbba1ac-cnibin\") pod \"multus-additional-cni-plugins-jr7p2\" (UID: \"0d46be99-6b62-4c3d-8106-257edfbba1ac\") " pod="openshift-multus/multus-additional-cni-plugins-jr7p2" Jun 02 19:03:18.555713 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555585 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0d46be99-6b62-4c3d-8106-257edfbba1ac-cni-binary-copy\") pod \"multus-additional-cni-plugins-jr7p2\" (UID: \"0d46be99-6b62-4c3d-8106-257edfbba1ac\") " pod="openshift-multus/multus-additional-cni-plugins-jr7p2" Jun 02 19:03:18.555713 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555613 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8fa3d670-e63b-43c3-ad81-5c43997d083b-device-dir\") pod \"aws-ebs-csi-driver-node-dwhv6\" (UID: \"8fa3d670-e63b-43c3-ad81-5c43997d083b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwhv6" Jun 02 19:03:18.555713 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555637 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-run\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.555713 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555667 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-os-release\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.555713 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555667 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8fa3d670-e63b-43c3-ad81-5c43997d083b-sys-fs\") pod \"aws-ebs-csi-driver-node-dwhv6\" (UID: \"8fa3d670-e63b-43c3-ad81-5c43997d083b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwhv6" Jun 02 19:03:18.555713 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555692 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fa99b71f-8897-4e26-97f1-40619c45e006-ovn-node-metrics-cert\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.555713 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555719 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1fca4d91-f894-4c30-a0df-583ee61b5f2e-agent-certs\") pod \"konnectivity-agent-pclcs\" (UID: \"1fca4d91-f894-4c30-a0df-583ee61b5f2e\") " pod="kube-system/konnectivity-agent-pclcs" Jun 02 19:03:18.556340 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555745 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-etc-sysctl-conf\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.556340 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555771 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2sczk\" (UniqueName: \"kubernetes.io/projected/4d905ff7-fad0-4198-a83a-4256a1106d7d-kube-api-access-2sczk\") pod \"network-check-target-pzkk4\" (UID: \"4d905ff7-fad0-4198-a83a-4256a1106d7d\") " pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:03:18.556340 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555796 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8fa3d670-e63b-43c3-ad81-5c43997d083b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dwhv6\" (UID: \"8fa3d670-e63b-43c3-ad81-5c43997d083b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwhv6" Jun 02 19:03:18.556340 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555839 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-host-slash\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.556340 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555870 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.556340 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555898 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0840a32-3528-4cef-aec6-d62b0f977e98-host\") pod \"node-ca-6ddrs\" (UID: \"b0840a32-3528-4cef-aec6-d62b0f977e98\") " pod="openshift-image-registry/node-ca-6ddrs" Jun 02 19:03:18.556340 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555925 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c06cfb25-324b-408a-a07f-63de6128d0f3-metrics-certs\") pod \"network-metrics-daemon-rtm24\" (UID: \"c06cfb25-324b-408a-a07f-63de6128d0f3\") " pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:18.556340 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555951 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8fa3d670-e63b-43c3-ad81-5c43997d083b-socket-dir\") pod \"aws-ebs-csi-driver-node-dwhv6\" (UID: \"8fa3d670-e63b-43c3-ad81-5c43997d083b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwhv6" Jun 02 19:03:18.556340 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555970 2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 19:03:18.556340 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.556054 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8fa3d670-e63b-43c3-ad81-5c43997d083b-registration-dir\") pod \"aws-ebs-csi-driver-node-dwhv6\" (UID: \"8fa3d670-e63b-43c3-ad81-5c43997d083b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwhv6" Jun 02 19:03:18.556763 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.556436 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-sys\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.556763 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.556445 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8fa3d670-e63b-43c3-ad81-5c43997d083b-device-dir\") pod \"aws-ebs-csi-driver-node-dwhv6\" (UID: \"8fa3d670-e63b-43c3-ad81-5c43997d083b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwhv6" Jun 02 19:03:18.556763 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.556502 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-host\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.556763 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.556572 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1fca4d91-f894-4c30-a0df-583ee61b5f2e-konnectivity-ca\") pod \"konnectivity-agent-pclcs\" (UID: \"1fca4d91-f894-4c30-a0df-583ee61b5f2e\") " pod="kube-system/konnectivity-agent-pclcs" Jun 02 19:03:18.556763 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.556595 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0d46be99-6b62-4c3d-8106-257edfbba1ac-cnibin\") pod \"multus-additional-cni-plugins-jr7p2\" (UID: \"0d46be99-6b62-4c3d-8106-257edfbba1ac\") " pod="openshift-multus/multus-additional-cni-plugins-jr7p2" Jun 02 19:03:18.556763 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.555994 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8fa3d670-e63b-43c3-ad81-5c43997d083b-registration-dir\") pod \"aws-ebs-csi-driver-node-dwhv6\" (UID: \"8fa3d670-e63b-43c3-ad81-5c43997d083b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwhv6" Jun 02 19:03:18.557052 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.556816 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-run\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.557052 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.556824 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8fa3d670-e63b-43c3-ad81-5c43997d083b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dwhv6\" (UID: \"8fa3d670-e63b-43c3-ad81-5c43997d083b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwhv6" Jun 02 19:03:18.557052 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.556865 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-etc-sysctl-conf\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.557609 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.557226 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0d46be99-6b62-4c3d-8106-257edfbba1ac-cni-binary-copy\") pod \"multus-additional-cni-plugins-jr7p2\" (UID: \"0d46be99-6b62-4c3d-8106-257edfbba1ac\") " pod="openshift-multus/multus-additional-cni-plugins-jr7p2" Jun 02 19:03:18.557609 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.557290 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8fa3d670-e63b-43c3-ad81-5c43997d083b-etc-selinux\") pod \"aws-ebs-csi-driver-node-dwhv6\" (UID: \"8fa3d670-e63b-43c3-ad81-5c43997d083b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwhv6" Jun 02 19:03:18.557609 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:18.557321 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:18.557609 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.557332 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8fa3d670-e63b-43c3-ad81-5c43997d083b-socket-dir\") pod \"aws-ebs-csi-driver-node-dwhv6\" (UID: \"8fa3d670-e63b-43c3-ad81-5c43997d083b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwhv6" Jun 02 19:03:18.557609 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.557366 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-lib-modules\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.557609 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:18.557416 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06cfb25-324b-408a-a07f-63de6128d0f3-metrics-certs podName:c06cfb25-324b-408a-a07f-63de6128d0f3 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:19.057371045 +0000 UTC m=+3.032272574 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c06cfb25-324b-408a-a07f-63de6128d0f3-metrics-certs") pod "network-metrics-daemon-rtm24" (UID: "c06cfb25-324b-408a-a07f-63de6128d0f3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:18.557609 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.557413 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8fa3d670-e63b-43c3-ad81-5c43997d083b-etc-selinux\") pod \"aws-ebs-csi-driver-node-dwhv6\" (UID: \"8fa3d670-e63b-43c3-ad81-5c43997d083b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwhv6" Jun 02 19:03:18.557609 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.557470 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-lib-modules\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.557609 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.557481 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-host-kubelet\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.557609 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.557525 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fa99b71f-8897-4e26-97f1-40619c45e006-ovnkube-script-lib\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.557609 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.557560 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-var-lib-kubelet\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.557609 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.557585 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-host-run-netns\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.558234 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.557633 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-var-lib-kubelet\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.558234 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.557674 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2jxj\" (UniqueName: \"kubernetes.io/projected/fa99b71f-8897-4e26-97f1-40619c45e006-kube-api-access-h2jxj\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.558234 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.557766 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0d46be99-6b62-4c3d-8106-257edfbba1ac-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jr7p2\" (UID: \"0d46be99-6b62-4c3d-8106-257edfbba1ac\") " pod="openshift-multus/multus-additional-cni-plugins-jr7p2" Jun 02 19:03:18.558234 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.557808 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-etc-kubernetes\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.558234 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.557839 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-hostroot\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.558234 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.557869 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fa99b71f-8897-4e26-97f1-40619c45e006-ovnkube-config\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.558234 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.557884 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0d46be99-6b62-4c3d-8106-257edfbba1ac-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jr7p2\" (UID: \"0d46be99-6b62-4c3d-8106-257edfbba1ac\") " pod="openshift-multus/multus-additional-cni-plugins-jr7p2" Jun 02 19:03:18.558234 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.557892 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xff7s\" (UniqueName: \"kubernetes.io/projected/b0840a32-3528-4cef-aec6-d62b0f977e98-kube-api-access-xff7s\") pod \"node-ca-6ddrs\" (UID: \"b0840a32-3528-4cef-aec6-d62b0f977e98\") " pod="openshift-image-registry/node-ca-6ddrs" Jun 02 19:03:18.558234 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.557913 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-etc-kubernetes\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.558234 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.557927 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c8sg5\" (UniqueName: \"kubernetes.io/projected/0d46be99-6b62-4c3d-8106-257edfbba1ac-kube-api-access-c8sg5\") pod \"multus-additional-cni-plugins-jr7p2\" (UID: \"0d46be99-6b62-4c3d-8106-257edfbba1ac\") " pod="openshift-multus/multus-additional-cni-plugins-jr7p2" Jun 02 19:03:18.558234 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.557961 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ddkv6\" (UniqueName: \"kubernetes.io/projected/10a30f16-e658-4abd-bed5-f0521177b19f-kube-api-access-ddkv6\") pod \"iptables-alerter-4sslh\" (UID: \"10a30f16-e658-4abd-bed5-f0521177b19f\") " pod="openshift-network-operator/iptables-alerter-4sslh" Jun 02 19:03:18.558234 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.558071 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-etc-sysctl-d\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.558234 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.558101 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-host-run-ovn-kubernetes\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.558234 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.558183 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-host-cni-netd\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.558234 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.558198 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-etc-sysctl-d\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.558234 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.558226 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0d46be99-6b62-4c3d-8106-257edfbba1ac-os-release\") pod \"multus-additional-cni-plugins-jr7p2\" (UID: \"0d46be99-6b62-4c3d-8106-257edfbba1ac\") " pod="openshift-multus/multus-additional-cni-plugins-jr7p2" Jun 02 19:03:18.558970 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.558253 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-multus-cni-dir\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.558970 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.558277 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-multus-socket-dir-parent\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.558970 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.558300 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-host-run-k8s-cni-cncf-io\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.558970 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.558337 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-host-var-lib-cni-multus\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.558970 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.558351 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0d46be99-6b62-4c3d-8106-257edfbba1ac-os-release\") pod \"multus-additional-cni-plugins-jr7p2\" (UID: \"0d46be99-6b62-4c3d-8106-257edfbba1ac\") " pod="openshift-multus/multus-additional-cni-plugins-jr7p2" Jun 02 19:03:18.558970 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.558357 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-var-lib-openvswitch\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.558970 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.558378 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-run-ovn\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.558970 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.558409 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d46be99-6b62-4c3d-8106-257edfbba1ac-system-cni-dir\") pod \"multus-additional-cni-plugins-jr7p2\" (UID: \"0d46be99-6b62-4c3d-8106-257edfbba1ac\") " pod="openshift-multus/multus-additional-cni-plugins-jr7p2" Jun 02 19:03:18.558970 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.558432 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0d46be99-6b62-4c3d-8106-257edfbba1ac-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jr7p2\" (UID: \"0d46be99-6b62-4c3d-8106-257edfbba1ac\") " pod="openshift-multus/multus-additional-cni-plugins-jr7p2" Jun 02 19:03:18.558970 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.558460 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0d46be99-6b62-4c3d-8106-257edfbba1ac-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jr7p2\" (UID: \"0d46be99-6b62-4c3d-8106-257edfbba1ac\") " pod="openshift-multus/multus-additional-cni-plugins-jr7p2" Jun 02 19:03:18.558970 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.558493 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10a30f16-e658-4abd-bed5-f0521177b19f-host-slash\") pod \"iptables-alerter-4sslh\" (UID: \"10a30f16-e658-4abd-bed5-f0521177b19f\") " pod="openshift-network-operator/iptables-alerter-4sslh" Jun 02 19:03:18.558970 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.558513 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d46be99-6b62-4c3d-8106-257edfbba1ac-system-cni-dir\") pod \"multus-additional-cni-plugins-jr7p2\" (UID: \"0d46be99-6b62-4c3d-8106-257edfbba1ac\") " pod="openshift-multus/multus-additional-cni-plugins-jr7p2" Jun 02 19:03:18.558970 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.558515 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-etc-sysconfig\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.558970 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.558557 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-node-log\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.558970 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.558562 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-etc-sysconfig\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.558970 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.558587 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mt6wd\" (UniqueName: \"kubernetes.io/projected/c06cfb25-324b-408a-a07f-63de6128d0f3-kube-api-access-mt6wd\") pod \"network-metrics-daemon-rtm24\" (UID: \"c06cfb25-324b-408a-a07f-63de6128d0f3\") " pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:18.558970 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.558599 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10a30f16-e658-4abd-bed5-f0521177b19f-host-slash\") pod \"iptables-alerter-4sslh\" (UID: \"10a30f16-e658-4abd-bed5-f0521177b19f\") " pod="openshift-network-operator/iptables-alerter-4sslh" Jun 02 19:03:18.559780 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.558613 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/10a30f16-e658-4abd-bed5-f0521177b19f-iptables-alerter-script\") pod \"iptables-alerter-4sslh\" (UID: \"10a30f16-e658-4abd-bed5-f0521177b19f\") " pod="openshift-network-operator/iptables-alerter-4sslh" Jun 02 19:03:18.559780 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.558638 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-etc-modprobe-d\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.559780 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.558662 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-etc-systemd\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.559780 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.558687 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-run-systemd\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.559780 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.558987 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0d46be99-6b62-4c3d-8106-257edfbba1ac-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jr7p2\" (UID: \"0d46be99-6b62-4c3d-8106-257edfbba1ac\") " pod="openshift-multus/multus-additional-cni-plugins-jr7p2" Jun 02 19:03:18.559780 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.559074 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-etc-modprobe-d\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.559780 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.559120 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-etc-systemd\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.559780 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.559180 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0d46be99-6b62-4c3d-8106-257edfbba1ac-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jr7p2\" (UID: \"0d46be99-6b62-4c3d-8106-257edfbba1ac\") " pod="openshift-multus/multus-additional-cni-plugins-jr7p2" Jun 02 19:03:18.559780 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.559244 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/10a30f16-e658-4abd-bed5-f0521177b19f-iptables-alerter-script\") pod \"iptables-alerter-4sslh\" (UID: \"10a30f16-e658-4abd-bed5-f0521177b19f\") " pod="openshift-network-operator/iptables-alerter-4sslh" Jun 02 19:03:18.560188 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.560071 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-tmp\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.560463 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.560447 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1fca4d91-f894-4c30-a0df-583ee61b5f2e-agent-certs\") pod \"konnectivity-agent-pclcs\" (UID: \"1fca4d91-f894-4c30-a0df-583ee61b5f2e\") " pod="kube-system/konnectivity-agent-pclcs" Jun 02 19:03:18.560824 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.560807 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-etc-tuned\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.564993 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:18.564975 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:03:18.564993 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:18.564995 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:03:18.565135 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:18.565004 2557 projected.go:194] Error preparing data for projected volume kube-api-access-2sczk for pod openshift-network-diagnostics/network-check-target-pzkk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:18.565135 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:18.565061 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d905ff7-fad0-4198-a83a-4256a1106d7d-kube-api-access-2sczk podName:4d905ff7-fad0-4198-a83a-4256a1106d7d nodeName:}" failed. No retries permitted until 2026-06-02 19:03:19.065045942 +0000 UTC m=+3.039947457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2sczk" (UniqueName: "kubernetes.io/projected/4d905ff7-fad0-4198-a83a-4256a1106d7d-kube-api-access-2sczk") pod "network-check-target-pzkk4" (UID: "4d905ff7-fad0-4198-a83a-4256a1106d7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:18.567375 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.567350 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddkv6\" (UniqueName: \"kubernetes.io/projected/10a30f16-e658-4abd-bed5-f0521177b19f-kube-api-access-ddkv6\") pod \"iptables-alerter-4sslh\" (UID: \"10a30f16-e658-4abd-bed5-f0521177b19f\") " pod="openshift-network-operator/iptables-alerter-4sslh" Jun 02 19:03:18.567947 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.567825 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x85pb\" (UniqueName: \"kubernetes.io/projected/8fa3d670-e63b-43c3-ad81-5c43997d083b-kube-api-access-x85pb\") pod \"aws-ebs-csi-driver-node-dwhv6\" (UID: \"8fa3d670-e63b-43c3-ad81-5c43997d083b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwhv6" Jun 02 19:03:18.568030 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.567976 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntrcd\" (UniqueName: \"kubernetes.io/projected/40d3c9e7-72bb-4079-97aa-7dbc9fc9231c-kube-api-access-ntrcd\") pod \"tuned-whmqd\" (UID: \"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c\") " pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.568351 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.568299 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8sg5\" (UniqueName: \"kubernetes.io/projected/0d46be99-6b62-4c3d-8106-257edfbba1ac-kube-api-access-c8sg5\") pod \"multus-additional-cni-plugins-jr7p2\" (UID: \"0d46be99-6b62-4c3d-8106-257edfbba1ac\") " pod="openshift-multus/multus-additional-cni-plugins-jr7p2" Jun 02 19:03:18.568432 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.568411 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt6wd\" (UniqueName: \"kubernetes.io/projected/c06cfb25-324b-408a-a07f-63de6128d0f3-kube-api-access-mt6wd\") pod \"network-metrics-daemon-rtm24\" (UID: \"c06cfb25-324b-408a-a07f-63de6128d0f3\") " pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:18.659429 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.659398 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-host-var-lib-cni-bin\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.659429 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.659440 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-etc-kubernetes\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.659639 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.659464 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b0840a32-3528-4cef-aec6-d62b0f977e98-serviceca\") pod \"node-ca-6ddrs\" (UID: \"b0840a32-3528-4cef-aec6-d62b0f977e98\") " pod="openshift-image-registry/node-ca-6ddrs" Jun 02 19:03:18.659639 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.659491 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-system-cni-dir\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.659639 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.659509 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-host-var-lib-cni-bin\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.659639 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.659515 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-host-run-multus-certs\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.659639 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.659510 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-etc-kubernetes\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.659639 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.659538 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-systemd-units\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.659639 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.659563 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-log-socket\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.659639 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.659573 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-system-cni-dir\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.659639 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.659587 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-cnibin\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.659639 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.659624 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-log-socket\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.659639 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.659640 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-host-run-multus-certs\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.660144 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.659643 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-systemd-units\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.660144 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.659643 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-cnibin\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.660144 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.659652 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-multus-conf-dir\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.660144 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.659680 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-multus-conf-dir\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.660144 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.659700 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-multus-daemon-config\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.660144 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.659727 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dxsx6\" (UniqueName: \"kubernetes.io/projected/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-kube-api-access-dxsx6\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.660144 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.659754 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-run-openvswitch\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.660144 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.659782 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-os-release\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.660144 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.659805 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fa99b71f-8897-4e26-97f1-40619c45e006-ovn-node-metrics-cert\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.660144 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.659846 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-host-slash\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.660144 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.659872 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.660144 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.659897 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0840a32-3528-4cef-aec6-d62b0f977e98-host\") pod \"node-ca-6ddrs\" (UID: \"b0840a32-3528-4cef-aec6-d62b0f977e98\") " pod="openshift-image-registry/node-ca-6ddrs" Jun 02 19:03:18.660144 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.659935 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b0840a32-3528-4cef-aec6-d62b0f977e98-serviceca\") pod \"node-ca-6ddrs\" (UID: \"b0840a32-3528-4cef-aec6-d62b0f977e98\") " pod="openshift-image-registry/node-ca-6ddrs" Jun 02 19:03:18.660144 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.659936 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-host-kubelet\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.660144 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.659985 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fa99b71f-8897-4e26-97f1-40619c45e006-ovnkube-script-lib\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.660144 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660014 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-host-run-netns\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.660144 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660042 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2jxj\" (UniqueName: \"kubernetes.io/projected/fa99b71f-8897-4e26-97f1-40619c45e006-kube-api-access-h2jxj\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.660144 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660045 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-run-openvswitch\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.661028 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660070 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-hostroot\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.661028 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660087 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-os-release\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.661028 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660094 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-host-kubelet\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.661028 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660094 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fa99b71f-8897-4e26-97f1-40619c45e006-ovnkube-config\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.661028 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660132 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xff7s\" (UniqueName: \"kubernetes.io/projected/b0840a32-3528-4cef-aec6-d62b0f977e98-kube-api-access-xff7s\") pod \"node-ca-6ddrs\" (UID: \"b0840a32-3528-4cef-aec6-d62b0f977e98\") " pod="openshift-image-registry/node-ca-6ddrs" Jun 02 19:03:18.661028 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660140 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-host-slash\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.661028 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660162 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-host-run-ovn-kubernetes\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.661028 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660187 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-host-cni-netd\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.661028 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660195 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-multus-daemon-config\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.661028 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660212 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-multus-cni-dir\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.661028 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660238 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-multus-socket-dir-parent\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.661028 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660265 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-host-run-k8s-cni-cncf-io\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.661028 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660292 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-host-var-lib-cni-multus\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.661028 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660338 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-var-lib-openvswitch\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.661028 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660362 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-run-ovn\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.661028 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660387 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-host-run-netns\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.661028 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660393 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-node-log\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.661028 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660429 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-run-systemd\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.661697 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660432 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-node-log\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.661697 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660455 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fa99b71f-8897-4e26-97f1-40619c45e006-env-overrides\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.661697 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660468 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0840a32-3528-4cef-aec6-d62b0f977e98-host\") pod \"node-ca-6ddrs\" (UID: \"b0840a32-3528-4cef-aec6-d62b0f977e98\") " pod="openshift-image-registry/node-ca-6ddrs" Jun 02 19:03:18.661697 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660480 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-cni-binary-copy\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.661697 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660505 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-host-run-netns\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.661697 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660529 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-host-var-lib-kubelet\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.661697 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660552 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-etc-openvswitch\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.661697 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660580 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-host-cni-bin\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.661697 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660613 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fa99b71f-8897-4e26-97f1-40619c45e006-ovnkube-script-lib\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.661697 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660640 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-host-cni-bin\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.661697 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660665 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-multus-socket-dir-parent\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.661697 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660682 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-host-run-k8s-cni-cncf-io\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.661697 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660687 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fa99b71f-8897-4e26-97f1-40619c45e006-ovnkube-config\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.661697 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660722 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-multus-cni-dir\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.661697 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660735 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-run-ovn\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.661697 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660746 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-run-systemd\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.661697 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660745 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-var-lib-openvswitch\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.661697 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660770 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-host-run-netns\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.662327 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660786 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.662327 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660794 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-hostroot\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.662327 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660694 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-host-cni-netd\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.662327 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660826 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-host-var-lib-cni-multus\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.662327 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660832 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-host-var-lib-kubelet\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.662327 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660848 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-etc-openvswitch\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.662327 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.660939 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa99b71f-8897-4e26-97f1-40619c45e006-host-run-ovn-kubernetes\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.662327 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.661020 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fa99b71f-8897-4e26-97f1-40619c45e006-env-overrides\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.662327 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.661159 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-cni-binary-copy\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.662327 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.662098 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fa99b71f-8897-4e26-97f1-40619c45e006-ovn-node-metrics-cert\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.667850 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.667827 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxsx6\" (UniqueName: \"kubernetes.io/projected/7cc494a4-baa5-42d9-b4f0-93675ddc7da6-kube-api-access-dxsx6\") pod \"multus-ncxcn\" (UID: \"7cc494a4-baa5-42d9-b4f0-93675ddc7da6\") " pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.667947 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.667893 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xff7s\" (UniqueName: \"kubernetes.io/projected/b0840a32-3528-4cef-aec6-d62b0f977e98-kube-api-access-xff7s\") pod \"node-ca-6ddrs\" (UID: \"b0840a32-3528-4cef-aec6-d62b0f977e98\") " pod="openshift-image-registry/node-ca-6ddrs" Jun 02 19:03:18.668050 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.668032 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2jxj\" (UniqueName: \"kubernetes.io/projected/fa99b71f-8897-4e26-97f1-40619c45e006-kube-api-access-h2jxj\") pod \"ovnkube-node-hstll\" (UID: \"fa99b71f-8897-4e26-97f1-40619c45e006\") " pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.753137 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.753086 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jr7p2" Jun 02 19:03:18.760798 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.760778 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4sslh" Jun 02 19:03:18.768984 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.768958 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pclcs" Jun 02 19:03:18.773565 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.773545 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwhv6" Jun 02 19:03:18.778084 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.778065 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-whmqd" Jun 02 19:03:18.784594 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.784578 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6ddrs" Jun 02 19:03:18.790127 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.790106 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ncxcn" Jun 02 19:03:18.795664 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.795647 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:18.903117 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:18.903091 2557 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 19:03:19.062039 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:19.061955 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c06cfb25-324b-408a-a07f-63de6128d0f3-metrics-certs\") pod \"network-metrics-daemon-rtm24\" (UID: \"c06cfb25-324b-408a-a07f-63de6128d0f3\") " pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:19.062190 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:19.062088 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:19.062190 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:19.062155 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06cfb25-324b-408a-a07f-63de6128d0f3-metrics-certs podName:c06cfb25-324b-408a-a07f-63de6128d0f3 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:20.062136466 +0000 UTC m=+4.037037985 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c06cfb25-324b-408a-a07f-63de6128d0f3-metrics-certs") pod "network-metrics-daemon-rtm24" (UID: "c06cfb25-324b-408a-a07f-63de6128d0f3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:19.162958 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:19.162930 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2sczk\" (UniqueName: \"kubernetes.io/projected/4d905ff7-fad0-4198-a83a-4256a1106d7d-kube-api-access-2sczk\") pod \"network-check-target-pzkk4\" (UID: \"4d905ff7-fad0-4198-a83a-4256a1106d7d\") " pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:03:19.163101 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:19.163056 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:03:19.163101 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:19.163070 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:03:19.163101 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:19.163078 2557 projected.go:194] Error preparing data for projected volume kube-api-access-2sczk for pod openshift-network-diagnostics/network-check-target-pzkk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:19.163220 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:19.163125 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d905ff7-fad0-4198-a83a-4256a1106d7d-kube-api-access-2sczk podName:4d905ff7-fad0-4198-a83a-4256a1106d7d nodeName:}" failed. No retries permitted until 2026-06-02 19:03:20.163112627 +0000 UTC m=+4.138014142 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2sczk" (UniqueName: "kubernetes.io/projected/4d905ff7-fad0-4198-a83a-4256a1106d7d-kube-api-access-2sczk") pod "network-check-target-pzkk4" (UID: "4d905ff7-fad0-4198-a83a-4256a1106d7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:19.316232 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:19.316111 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40d3c9e7_72bb_4079_97aa_7dbc9fc9231c.slice/crio-8f758d4eac76891432d011fe3dc6af91a7a1408fcae083722c2ddc35e7f8d97c WatchSource:0}: Error finding container 8f758d4eac76891432d011fe3dc6af91a7a1408fcae083722c2ddc35e7f8d97c: Status 404 returned error can't find the container with id 8f758d4eac76891432d011fe3dc6af91a7a1408fcae083722c2ddc35e7f8d97c Jun 02 19:03:19.318614 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:19.318529 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa99b71f_8897_4e26_97f1_40619c45e006.slice/crio-923f4473d4b1bf6e3d0b01d26b77dba41d65b239525ce8e36154b4b43241e697 WatchSource:0}: Error finding container 923f4473d4b1bf6e3d0b01d26b77dba41d65b239525ce8e36154b4b43241e697: Status 404 returned error can't find the container with id 923f4473d4b1bf6e3d0b01d26b77dba41d65b239525ce8e36154b4b43241e697 Jun 02 19:03:19.319487 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:19.319446 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0840a32_3528_4cef_aec6_d62b0f977e98.slice/crio-4ccfdb61ff788e6fcc46202a23de78f4b2c12fcadca38482f6a2bcad6fd99b8f WatchSource:0}: Error finding container 4ccfdb61ff788e6fcc46202a23de78f4b2c12fcadca38482f6a2bcad6fd99b8f: Status 404 returned error can't find the container with id 4ccfdb61ff788e6fcc46202a23de78f4b2c12fcadca38482f6a2bcad6fd99b8f Jun 02 19:03:19.321099 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:19.321075 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fca4d91_f894_4c30_a0df_583ee61b5f2e.slice/crio-e2bee1e219956fc261f872205213c7ab97f5c31e4e2e073ac54d92decee3c60a WatchSource:0}: Error finding container e2bee1e219956fc261f872205213c7ab97f5c31e4e2e073ac54d92decee3c60a: Status 404 returned error can't find the container with id e2bee1e219956fc261f872205213c7ab97f5c31e4e2e073ac54d92decee3c60a Jun 02 19:03:19.321983 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:19.321964 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d46be99_6b62_4c3d_8106_257edfbba1ac.slice/crio-8fdaed6268d87e7d24486820ef75eb8fdc84bba398ef25c201d85451376099c4 WatchSource:0}: Error finding container 8fdaed6268d87e7d24486820ef75eb8fdc84bba398ef25c201d85451376099c4: Status 404 returned error can't find the container with id 8fdaed6268d87e7d24486820ef75eb8fdc84bba398ef25c201d85451376099c4 Jun 02 19:03:19.324136 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:19.324053 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fa3d670_e63b_43c3_ad81_5c43997d083b.slice/crio-84ef4697b7f28c905701d918fc4d9b661583e4ab33cfaa33dfdd508b660ecc90 WatchSource:0}: Error finding container 84ef4697b7f28c905701d918fc4d9b661583e4ab33cfaa33dfdd508b660ecc90: Status 404 returned error can't find the container with id 84ef4697b7f28c905701d918fc4d9b661583e4ab33cfaa33dfdd508b660ecc90 Jun 02 19:03:19.324523 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:19.324487 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10a30f16_e658_4abd_bed5_f0521177b19f.slice/crio-aaa44612ba8c2de711181bea8f6009f0af625cae1ad4b07507f45068933634f2 WatchSource:0}: Error finding container aaa44612ba8c2de711181bea8f6009f0af625cae1ad4b07507f45068933634f2: Status 404 returned error can't find the container with id aaa44612ba8c2de711181bea8f6009f0af625cae1ad4b07507f45068933634f2 Jun 02 19:03:19.326274 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:19.326251 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cc494a4_baa5_42d9_b4f0_93675ddc7da6.slice/crio-1e4b7434228354a7d3d13517b87efd084ac5c8e105581283ffb008c80f901011 WatchSource:0}: Error finding container 1e4b7434228354a7d3d13517b87efd084ac5c8e105581283ffb008c80f901011: Status 404 returned error can't find the container with id 1e4b7434228354a7d3d13517b87efd084ac5c8e105581283ffb008c80f901011 Jun 02 19:03:19.489577 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:19.489442 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 18:58:17 +0000 UTC" deadline="2028-03-11 05:43:27.938678978 +0000 UTC" Jun 02 19:03:19.489577 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:19.489574 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15538h40m8.449106867s" Jun 02 19:03:19.549852 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:19.549830 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:03:19.549953 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:19.549919 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pzkk4" podUID="4d905ff7-fad0-4198-a83a-4256a1106d7d" Jun 02 19:03:19.555928 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:19.555906 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ncxcn" event={"ID":"7cc494a4-baa5-42d9-b4f0-93675ddc7da6","Type":"ContainerStarted","Data":"1e4b7434228354a7d3d13517b87efd084ac5c8e105581283ffb008c80f901011"} Jun 02 19:03:19.557070 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:19.557048 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4sslh" event={"ID":"10a30f16-e658-4abd-bed5-f0521177b19f","Type":"ContainerStarted","Data":"aaa44612ba8c2de711181bea8f6009f0af625cae1ad4b07507f45068933634f2"} Jun 02 19:03:19.558036 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:19.558010 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwhv6" event={"ID":"8fa3d670-e63b-43c3-ad81-5c43997d083b","Type":"ContainerStarted","Data":"84ef4697b7f28c905701d918fc4d9b661583e4ab33cfaa33dfdd508b660ecc90"} Jun 02 19:03:19.558949 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:19.558931 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jr7p2" event={"ID":"0d46be99-6b62-4c3d-8106-257edfbba1ac","Type":"ContainerStarted","Data":"8fdaed6268d87e7d24486820ef75eb8fdc84bba398ef25c201d85451376099c4"} Jun 02 19:03:19.559881 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:19.559861 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6ddrs" event={"ID":"b0840a32-3528-4cef-aec6-d62b0f977e98","Type":"ContainerStarted","Data":"4ccfdb61ff788e6fcc46202a23de78f4b2c12fcadca38482f6a2bcad6fd99b8f"} Jun 02 19:03:19.560801 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:19.560783 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hstll" event={"ID":"fa99b71f-8897-4e26-97f1-40619c45e006","Type":"ContainerStarted","Data":"923f4473d4b1bf6e3d0b01d26b77dba41d65b239525ce8e36154b4b43241e697"} Jun 02 19:03:19.561758 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:19.561725 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-whmqd" event={"ID":"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c","Type":"ContainerStarted","Data":"8f758d4eac76891432d011fe3dc6af91a7a1408fcae083722c2ddc35e7f8d97c"} Jun 02 19:03:19.563300 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:19.563282 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal" event={"ID":"00ab6e9e70b3869b45a8dbd4d89dd58d","Type":"ContainerStarted","Data":"661f79d259da4f79c83ecb1f1947dcae7ec1a7ce999e11c9daabc5cdff069290"} Jun 02 19:03:19.564283 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:19.564260 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pclcs" event={"ID":"1fca4d91-f894-4c30-a0df-583ee61b5f2e","Type":"ContainerStarted","Data":"e2bee1e219956fc261f872205213c7ab97f5c31e4e2e073ac54d92decee3c60a"} Jun 02 19:03:19.590125 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:19.590074 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-177.ec2.internal" podStartSLOduration=2.590062439 podStartE2EDuration="2.590062439s" podCreationTimestamp="2026-06-02 19:03:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:03:19.589684182 +0000 UTC m=+3.564585719" watchObservedRunningTime="2026-06-02 19:03:19.590062439 +0000 UTC m=+3.564963976" Jun 02 19:03:20.070923 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:20.070839 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c06cfb25-324b-408a-a07f-63de6128d0f3-metrics-certs\") pod \"network-metrics-daemon-rtm24\" (UID: \"c06cfb25-324b-408a-a07f-63de6128d0f3\") " pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:20.071076 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:20.071009 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:20.071076 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:20.071068 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06cfb25-324b-408a-a07f-63de6128d0f3-metrics-certs podName:c06cfb25-324b-408a-a07f-63de6128d0f3 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:22.071051102 +0000 UTC m=+6.045952633 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c06cfb25-324b-408a-a07f-63de6128d0f3-metrics-certs") pod "network-metrics-daemon-rtm24" (UID: "c06cfb25-324b-408a-a07f-63de6128d0f3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:20.172723 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:20.172119 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2sczk\" (UniqueName: \"kubernetes.io/projected/4d905ff7-fad0-4198-a83a-4256a1106d7d-kube-api-access-2sczk\") pod \"network-check-target-pzkk4\" (UID: \"4d905ff7-fad0-4198-a83a-4256a1106d7d\") " pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:03:20.172723 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:20.172301 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:03:20.172723 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:20.172337 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:03:20.172723 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:20.172349 2557 projected.go:194] Error preparing data for projected volume kube-api-access-2sczk for pod openshift-network-diagnostics/network-check-target-pzkk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:20.172723 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:20.172402 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d905ff7-fad0-4198-a83a-4256a1106d7d-kube-api-access-2sczk podName:4d905ff7-fad0-4198-a83a-4256a1106d7d nodeName:}" failed. No retries permitted until 2026-06-02 19:03:22.172384291 +0000 UTC m=+6.147285821 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2sczk" (UniqueName: "kubernetes.io/projected/4d905ff7-fad0-4198-a83a-4256a1106d7d-kube-api-access-2sczk") pod "network-check-target-pzkk4" (UID: "4d905ff7-fad0-4198-a83a-4256a1106d7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:20.552965 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:20.552434 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:20.552965 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:20.552562 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtm24" podUID="c06cfb25-324b-408a-a07f-63de6128d0f3" Jun 02 19:03:20.582816 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:20.582038 2557 generic.go:358] "Generic (PLEG): container finished" podID="4669e9fdc58fcc49647e48b529e468a8" containerID="cc0a9e355fa47fce344b25070a4eb0521c702c60d1f5358cc28e25a19e719986" exitCode=0 Jun 02 19:03:20.582816 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:20.582409 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" event={"ID":"4669e9fdc58fcc49647e48b529e468a8","Type":"ContainerDied","Data":"cc0a9e355fa47fce344b25070a4eb0521c702c60d1f5358cc28e25a19e719986"} Jun 02 19:03:21.549991 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:21.549917 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:03:21.550139 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:21.550045 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pzkk4" podUID="4d905ff7-fad0-4198-a83a-4256a1106d7d" Jun 02 19:03:21.591883 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:21.591259 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" event={"ID":"4669e9fdc58fcc49647e48b529e468a8","Type":"ContainerStarted","Data":"ec81fd3fcd9b9943a18d9789a86f46faa90d86f9f699165c67f01f351d696e70"} Jun 02 19:03:22.092399 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:22.092368 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c06cfb25-324b-408a-a07f-63de6128d0f3-metrics-certs\") pod \"network-metrics-daemon-rtm24\" (UID: \"c06cfb25-324b-408a-a07f-63de6128d0f3\") " pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:22.092573 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:22.092499 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:22.092573 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:22.092571 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06cfb25-324b-408a-a07f-63de6128d0f3-metrics-certs podName:c06cfb25-324b-408a-a07f-63de6128d0f3 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:26.09255197 +0000 UTC m=+10.067453494 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c06cfb25-324b-408a-a07f-63de6128d0f3-metrics-certs") pod "network-metrics-daemon-rtm24" (UID: "c06cfb25-324b-408a-a07f-63de6128d0f3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:22.193573 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:22.193534 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2sczk\" (UniqueName: \"kubernetes.io/projected/4d905ff7-fad0-4198-a83a-4256a1106d7d-kube-api-access-2sczk\") pod \"network-check-target-pzkk4\" (UID: \"4d905ff7-fad0-4198-a83a-4256a1106d7d\") " pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:03:22.193797 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:22.193704 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:03:22.193797 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:22.193721 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:03:22.193797 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:22.193733 2557 projected.go:194] Error preparing data for projected volume kube-api-access-2sczk for pod openshift-network-diagnostics/network-check-target-pzkk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:22.193797 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:22.193799 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d905ff7-fad0-4198-a83a-4256a1106d7d-kube-api-access-2sczk podName:4d905ff7-fad0-4198-a83a-4256a1106d7d nodeName:}" failed. No retries permitted until 2026-06-02 19:03:26.193783416 +0000 UTC m=+10.168684933 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2sczk" (UniqueName: "kubernetes.io/projected/4d905ff7-fad0-4198-a83a-4256a1106d7d-kube-api-access-2sczk") pod "network-check-target-pzkk4" (UID: "4d905ff7-fad0-4198-a83a-4256a1106d7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:22.550431 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:22.550354 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:22.550582 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:22.550490 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtm24" podUID="c06cfb25-324b-408a-a07f-63de6128d0f3" Jun 02 19:03:23.550211 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:23.550182 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:03:23.550681 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:23.550280 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pzkk4" podUID="4d905ff7-fad0-4198-a83a-4256a1106d7d" Jun 02 19:03:24.550420 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:24.550373 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:24.550854 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:24.550507 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtm24" podUID="c06cfb25-324b-408a-a07f-63de6128d0f3" Jun 02 19:03:25.550138 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:25.550106 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:03:25.550326 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:25.550235 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pzkk4" podUID="4d905ff7-fad0-4198-a83a-4256a1106d7d" Jun 02 19:03:26.122568 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:26.122529 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c06cfb25-324b-408a-a07f-63de6128d0f3-metrics-certs\") pod \"network-metrics-daemon-rtm24\" (UID: \"c06cfb25-324b-408a-a07f-63de6128d0f3\") " pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:26.123026 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:26.122694 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:26.123026 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:26.122779 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06cfb25-324b-408a-a07f-63de6128d0f3-metrics-certs podName:c06cfb25-324b-408a-a07f-63de6128d0f3 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:34.122757983 +0000 UTC m=+18.097659499 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c06cfb25-324b-408a-a07f-63de6128d0f3-metrics-certs") pod "network-metrics-daemon-rtm24" (UID: "c06cfb25-324b-408a-a07f-63de6128d0f3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:26.223809 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:26.223759 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2sczk\" (UniqueName: \"kubernetes.io/projected/4d905ff7-fad0-4198-a83a-4256a1106d7d-kube-api-access-2sczk\") pod \"network-check-target-pzkk4\" (UID: \"4d905ff7-fad0-4198-a83a-4256a1106d7d\") " pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:03:26.223965 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:26.223890 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:03:26.223965 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:26.223907 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:03:26.223965 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:26.223917 2557 projected.go:194] Error preparing data for projected volume kube-api-access-2sczk for pod openshift-network-diagnostics/network-check-target-pzkk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:26.224104 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:26.223969 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d905ff7-fad0-4198-a83a-4256a1106d7d-kube-api-access-2sczk podName:4d905ff7-fad0-4198-a83a-4256a1106d7d nodeName:}" failed. No retries permitted until 2026-06-02 19:03:34.223954177 +0000 UTC m=+18.198855691 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2sczk" (UniqueName: "kubernetes.io/projected/4d905ff7-fad0-4198-a83a-4256a1106d7d-kube-api-access-2sczk") pod "network-check-target-pzkk4" (UID: "4d905ff7-fad0-4198-a83a-4256a1106d7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:26.550989 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:26.550964 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:26.551099 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:26.551063 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtm24" podUID="c06cfb25-324b-408a-a07f-63de6128d0f3" Jun 02 19:03:26.600352 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:26.600322 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pclcs" event={"ID":"1fca4d91-f894-4c30-a0df-583ee61b5f2e","Type":"ContainerStarted","Data":"694c03f22019cf6663c2eb60a2621c561895928d623189b02e7f533bfaa77f1f"} Jun 02 19:03:26.602009 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:26.601964 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwhv6" event={"ID":"8fa3d670-e63b-43c3-ad81-5c43997d083b","Type":"ContainerStarted","Data":"c8d656b6b1fe62832c608591b12c552e595544419dd34a04d3488a03fd36903d"} Jun 02 19:03:26.605225 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:26.605194 2557 generic.go:358] "Generic (PLEG): container finished" podID="0d46be99-6b62-4c3d-8106-257edfbba1ac" containerID="3a9c4d2a2915e53158f46f60977bec30f3e20c59d85405fdc7d460fa79963d19" exitCode=0 Jun 02 19:03:26.605333 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:26.605302 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jr7p2" event={"ID":"0d46be99-6b62-4c3d-8106-257edfbba1ac","Type":"ContainerDied","Data":"3a9c4d2a2915e53158f46f60977bec30f3e20c59d85405fdc7d460fa79963d19"} Jun 02 19:03:26.608512 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:26.608482 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6ddrs" event={"ID":"b0840a32-3528-4cef-aec6-d62b0f977e98","Type":"ContainerStarted","Data":"e09275de8e2ca4dd7b2b41af76601e7198db8f569d0a9501785b474f260a4262"} Jun 02 19:03:26.614095 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:26.614052 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-177.ec2.internal" podStartSLOduration=9.614020999 podStartE2EDuration="9.614020999s" podCreationTimestamp="2026-06-02 19:03:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:03:21.606126192 +0000 UTC m=+5.581027731" watchObservedRunningTime="2026-06-02 19:03:26.614020999 +0000 UTC m=+10.588922533" Jun 02 19:03:26.614800 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:26.614764 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pclcs" podStartSLOduration=3.693610955 podStartE2EDuration="10.614751437s" podCreationTimestamp="2026-06-02 19:03:16 +0000 UTC" firstStartedPulling="2026-06-02 19:03:19.322720243 +0000 UTC m=+3.297621762" lastFinishedPulling="2026-06-02 19:03:26.24386073 +0000 UTC m=+10.218762244" observedRunningTime="2026-06-02 19:03:26.614239694 +0000 UTC m=+10.589141232" watchObservedRunningTime="2026-06-02 19:03:26.614751437 +0000 UTC m=+10.589652975" Jun 02 19:03:26.642904 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:26.642840 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6ddrs" podStartSLOduration=3.722595177 podStartE2EDuration="10.642826028s" podCreationTimestamp="2026-06-02 19:03:16 +0000 UTC" firstStartedPulling="2026-06-02 19:03:19.321162553 +0000 UTC m=+3.296064067" lastFinishedPulling="2026-06-02 19:03:26.241393396 +0000 UTC m=+10.216294918" observedRunningTime="2026-06-02 19:03:26.642526521 +0000 UTC m=+10.617428059" watchObservedRunningTime="2026-06-02 19:03:26.642826028 +0000 UTC m=+10.617727566" Jun 02 19:03:27.550051 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:27.549966 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:03:27.550548 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:27.550109 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pzkk4" podUID="4d905ff7-fad0-4198-a83a-4256a1106d7d" Jun 02 19:03:28.550613 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:28.550503 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:28.551031 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:28.550647 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtm24" podUID="c06cfb25-324b-408a-a07f-63de6128d0f3" Jun 02 19:03:28.612877 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:28.612808 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4sslh" event={"ID":"10a30f16-e658-4abd-bed5-f0521177b19f","Type":"ContainerStarted","Data":"68653cc5e03f0e36d96c2e898b5f465870bcc3a0514cc9aa6f7d7a94211ff7a1"} Jun 02 19:03:29.550085 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:29.549896 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:03:29.550249 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:29.550209 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pzkk4" podUID="4d905ff7-fad0-4198-a83a-4256a1106d7d" Jun 02 19:03:30.059181 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:30.059073 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pclcs" Jun 02 19:03:30.059980 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:30.059838 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pclcs" Jun 02 19:03:30.075917 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:30.075870 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4sslh" podStartSLOduration=7.155779353 podStartE2EDuration="14.07585373s" podCreationTimestamp="2026-06-02 19:03:16 +0000 UTC" firstStartedPulling="2026-06-02 19:03:19.327113332 +0000 UTC m=+3.302014851" lastFinishedPulling="2026-06-02 19:03:26.247187713 +0000 UTC m=+10.222089228" observedRunningTime="2026-06-02 19:03:28.626953131 +0000 UTC m=+12.601854663" watchObservedRunningTime="2026-06-02 19:03:30.07585373 +0000 UTC m=+14.050755268" Jun 02 19:03:30.549958 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:30.549879 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:30.550114 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:30.549997 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtm24" podUID="c06cfb25-324b-408a-a07f-63de6128d0f3" Jun 02 19:03:31.550223 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:31.550189 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:03:31.550797 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:31.550317 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pzkk4" podUID="4d905ff7-fad0-4198-a83a-4256a1106d7d" Jun 02 19:03:32.550059 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:32.550031 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:32.550197 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:32.550144 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtm24" podUID="c06cfb25-324b-408a-a07f-63de6128d0f3" Jun 02 19:03:33.550539 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:33.550381 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:03:33.551153 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:33.550636 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pzkk4" podUID="4d905ff7-fad0-4198-a83a-4256a1106d7d" Jun 02 19:03:33.592566 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:33.592545 2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 19:03:33.623001 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:33.622967 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ncxcn" event={"ID":"7cc494a4-baa5-42d9-b4f0-93675ddc7da6","Type":"ContainerStarted","Data":"a51413b01d239a07732ad5ce90627ce0b627fc8543763e807a2d58a40cc2e95b"} Jun 02 19:03:33.624754 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:33.624723 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwhv6" event={"ID":"8fa3d670-e63b-43c3-ad81-5c43997d083b","Type":"ContainerStarted","Data":"76ed01644cc449e02e6ec2df662c38bfef9de5b468479140546e5394f8e77908"} Jun 02 19:03:33.626063 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:33.626038 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-whmqd" event={"ID":"40d3c9e7-72bb-4079-97aa-7dbc9fc9231c","Type":"ContainerStarted","Data":"54d82de73b065bb08b5c257cd4b620d4cb1f149cc72f6ac1e32c537e475cd9ed"} Jun 02 19:03:33.638523 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:33.638476 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-ncxcn" podStartSLOduration=4.162865907 podStartE2EDuration="17.638461931s" podCreationTimestamp="2026-06-02 19:03:16 +0000 UTC" firstStartedPulling="2026-06-02 19:03:19.327593531 +0000 UTC m=+3.302495059" lastFinishedPulling="2026-06-02 19:03:32.803189568 +0000 UTC m=+16.778091083" observedRunningTime="2026-06-02 19:03:33.638383687 +0000 UTC m=+17.613285225" watchObservedRunningTime="2026-06-02 19:03:33.638461931 +0000 UTC m=+17.613363470" Jun 02 19:03:33.651985 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:33.651941 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-whmqd" podStartSLOduration=4.069419836 podStartE2EDuration="17.651926266s" podCreationTimestamp="2026-06-02 19:03:16 +0000 UTC" firstStartedPulling="2026-06-02 19:03:19.318231325 +0000 UTC m=+3.293132854" lastFinishedPulling="2026-06-02 19:03:32.900737754 +0000 UTC m=+16.875639284" observedRunningTime="2026-06-02 19:03:33.651509171 +0000 UTC m=+17.626410708" watchObservedRunningTime="2026-06-02 19:03:33.651926266 +0000 UTC m=+17.626827806" Jun 02 19:03:34.183638 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:34.183606 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c06cfb25-324b-408a-a07f-63de6128d0f3-metrics-certs\") pod \"network-metrics-daemon-rtm24\" (UID: \"c06cfb25-324b-408a-a07f-63de6128d0f3\") " pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:34.183848 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:34.183742 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:34.183848 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:34.183808 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06cfb25-324b-408a-a07f-63de6128d0f3-metrics-certs podName:c06cfb25-324b-408a-a07f-63de6128d0f3 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:50.183790326 +0000 UTC m=+34.158691854 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c06cfb25-324b-408a-a07f-63de6128d0f3-metrics-certs") pod "network-metrics-daemon-rtm24" (UID: "c06cfb25-324b-408a-a07f-63de6128d0f3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:34.285103 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:34.285014 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2sczk\" (UniqueName: \"kubernetes.io/projected/4d905ff7-fad0-4198-a83a-4256a1106d7d-kube-api-access-2sczk\") pod \"network-check-target-pzkk4\" (UID: \"4d905ff7-fad0-4198-a83a-4256a1106d7d\") " pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:03:34.285294 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:34.285176 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:03:34.285294 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:34.285198 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:03:34.285294 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:34.285209 2557 projected.go:194] Error preparing data for projected volume kube-api-access-2sczk for pod openshift-network-diagnostics/network-check-target-pzkk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:34.285294 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:34.285274 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d905ff7-fad0-4198-a83a-4256a1106d7d-kube-api-access-2sczk podName:4d905ff7-fad0-4198-a83a-4256a1106d7d nodeName:}" failed. No retries permitted until 2026-06-02 19:03:50.285255737 +0000 UTC m=+34.260157254 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2sczk" (UniqueName: "kubernetes.io/projected/4d905ff7-fad0-4198-a83a-4256a1106d7d-kube-api-access-2sczk") pod "network-check-target-pzkk4" (UID: "4d905ff7-fad0-4198-a83a-4256a1106d7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:34.519406 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:34.519204 2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T19:03:33.592561818Z","UUID":"754af885-8d45-412e-b68b-bdca8d5246a3","Handler":null,"Name":"","Endpoint":""} Jun 02 19:03:34.521005 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:34.520974 2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 19:03:34.521005 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:34.521003 2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 19:03:34.549976 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:34.549951 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:34.550096 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:34.550077 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtm24" podUID="c06cfb25-324b-408a-a07f-63de6128d0f3" Jun 02 19:03:35.282455 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:35.282420 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-gr66k"] Jun 02 19:03:35.302552 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:35.302524 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gr66k" Jun 02 19:03:35.305584 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:35.305558 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 19:03:35.306172 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:35.305951 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 19:03:35.306172 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:35.306158 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-w4q8m\"" Jun 02 19:03:35.394687 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:35.394519 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/712dc734-631f-4fc5-bfa4-7b036c53cad0-hosts-file\") pod \"node-resolver-gr66k\" (UID: \"712dc734-631f-4fc5-bfa4-7b036c53cad0\") " pod="openshift-dns/node-resolver-gr66k" Jun 02 19:03:35.394687 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:35.394560 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrdz6\" (UniqueName: \"kubernetes.io/projected/712dc734-631f-4fc5-bfa4-7b036c53cad0-kube-api-access-wrdz6\") pod \"node-resolver-gr66k\" (UID: \"712dc734-631f-4fc5-bfa4-7b036c53cad0\") " pod="openshift-dns/node-resolver-gr66k" Jun 02 19:03:35.394687 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:35.394601 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/712dc734-631f-4fc5-bfa4-7b036c53cad0-tmp-dir\") pod \"node-resolver-gr66k\" (UID: \"712dc734-631f-4fc5-bfa4-7b036c53cad0\") " pod="openshift-dns/node-resolver-gr66k" Jun 02 19:03:35.495393 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:35.495359 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/712dc734-631f-4fc5-bfa4-7b036c53cad0-tmp-dir\") pod \"node-resolver-gr66k\" (UID: \"712dc734-631f-4fc5-bfa4-7b036c53cad0\") " pod="openshift-dns/node-resolver-gr66k" Jun 02 19:03:35.495528 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:35.495424 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/712dc734-631f-4fc5-bfa4-7b036c53cad0-hosts-file\") pod \"node-resolver-gr66k\" (UID: \"712dc734-631f-4fc5-bfa4-7b036c53cad0\") " pod="openshift-dns/node-resolver-gr66k" Jun 02 19:03:35.495528 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:35.495452 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wrdz6\" (UniqueName: \"kubernetes.io/projected/712dc734-631f-4fc5-bfa4-7b036c53cad0-kube-api-access-wrdz6\") pod \"node-resolver-gr66k\" (UID: \"712dc734-631f-4fc5-bfa4-7b036c53cad0\") " pod="openshift-dns/node-resolver-gr66k" Jun 02 19:03:35.495622 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:35.495539 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/712dc734-631f-4fc5-bfa4-7b036c53cad0-hosts-file\") pod \"node-resolver-gr66k\" (UID: \"712dc734-631f-4fc5-bfa4-7b036c53cad0\") " pod="openshift-dns/node-resolver-gr66k" Jun 02 19:03:35.495764 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:35.495743 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/712dc734-631f-4fc5-bfa4-7b036c53cad0-tmp-dir\") pod \"node-resolver-gr66k\" (UID: \"712dc734-631f-4fc5-bfa4-7b036c53cad0\") " pod="openshift-dns/node-resolver-gr66k" Jun 02 19:03:35.505933 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:35.505915 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrdz6\" (UniqueName: \"kubernetes.io/projected/712dc734-631f-4fc5-bfa4-7b036c53cad0-kube-api-access-wrdz6\") pod \"node-resolver-gr66k\" (UID: \"712dc734-631f-4fc5-bfa4-7b036c53cad0\") " pod="openshift-dns/node-resolver-gr66k" Jun 02 19:03:35.550332 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:35.550264 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:03:35.550443 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:35.550379 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pzkk4" podUID="4d905ff7-fad0-4198-a83a-4256a1106d7d" Jun 02 19:03:35.614092 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:35.614068 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gr66k" Jun 02 19:03:36.550618 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:36.550588 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:36.551098 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:36.550704 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtm24" podUID="c06cfb25-324b-408a-a07f-63de6128d0f3" Jun 02 19:03:37.549762 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:37.549729 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:03:37.549934 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:37.549851 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pzkk4" podUID="4d905ff7-fad0-4198-a83a-4256a1106d7d" Jun 02 19:03:38.549900 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:38.549869 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:38.550297 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:38.550010 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtm24" podUID="c06cfb25-324b-408a-a07f-63de6128d0f3" Jun 02 19:03:39.550316 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:39.550271 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:03:39.550691 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:39.550426 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pzkk4" podUID="4d905ff7-fad0-4198-a83a-4256a1106d7d" Jun 02 19:03:40.381739 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:40.381705 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod712dc734_631f_4fc5_bfa4_7b036c53cad0.slice/crio-b0a126f776a71d91db041991f2cb04189efacb3f3428ad1ca634264ad93c82ad WatchSource:0}: Error finding container b0a126f776a71d91db041991f2cb04189efacb3f3428ad1ca634264ad93c82ad: Status 404 returned error can't find the container with id b0a126f776a71d91db041991f2cb04189efacb3f3428ad1ca634264ad93c82ad Jun 02 19:03:40.551399 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:40.551075 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:40.551399 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:40.551375 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtm24" podUID="c06cfb25-324b-408a-a07f-63de6128d0f3" Jun 02 19:03:40.639157 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:40.639122 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwhv6" event={"ID":"8fa3d670-e63b-43c3-ad81-5c43997d083b","Type":"ContainerStarted","Data":"582c64d7d728eef5358e218a88ab85f2a253130805eeee5aca18c9e490297ca3"} Jun 02 19:03:40.640658 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:40.640635 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jr7p2" event={"ID":"0d46be99-6b62-4c3d-8106-257edfbba1ac","Type":"ContainerStarted","Data":"4b8b831cf3883ad26f029c17134143ff5d7a1f05572f371f9ebfaa2dd3c75b3f"} Jun 02 19:03:40.642433 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:40.642411 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hstll" event={"ID":"fa99b71f-8897-4e26-97f1-40619c45e006","Type":"ContainerStarted","Data":"c9d25fab73b6469b9f9cf4d0c41038736e292d1c94df637411510665724ebbcd"} Jun 02 19:03:40.642433 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:40.642441 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hstll" event={"ID":"fa99b71f-8897-4e26-97f1-40619c45e006","Type":"ContainerStarted","Data":"1cd7df6d9a5deccc47ad30edd828bc4f42073448a0ade91cb063b8f9d9c8e115"} Jun 02 19:03:40.642573 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:40.642454 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hstll" event={"ID":"fa99b71f-8897-4e26-97f1-40619c45e006","Type":"ContainerStarted","Data":"2c4a6ac8271e2970ad6d00b29f3ce4ad7ea70daf1527d2c98341d97e3ca90145"} Jun 02 19:03:40.643636 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:40.643617 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gr66k" event={"ID":"712dc734-631f-4fc5-bfa4-7b036c53cad0","Type":"ContainerStarted","Data":"b9bf667563d5482a62b12dd01b6e3ad2656c2d6bf6ff354a01f6e18a4ecc99c9"} Jun 02 19:03:40.643636 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:40.643641 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gr66k" event={"ID":"712dc734-631f-4fc5-bfa4-7b036c53cad0","Type":"ContainerStarted","Data":"b0a126f776a71d91db041991f2cb04189efacb3f3428ad1ca634264ad93c82ad"} Jun 02 19:03:40.678108 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:40.678072 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwhv6" podStartSLOduration=3.526640005 podStartE2EDuration="24.678062008s" podCreationTimestamp="2026-06-02 19:03:16 +0000 UTC" firstStartedPulling="2026-06-02 19:03:19.325270129 +0000 UTC m=+3.300171644" lastFinishedPulling="2026-06-02 19:03:40.476692119 +0000 UTC m=+24.451593647" observedRunningTime="2026-06-02 19:03:40.678047601 +0000 UTC m=+24.652949130" watchObservedRunningTime="2026-06-02 19:03:40.678062008 +0000 UTC m=+24.652963545" Jun 02 19:03:40.693862 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:40.693833 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-gr66k" podStartSLOduration=5.693825053 podStartE2EDuration="5.693825053s" podCreationTimestamp="2026-06-02 19:03:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:03:40.693759607 +0000 UTC m=+24.668661140" watchObservedRunningTime="2026-06-02 19:03:40.693825053 +0000 UTC m=+24.668726590" Jun 02 19:03:41.549577 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:41.549511 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:03:41.549698 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:41.549605 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pzkk4" podUID="4d905ff7-fad0-4198-a83a-4256a1106d7d" Jun 02 19:03:41.646772 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:41.646742 2557 generic.go:358] "Generic (PLEG): container finished" podID="0d46be99-6b62-4c3d-8106-257edfbba1ac" containerID="4b8b831cf3883ad26f029c17134143ff5d7a1f05572f371f9ebfaa2dd3c75b3f" exitCode=0 Jun 02 19:03:41.647358 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:41.646812 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jr7p2" event={"ID":"0d46be99-6b62-4c3d-8106-257edfbba1ac","Type":"ContainerDied","Data":"4b8b831cf3883ad26f029c17134143ff5d7a1f05572f371f9ebfaa2dd3c75b3f"} Jun 02 19:03:41.649357 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:41.649334 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hstll" event={"ID":"fa99b71f-8897-4e26-97f1-40619c45e006","Type":"ContainerStarted","Data":"e47cae2bf88fac99420e589eb4f7375b323657507e43319263d9e626421ecd35"} Jun 02 19:03:41.649443 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:41.649365 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hstll" event={"ID":"fa99b71f-8897-4e26-97f1-40619c45e006","Type":"ContainerStarted","Data":"8007528272edcd3aed452bf52b5e1e12f4fe3cfe7c7cc34dca69ca918a9b2315"} Jun 02 19:03:41.649443 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:41.649378 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hstll" event={"ID":"fa99b71f-8897-4e26-97f1-40619c45e006","Type":"ContainerStarted","Data":"fabeb62c62b49c4444e0f689696b0530557e10bdf1d951bd7256214988a4ac93"} Jun 02 19:03:42.550193 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:42.550167 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:42.550285 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:42.550268 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtm24" podUID="c06cfb25-324b-408a-a07f-63de6128d0f3" Jun 02 19:03:42.652574 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:42.652544 2557 generic.go:358] "Generic (PLEG): container finished" podID="0d46be99-6b62-4c3d-8106-257edfbba1ac" containerID="8a403a3b482a659825203dbac56b366ac9e0e0b6639a8848fbce6817dcd99ed1" exitCode=0 Jun 02 19:03:42.652840 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:42.652595 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jr7p2" event={"ID":"0d46be99-6b62-4c3d-8106-257edfbba1ac","Type":"ContainerDied","Data":"8a403a3b482a659825203dbac56b366ac9e0e0b6639a8848fbce6817dcd99ed1"} Jun 02 19:03:43.549881 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:43.549841 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:03:43.550028 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:43.549946 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pzkk4" podUID="4d905ff7-fad0-4198-a83a-4256a1106d7d" Jun 02 19:03:43.656591 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:43.656554 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hstll" event={"ID":"fa99b71f-8897-4e26-97f1-40619c45e006","Type":"ContainerStarted","Data":"937de00d84b6ac4bf555d32cb7d3cc0a465a16e4747f71e32f206b15ef195930"} Jun 02 19:03:44.005234 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:44.005210 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pclcs" Jun 02 19:03:44.005351 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:44.005341 2557 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 19:03:44.005863 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:44.005837 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pclcs" Jun 02 19:03:44.550237 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:44.550197 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:44.550506 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:44.550286 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtm24" podUID="c06cfb25-324b-408a-a07f-63de6128d0f3" Jun 02 19:03:44.660429 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:44.660401 2557 generic.go:358] "Generic (PLEG): container finished" podID="0d46be99-6b62-4c3d-8106-257edfbba1ac" containerID="6e49c5967d5f41a2a6f105e6218432864f6faf3f0004fa838ce0c21fefbcb68e" exitCode=0 Jun 02 19:03:44.660826 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:44.660484 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jr7p2" event={"ID":"0d46be99-6b62-4c3d-8106-257edfbba1ac","Type":"ContainerDied","Data":"6e49c5967d5f41a2a6f105e6218432864f6faf3f0004fa838ce0c21fefbcb68e"} Jun 02 19:03:45.550566 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:45.550409 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:03:45.550794 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:45.550645 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pzkk4" podUID="4d905ff7-fad0-4198-a83a-4256a1106d7d" Jun 02 19:03:45.665408 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:45.665356 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hstll" event={"ID":"fa99b71f-8897-4e26-97f1-40619c45e006","Type":"ContainerStarted","Data":"147ce41800dd9e7eb5f2dcc149b9d8404ee74925b40fa94339ab59f1793c5d23"} Jun 02 19:03:45.665789 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:45.665769 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:45.665869 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:45.665808 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:45.683220 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:45.683188 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:45.719815 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:45.719770 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hstll" podStartSLOduration=7.658916487 podStartE2EDuration="28.719754917s" podCreationTimestamp="2026-06-02 19:03:17 +0000 UTC" firstStartedPulling="2026-06-02 19:03:19.320154407 +0000 UTC m=+3.295055922" lastFinishedPulling="2026-06-02 19:03:40.380992821 +0000 UTC m=+24.355894352" observedRunningTime="2026-06-02 19:03:45.69408391 +0000 UTC m=+29.668985449" watchObservedRunningTime="2026-06-02 19:03:45.719754917 +0000 UTC m=+29.694656454" Jun 02 19:03:46.550293 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:46.550263 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:46.550461 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:46.550385 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtm24" podUID="c06cfb25-324b-408a-a07f-63de6128d0f3" Jun 02 19:03:46.667777 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:46.667744 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:46.685905 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:46.685881 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:03:46.879064 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:46.878979 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rtm24"] Jun 02 19:03:46.879275 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:46.879098 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:46.879275 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:46.879233 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtm24" podUID="c06cfb25-324b-408a-a07f-63de6128d0f3" Jun 02 19:03:46.881609 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:46.881586 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pzkk4"] Jun 02 19:03:46.881731 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:46.881689 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:03:46.881805 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:46.881788 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pzkk4" podUID="4d905ff7-fad0-4198-a83a-4256a1106d7d" Jun 02 19:03:48.549929 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:48.549894 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:03:48.550422 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:48.549895 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:48.550422 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:48.549998 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pzkk4" podUID="4d905ff7-fad0-4198-a83a-4256a1106d7d" Jun 02 19:03:48.550422 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:48.550063 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtm24" podUID="c06cfb25-324b-408a-a07f-63de6128d0f3" Jun 02 19:03:50.210243 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:50.210199 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c06cfb25-324b-408a-a07f-63de6128d0f3-metrics-certs\") pod \"network-metrics-daemon-rtm24\" (UID: \"c06cfb25-324b-408a-a07f-63de6128d0f3\") " pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:50.210794 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:50.210360 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:50.210794 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:50.210426 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c06cfb25-324b-408a-a07f-63de6128d0f3-metrics-certs podName:c06cfb25-324b-408a-a07f-63de6128d0f3 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:22.210408655 +0000 UTC m=+66.185310185 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c06cfb25-324b-408a-a07f-63de6128d0f3-metrics-certs") pod "network-metrics-daemon-rtm24" (UID: "c06cfb25-324b-408a-a07f-63de6128d0f3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 19:03:50.311220 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:50.311184 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2sczk\" (UniqueName: \"kubernetes.io/projected/4d905ff7-fad0-4198-a83a-4256a1106d7d-kube-api-access-2sczk\") pod \"network-check-target-pzkk4\" (UID: \"4d905ff7-fad0-4198-a83a-4256a1106d7d\") " pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:03:50.311397 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:50.311352 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 19:03:50.311397 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:50.311373 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 19:03:50.311397 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:50.311386 2557 projected.go:194] Error preparing data for projected volume kube-api-access-2sczk for pod openshift-network-diagnostics/network-check-target-pzkk4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:50.311528 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:50.311440 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d905ff7-fad0-4198-a83a-4256a1106d7d-kube-api-access-2sczk podName:4d905ff7-fad0-4198-a83a-4256a1106d7d nodeName:}" failed. No retries permitted until 2026-06-02 19:04:22.311426424 +0000 UTC m=+66.286327939 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2sczk" (UniqueName: "kubernetes.io/projected/4d905ff7-fad0-4198-a83a-4256a1106d7d-kube-api-access-2sczk") pod "network-check-target-pzkk4" (UID: "4d905ff7-fad0-4198-a83a-4256a1106d7d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 19:03:50.549706 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:50.549619 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:50.549872 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:50.549757 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtm24" podUID="c06cfb25-324b-408a-a07f-63de6128d0f3" Jun 02 19:03:50.549872 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:50.549825 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:03:50.549989 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:50.549943 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pzkk4" podUID="4d905ff7-fad0-4198-a83a-4256a1106d7d" Jun 02 19:03:52.550290 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:52.550140 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:03:52.550726 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:52.550146 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:52.550726 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:52.550385 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pzkk4" podUID="4d905ff7-fad0-4198-a83a-4256a1106d7d" Jun 02 19:03:52.550726 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:52.550469 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rtm24" podUID="c06cfb25-324b-408a-a07f-63de6128d0f3" Jun 02 19:03:52.681647 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:52.681592 2557 generic.go:358] "Generic (PLEG): container finished" podID="0d46be99-6b62-4c3d-8106-257edfbba1ac" containerID="44cb74a778d4afca0c29903220aaa99fbfbec0219ba15b87c26ddd25ed546606" exitCode=0 Jun 02 19:03:52.681760 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:52.681644 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jr7p2" event={"ID":"0d46be99-6b62-4c3d-8106-257edfbba1ac","Type":"ContainerDied","Data":"44cb74a778d4afca0c29903220aaa99fbfbec0219ba15b87c26ddd25ed546606"} Jun 02 19:03:53.345132 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.345112 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-177.ec2.internal" event="NodeReady" Jun 02 19:03:53.345229 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.345198 2557 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 19:03:53.382295 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.382270 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2pkxz"] Jun 02 19:03:53.410605 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.410580 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gcb84"] Jun 02 19:03:53.410759 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.410736 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2pkxz" Jun 02 19:03:53.414266 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.414245 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 02 19:03:53.415379 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.415359 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 02 19:03:53.415861 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.415847 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 02 19:03:53.416032 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.416020 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-df5dk\"" Jun 02 19:03:53.423098 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.423081 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 02 19:03:53.430910 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.430889 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-l2lnk"] Jun 02 19:03:53.431006 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.430943 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gcb84" Jun 02 19:03:53.435034 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.435015 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mxfc9\"" Jun 02 19:03:53.435120 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.435017 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 02 19:03:53.435695 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.435676 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 02 19:03:53.440667 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.440645 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 02 19:03:53.456683 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.456665 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7474894d9b-m2x4b"] Jun 02 19:03:53.456809 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.456795 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-l2lnk" Jun 02 19:03:53.462333 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.462300 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 02 19:03:53.465237 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.465222 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 19:03:53.465237 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.465235 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 02 19:03:53.465359 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.465262 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 19:03:53.465359 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.465262 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2th5d\"" Jun 02 19:03:53.476915 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.476870 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tc247"] Jun 02 19:03:53.477006 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.476992 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:03:53.480269 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.480254 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 19:03:53.480485 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.480470 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fds9f\"" Jun 02 19:03:53.480561 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.480497 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 19:03:53.480561 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.480510 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 19:03:53.490408 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.490390 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 19:03:53.501978 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.501956 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2pkxz"] Jun 02 19:03:53.501978 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.501976 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-qbblk"] Jun 02 19:03:53.502085 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.502072 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tc247" Jun 02 19:03:53.506192 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.506159 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 02 19:03:53.506192 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.506173 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 02 19:03:53.506384 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.506166 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-n6sdh\"" Jun 02 19:03:53.526064 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.526045 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6c96dcf58c-hn2d6"] Jun 02 19:03:53.526156 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.526131 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-qbblk" Jun 02 19:03:53.529983 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.529967 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-4kfbd\"" Jun 02 19:03:53.530200 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.530182 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 19:03:53.530275 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.530240 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 19:03:53.534298 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.534281 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4wlz\" (UniqueName: \"kubernetes.io/projected/f6d92fd4-4328-46b7-b3e4-448c1b6bce14-kube-api-access-m4wlz\") pod \"kube-storage-version-migrator-operator-96ddc787c-2pkxz\" (UID: \"f6d92fd4-4328-46b7-b3e4-448c1b6bce14\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2pkxz" Jun 02 19:03:53.534390 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.534331 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f6d92fd4-4328-46b7-b3e4-448c1b6bce14-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-2pkxz\" (UID: \"f6d92fd4-4328-46b7-b3e4-448c1b6bce14\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2pkxz" Jun 02 19:03:53.534390 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.534365 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5361bc1f-484a-4b20-803a-02b1bd7aff31-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-gcb84\" (UID: \"5361bc1f-484a-4b20-803a-02b1bd7aff31\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gcb84" Jun 02 19:03:53.534464 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.534402 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/17a50869-5f95-4436-9eaf-c2ad111ccd76-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-l2lnk\" (UID: \"17a50869-5f95-4436-9eaf-c2ad111ccd76\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-l2lnk" Jun 02 19:03:53.534464 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.534427 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4klxx\" (UniqueName: \"kubernetes.io/projected/5361bc1f-484a-4b20-803a-02b1bd7aff31-kube-api-access-4klxx\") pod \"cluster-samples-operator-755bbf9bfb-gcb84\" (UID: \"5361bc1f-484a-4b20-803a-02b1bd7aff31\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gcb84" Jun 02 19:03:53.534464 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.534454 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f6d92fd4-4328-46b7-b3e4-448c1b6bce14-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-2pkxz\" (UID: \"f6d92fd4-4328-46b7-b3e4-448c1b6bce14\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2pkxz" Jun 02 19:03:53.534553 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.534476 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/17a50869-5f95-4436-9eaf-c2ad111ccd76-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-l2lnk\" (UID: \"17a50869-5f95-4436-9eaf-c2ad111ccd76\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-l2lnk" Jun 02 19:03:53.534553 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.534493 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j76gk\" (UniqueName: \"kubernetes.io/projected/17a50869-5f95-4436-9eaf-c2ad111ccd76-kube-api-access-j76gk\") pod \"cluster-monitoring-operator-69b6cbdb88-l2lnk\" (UID: \"17a50869-5f95-4436-9eaf-c2ad111ccd76\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-l2lnk" Jun 02 19:03:53.544114 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.544099 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-lz4mf"] Jun 02 19:03:53.544190 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.544184 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:03:53.546777 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.546754 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 02 19:03:53.546847 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.546810 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 02 19:03:53.546975 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.546957 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 02 19:03:53.547093 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.547047 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 02 19:03:53.547150 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.547098 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dzvrh\"" Jun 02 19:03:53.547150 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.547103 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 19:03:53.547332 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.547215 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 19:03:53.555123 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.555107 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-hfhgt"] Jun 02 19:03:53.555504 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.555222 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-lz4mf" Jun 02 19:03:53.557670 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.557634 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 02 19:03:53.557670 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.557644 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 02 19:03:53.557670 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.557649 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 02 19:03:53.557670 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.557671 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 02 19:03:53.557880 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.557779 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-j9bwv\"" Jun 02 19:03:53.577491 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.577473 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-5hlnl"] Jun 02 19:03:53.577616 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.577603 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-hfhgt" Jun 02 19:03:53.580155 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.580133 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 02 19:03:53.580255 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.580141 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-c7p8h\"" Jun 02 19:03:53.580255 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.580187 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 02 19:03:53.597434 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.597416 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-kxcxc"] Jun 02 19:03:53.597553 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.597539 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-5hlnl" Jun 02 19:03:53.600224 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.600207 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 02 19:03:53.600320 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.600241 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 02 19:03:53.600373 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.600244 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-vjxm4\"" Jun 02 19:03:53.600462 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.600449 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 19:03:53.600506 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.600478 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 19:03:53.605274 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.605257 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 02 19:03:53.623583 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.623566 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6676c7c455-jc7gc"] Jun 02 19:03:53.623700 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.623687 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" Jun 02 19:03:53.626414 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.626395 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 02 19:03:53.626492 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.626398 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 02 19:03:53.626492 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.626430 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 02 19:03:53.626670 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.626656 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-bx85k\"" Jun 02 19:03:53.626912 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.626895 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 02 19:03:53.632223 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.632206 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 02 19:03:53.635367 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.635351 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8fjl\" (UniqueName: \"kubernetes.io/projected/a7bebca5-7203-4903-8298-b2d03a8b8b31-kube-api-access-l8fjl\") pod \"service-ca-operator-69877444c-lz4mf\" (UID: \"a7bebca5-7203-4903-8298-b2d03a8b8b31\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-lz4mf" Jun 02 19:03:53.635441 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.635379 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4klxx\" (UniqueName: \"kubernetes.io/projected/5361bc1f-484a-4b20-803a-02b1bd7aff31-kube-api-access-4klxx\") pod \"cluster-samples-operator-755bbf9bfb-gcb84\" (UID: \"5361bc1f-484a-4b20-803a-02b1bd7aff31\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gcb84" Jun 02 19:03:53.635441 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.635397 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3a1232c5-ec81-4d50-ae3b-6197805dd970-ca-trust-extracted\") pod \"image-registry-7474894d9b-m2x4b\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:03:53.635441 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.635418 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f6d92fd4-4328-46b7-b3e4-448c1b6bce14-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-2pkxz\" (UID: \"f6d92fd4-4328-46b7-b3e4-448c1b6bce14\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2pkxz" Jun 02 19:03:53.635441 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.635435 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3a1232c5-ec81-4d50-ae3b-6197805dd970-trusted-ca\") pod \"image-registry-7474894d9b-m2x4b\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:03:53.635571 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.635471 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-registry-tls\") pod \"image-registry-7474894d9b-m2x4b\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:03:53.635571 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.635496 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c590dacd-1369-4e42-b9ad-e6422b219426-stats-auth\") pod \"router-default-6c96dcf58c-hn2d6\" (UID: \"c590dacd-1369-4e42-b9ad-e6422b219426\") " pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:03:53.635571 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.635517 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-bound-sa-token\") pod \"image-registry-7474894d9b-m2x4b\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:03:53.635571 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.635533 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcs8z\" (UniqueName: \"kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-kube-api-access-mcs8z\") pod \"image-registry-7474894d9b-m2x4b\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:03:53.635571 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.635548 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bc9r\" (UniqueName: \"kubernetes.io/projected/6f1f23f4-811b-4aa3-8c26-8d0e018d202d-kube-api-access-9bc9r\") pod \"network-check-source-56d84b9f44-qbblk\" (UID: \"6f1f23f4-811b-4aa3-8c26-8d0e018d202d\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-qbblk" Jun 02 19:03:53.635571 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.635565 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c590dacd-1369-4e42-b9ad-e6422b219426-metrics-certs\") pod \"router-default-6c96dcf58c-hn2d6\" (UID: \"c590dacd-1369-4e42-b9ad-e6422b219426\") " pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:03:53.635782 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.635598 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a7bebca5-7203-4903-8298-b2d03a8b8b31-serving-cert\") pod \"service-ca-operator-69877444c-lz4mf\" (UID: \"a7bebca5-7203-4903-8298-b2d03a8b8b31\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-lz4mf" Jun 02 19:03:53.635782 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.635634 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/17a50869-5f95-4436-9eaf-c2ad111ccd76-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-l2lnk\" (UID: \"17a50869-5f95-4436-9eaf-c2ad111ccd76\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-l2lnk" Jun 02 19:03:53.635782 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.635662 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j76gk\" (UniqueName: \"kubernetes.io/projected/17a50869-5f95-4436-9eaf-c2ad111ccd76-kube-api-access-j76gk\") pod \"cluster-monitoring-operator-69b6cbdb88-l2lnk\" (UID: \"17a50869-5f95-4436-9eaf-c2ad111ccd76\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-l2lnk" Jun 02 19:03:53.635782 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:53.635708 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 19:03:53.635782 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:53.635782 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17a50869-5f95-4436-9eaf-c2ad111ccd76-cluster-monitoring-operator-tls podName:17a50869-5f95-4436-9eaf-c2ad111ccd76 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:54.135766652 +0000 UTC m=+38.110668171 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/17a50869-5f95-4436-9eaf-c2ad111ccd76-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-l2lnk" (UID: "17a50869-5f95-4436-9eaf-c2ad111ccd76") : secret "cluster-monitoring-operator-tls" not found Jun 02 19:03:53.636010 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.635797 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3a1232c5-ec81-4d50-ae3b-6197805dd970-registry-certificates\") pod \"image-registry-7474894d9b-m2x4b\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:03:53.636010 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.635813 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3a1232c5-ec81-4d50-ae3b-6197805dd970-installation-pull-secrets\") pod \"image-registry-7474894d9b-m2x4b\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:03:53.636010 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.635832 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c590dacd-1369-4e42-b9ad-e6422b219426-service-ca-bundle\") pod \"router-default-6c96dcf58c-hn2d6\" (UID: \"c590dacd-1369-4e42-b9ad-e6422b219426\") " pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:03:53.636010 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.635864 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c590dacd-1369-4e42-b9ad-e6422b219426-default-certificate\") pod \"router-default-6c96dcf58c-hn2d6\" (UID: \"c590dacd-1369-4e42-b9ad-e6422b219426\") " pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:03:53.636010 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.635910 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m4wlz\" (UniqueName: \"kubernetes.io/projected/f6d92fd4-4328-46b7-b3e4-448c1b6bce14-kube-api-access-m4wlz\") pod \"kube-storage-version-migrator-operator-96ddc787c-2pkxz\" (UID: \"f6d92fd4-4328-46b7-b3e4-448c1b6bce14\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2pkxz" Jun 02 19:03:53.636010 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.635942 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csxhb\" (UniqueName: \"kubernetes.io/projected/d89bfa95-df32-4295-a085-8f1e0388aa74-kube-api-access-csxhb\") pod \"volume-data-source-validator-7598fd5bd-tc247\" (UID: \"d89bfa95-df32-4295-a085-8f1e0388aa74\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tc247" Jun 02 19:03:53.636010 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.635986 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f6d92fd4-4328-46b7-b3e4-448c1b6bce14-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-2pkxz\" (UID: \"f6d92fd4-4328-46b7-b3e4-448c1b6bce14\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2pkxz" Jun 02 19:03:53.636285 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.636012 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5361bc1f-484a-4b20-803a-02b1bd7aff31-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-gcb84\" (UID: \"5361bc1f-484a-4b20-803a-02b1bd7aff31\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gcb84" Jun 02 19:03:53.636285 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.636040 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3a1232c5-ec81-4d50-ae3b-6197805dd970-image-registry-private-configuration\") pod \"image-registry-7474894d9b-m2x4b\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:03:53.636285 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.636085 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/17a50869-5f95-4436-9eaf-c2ad111ccd76-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-l2lnk\" (UID: \"17a50869-5f95-4436-9eaf-c2ad111ccd76\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-l2lnk" Jun 02 19:03:53.636285 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.636110 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a7bebca5-7203-4903-8298-b2d03a8b8b31-config\") pod \"service-ca-operator-69877444c-lz4mf\" (UID: \"a7bebca5-7203-4903-8298-b2d03a8b8b31\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-lz4mf" Jun 02 19:03:53.636285 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:53.636127 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 19:03:53.636285 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.636155 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58fv7\" (UniqueName: \"kubernetes.io/projected/c590dacd-1369-4e42-b9ad-e6422b219426-kube-api-access-58fv7\") pod \"router-default-6c96dcf58c-hn2d6\" (UID: \"c590dacd-1369-4e42-b9ad-e6422b219426\") " pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:03:53.636285 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:53.636172 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5361bc1f-484a-4b20-803a-02b1bd7aff31-samples-operator-tls podName:5361bc1f-484a-4b20-803a-02b1bd7aff31 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:54.136162073 +0000 UTC m=+38.111063588 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5361bc1f-484a-4b20-803a-02b1bd7aff31-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-gcb84" (UID: "5361bc1f-484a-4b20-803a-02b1bd7aff31") : secret "samples-operator-tls" not found Jun 02 19:03:53.636512 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.636443 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f6d92fd4-4328-46b7-b3e4-448c1b6bce14-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-2pkxz\" (UID: \"f6d92fd4-4328-46b7-b3e4-448c1b6bce14\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2pkxz" Jun 02 19:03:53.636783 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.636765 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/17a50869-5f95-4436-9eaf-c2ad111ccd76-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-l2lnk\" (UID: \"17a50869-5f95-4436-9eaf-c2ad111ccd76\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-l2lnk" Jun 02 19:03:53.639423 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.639408 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f6d92fd4-4328-46b7-b3e4-448c1b6bce14-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-2pkxz\" (UID: \"f6d92fd4-4328-46b7-b3e4-448c1b6bce14\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2pkxz" Jun 02 19:03:53.648093 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.648072 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dxkps"] Jun 02 19:03:53.648211 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.648196 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:03:53.648932 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.648903 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4wlz\" (UniqueName: \"kubernetes.io/projected/f6d92fd4-4328-46b7-b3e4-448c1b6bce14-kube-api-access-m4wlz\") pod \"kube-storage-version-migrator-operator-96ddc787c-2pkxz\" (UID: \"f6d92fd4-4328-46b7-b3e4-448c1b6bce14\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2pkxz" Jun 02 19:03:53.649089 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.649069 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j76gk\" (UniqueName: \"kubernetes.io/projected/17a50869-5f95-4436-9eaf-c2ad111ccd76-kube-api-access-j76gk\") pod \"cluster-monitoring-operator-69b6cbdb88-l2lnk\" (UID: \"17a50869-5f95-4436-9eaf-c2ad111ccd76\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-l2lnk" Jun 02 19:03:53.649736 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.649708 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4klxx\" (UniqueName: \"kubernetes.io/projected/5361bc1f-484a-4b20-803a-02b1bd7aff31-kube-api-access-4klxx\") pod \"cluster-samples-operator-755bbf9bfb-gcb84\" (UID: \"5361bc1f-484a-4b20-803a-02b1bd7aff31\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gcb84" Jun 02 19:03:53.677364 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.677345 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-l2w9x"] Jun 02 19:03:53.677463 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.677452 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dxkps" Jun 02 19:03:53.680288 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.680274 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 19:03:53.681033 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.681019 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 19:03:53.681910 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.681896 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z6cjs\"" Jun 02 19:03:53.685874 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.685844 2557 generic.go:358] "Generic (PLEG): container finished" podID="0d46be99-6b62-4c3d-8106-257edfbba1ac" containerID="a33479386db409266487aac79a42485afc4a1daa2a367d03139736bd49116d4b" exitCode=0 Jun 02 19:03:53.686357 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.686344 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 19:03:53.704966 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.704941 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jr7p2" event={"ID":"0d46be99-6b62-4c3d-8106-257edfbba1ac","Type":"ContainerDied","Data":"a33479386db409266487aac79a42485afc4a1daa2a367d03139736bd49116d4b"} Jun 02 19:03:53.704966 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.704968 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gcb84"] Jun 02 19:03:53.705086 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.704980 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tc247"] Jun 02 19:03:53.705086 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.704988 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-l2lnk"] Jun 02 19:03:53.705086 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.704996 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-qbblk"] Jun 02 19:03:53.705086 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.705003 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7474894d9b-m2x4b"] Jun 02 19:03:53.705086 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.705012 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-lz4mf"] Jun 02 19:03:53.705086 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.705020 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-hfhgt"] Jun 02 19:03:53.705086 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.705027 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-kxcxc"] Jun 02 19:03:53.705086 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.705034 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-5hlnl"] Jun 02 19:03:53.705086 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.705040 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l2w9x"] Jun 02 19:03:53.705086 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.705047 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6676c7c455-jc7gc"] Jun 02 19:03:53.705086 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.705054 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dxkps"] Jun 02 19:03:53.705086 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.705061 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6c96dcf58c-hn2d6"] Jun 02 19:03:53.705543 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.705133 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l2w9x" Jun 02 19:03:53.708347 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.708331 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 19:03:53.708407 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.708387 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 19:03:53.708617 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.708603 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t48t7\"" Jun 02 19:03:53.720750 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.720735 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2pkxz" Jun 02 19:03:53.736502 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.736482 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3a1232c5-ec81-4d50-ae3b-6197805dd970-image-registry-private-configuration\") pod \"image-registry-7474894d9b-m2x4b\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:03:53.736599 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.736510 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l8fjl\" (UniqueName: \"kubernetes.io/projected/a7bebca5-7203-4903-8298-b2d03a8b8b31-kube-api-access-l8fjl\") pod \"service-ca-operator-69877444c-lz4mf\" (UID: \"a7bebca5-7203-4903-8298-b2d03a8b8b31\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-lz4mf" Jun 02 19:03:53.736599 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.736530 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/049e9671-1102-4305-b575-93b90999960a-registry-certificates\") pod \"image-registry-6676c7c455-jc7gc\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:03:53.736599 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.736547 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a7bebca5-7203-4903-8298-b2d03a8b8b31-config\") pod \"service-ca-operator-69877444c-lz4mf\" (UID: \"a7bebca5-7203-4903-8298-b2d03a8b8b31\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-lz4mf" Jun 02 19:03:53.736599 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.736565 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3-serving-cert\") pod \"console-operator-86d7c6cc77-kxcxc\" (UID: \"7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" Jun 02 19:03:53.736806 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.736607 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/049e9671-1102-4305-b575-93b90999960a-ca-trust-extracted\") pod \"image-registry-6676c7c455-jc7gc\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:03:53.736806 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.736690 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-58fv7\" (UniqueName: \"kubernetes.io/projected/c590dacd-1369-4e42-b9ad-e6422b219426-kube-api-access-58fv7\") pod \"router-default-6c96dcf58c-hn2d6\" (UID: \"c590dacd-1369-4e42-b9ad-e6422b219426\") " pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:03:53.736914 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.736834 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3-config\") pod \"console-operator-86d7c6cc77-kxcxc\" (UID: \"7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" Jun 02 19:03:53.736914 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.736867 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-bound-sa-token\") pod \"image-registry-6676c7c455-jc7gc\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:03:53.736914 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.736900 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a7bebca5-7203-4903-8298-b2d03a8b8b31-serving-cert\") pod \"service-ca-operator-69877444c-lz4mf\" (UID: \"a7bebca5-7203-4903-8298-b2d03a8b8b31\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-lz4mf" Jun 02 19:03:53.737057 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.736927 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06a683cd-e489-4964-9795-c06845389ce7-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-5hlnl\" (UID: \"06a683cd-e489-4964-9795-c06845389ce7\") " pod="openshift-insights/insights-operator-788bf58df5-5hlnl" Jun 02 19:03:53.737057 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.736971 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-registry-tls\") pod \"image-registry-6676c7c455-jc7gc\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:03:53.737057 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.737007 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mcs8z\" (UniqueName: \"kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-kube-api-access-mcs8z\") pod \"image-registry-7474894d9b-m2x4b\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:03:53.737057 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.737035 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9bc9r\" (UniqueName: \"kubernetes.io/projected/6f1f23f4-811b-4aa3-8c26-8d0e018d202d-kube-api-access-9bc9r\") pod \"network-check-source-56d84b9f44-qbblk\" (UID: \"6f1f23f4-811b-4aa3-8c26-8d0e018d202d\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-qbblk" Jun 02 19:03:53.737250 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.737063 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3a1232c5-ec81-4d50-ae3b-6197805dd970-registry-certificates\") pod \"image-registry-7474894d9b-m2x4b\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:03:53.737250 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.737091 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c590dacd-1369-4e42-b9ad-e6422b219426-default-certificate\") pod \"router-default-6c96dcf58c-hn2d6\" (UID: \"c590dacd-1369-4e42-b9ad-e6422b219426\") " pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:03:53.737250 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.737123 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-csxhb\" (UniqueName: \"kubernetes.io/projected/d89bfa95-df32-4295-a085-8f1e0388aa74-kube-api-access-csxhb\") pod \"volume-data-source-validator-7598fd5bd-tc247\" (UID: \"d89bfa95-df32-4295-a085-8f1e0388aa74\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tc247" Jun 02 19:03:53.737250 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.737141 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a7bebca5-7203-4903-8298-b2d03a8b8b31-config\") pod \"service-ca-operator-69877444c-lz4mf\" (UID: \"a7bebca5-7203-4903-8298-b2d03a8b8b31\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-lz4mf" Jun 02 19:03:53.737250 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.737151 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/049e9671-1102-4305-b575-93b90999960a-installation-pull-secrets\") pod \"image-registry-6676c7c455-jc7gc\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:03:53.737250 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.737178 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpfbk\" (UniqueName: \"kubernetes.io/projected/06a683cd-e489-4964-9795-c06845389ce7-kube-api-access-lpfbk\") pod \"insights-operator-788bf58df5-5hlnl\" (UID: \"06a683cd-e489-4964-9795-c06845389ce7\") " pod="openshift-insights/insights-operator-788bf58df5-5hlnl" Jun 02 19:03:53.737250 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.737239 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3a1232c5-ec81-4d50-ae3b-6197805dd970-ca-trust-extracted\") pod \"image-registry-7474894d9b-m2x4b\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:03:53.737599 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.737263 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3-trusted-ca\") pod \"console-operator-86d7c6cc77-kxcxc\" (UID: \"7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" Jun 02 19:03:53.737599 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.737293 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3a1232c5-ec81-4d50-ae3b-6197805dd970-trusted-ca\") pod \"image-registry-7474894d9b-m2x4b\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:03:53.737599 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.737344 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c590dacd-1369-4e42-b9ad-e6422b219426-stats-auth\") pod \"router-default-6c96dcf58c-hn2d6\" (UID: \"c590dacd-1369-4e42-b9ad-e6422b219426\") " pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:03:53.737599 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.737386 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df9kp\" (UniqueName: \"kubernetes.io/projected/7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3-kube-api-access-df9kp\") pod \"console-operator-86d7c6cc77-kxcxc\" (UID: \"7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" Jun 02 19:03:53.737908 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.737843 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-bound-sa-token\") pod \"image-registry-7474894d9b-m2x4b\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:03:53.737908 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.737886 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c590dacd-1369-4e42-b9ad-e6422b219426-metrics-certs\") pod \"router-default-6c96dcf58c-hn2d6\" (UID: \"c590dacd-1369-4e42-b9ad-e6422b219426\") " pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:03:53.738022 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.737914 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06a683cd-e489-4964-9795-c06845389ce7-tmp\") pod \"insights-operator-788bf58df5-5hlnl\" (UID: \"06a683cd-e489-4964-9795-c06845389ce7\") " pod="openshift-insights/insights-operator-788bf58df5-5hlnl" Jun 02 19:03:53.738022 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.737951 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-registry-tls\") pod \"image-registry-7474894d9b-m2x4b\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:03:53.738022 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.737952 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3a1232c5-ec81-4d50-ae3b-6197805dd970-registry-certificates\") pod \"image-registry-7474894d9b-m2x4b\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:03:53.738022 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.737983 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqmfw\" (UniqueName: \"kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-kube-api-access-vqmfw\") pod \"image-registry-6676c7c455-jc7gc\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:03:53.738022 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.738019 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c489102-a181-45b3-b63e-b54e3046b8cc-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-hfhgt\" (UID: \"0c489102-a181-45b3-b63e-b54e3046b8cc\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-hfhgt" Jun 02 19:03:53.738322 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.738049 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/06a683cd-e489-4964-9795-c06845389ce7-snapshots\") pod \"insights-operator-788bf58df5-5hlnl\" (UID: \"06a683cd-e489-4964-9795-c06845389ce7\") " pod="openshift-insights/insights-operator-788bf58df5-5hlnl" Jun 02 19:03:53.738322 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.738087 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/049e9671-1102-4305-b575-93b90999960a-trusted-ca\") pod \"image-registry-6676c7c455-jc7gc\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:03:53.738322 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:53.738136 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 19:03:53.738322 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:53.738153 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7474894d9b-m2x4b: secret "image-registry-tls" not found Jun 02 19:03:53.738322 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.738155 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3a1232c5-ec81-4d50-ae3b-6197805dd970-installation-pull-secrets\") pod \"image-registry-7474894d9b-m2x4b\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:03:53.738322 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.738186 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0c489102-a181-45b3-b63e-b54e3046b8cc-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-hfhgt\" (UID: \"0c489102-a181-45b3-b63e-b54e3046b8cc\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-hfhgt" Jun 02 19:03:53.738322 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:53.738201 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-registry-tls podName:3a1232c5-ec81-4d50-ae3b-6197805dd970 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:54.238182902 +0000 UTC m=+38.213084434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-registry-tls") pod "image-registry-7474894d9b-m2x4b" (UID: "3a1232c5-ec81-4d50-ae3b-6197805dd970") : secret "image-registry-tls" not found Jun 02 19:03:53.738322 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.738249 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c590dacd-1369-4e42-b9ad-e6422b219426-service-ca-bundle\") pod \"router-default-6c96dcf58c-hn2d6\" (UID: \"c590dacd-1369-4e42-b9ad-e6422b219426\") " pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:03:53.738322 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:53.738271 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 19:03:53.738322 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.738281 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/06a683cd-e489-4964-9795-c06845389ce7-serving-cert\") pod \"insights-operator-788bf58df5-5hlnl\" (UID: \"06a683cd-e489-4964-9795-c06845389ce7\") " pod="openshift-insights/insights-operator-788bf58df5-5hlnl" Jun 02 19:03:53.738831 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:53.738412 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c590dacd-1369-4e42-b9ad-e6422b219426-metrics-certs podName:c590dacd-1369-4e42-b9ad-e6422b219426 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:54.238299294 +0000 UTC m=+38.213200812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c590dacd-1369-4e42-b9ad-e6422b219426-metrics-certs") pod "router-default-6c96dcf58c-hn2d6" (UID: "c590dacd-1369-4e42-b9ad-e6422b219426") : secret "router-metrics-certs-default" not found Jun 02 19:03:53.738831 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.738483 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/049e9671-1102-4305-b575-93b90999960a-image-registry-private-configuration\") pod \"image-registry-6676c7c455-jc7gc\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:03:53.738831 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.738513 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06a683cd-e489-4964-9795-c06845389ce7-service-ca-bundle\") pod \"insights-operator-788bf58df5-5hlnl\" (UID: \"06a683cd-e489-4964-9795-c06845389ce7\") " pod="openshift-insights/insights-operator-788bf58df5-5hlnl" Jun 02 19:03:53.738831 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:53.738657 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c590dacd-1369-4e42-b9ad-e6422b219426-service-ca-bundle podName:c590dacd-1369-4e42-b9ad-e6422b219426 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:54.238644249 +0000 UTC m=+38.213545787 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c590dacd-1369-4e42-b9ad-e6422b219426-service-ca-bundle") pod "router-default-6c96dcf58c-hn2d6" (UID: "c590dacd-1369-4e42-b9ad-e6422b219426") : configmap references non-existent config key: service-ca.crt Jun 02 19:03:53.739139 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.739029 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3a1232c5-ec81-4d50-ae3b-6197805dd970-ca-trust-extracted\") pod \"image-registry-7474894d9b-m2x4b\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:03:53.739541 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.739514 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3a1232c5-ec81-4d50-ae3b-6197805dd970-trusted-ca\") pod \"image-registry-7474894d9b-m2x4b\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:03:53.742457 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.740583 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c590dacd-1369-4e42-b9ad-e6422b219426-stats-auth\") pod \"router-default-6c96dcf58c-hn2d6\" (UID: \"c590dacd-1369-4e42-b9ad-e6422b219426\") " pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:03:53.742457 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.741932 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c590dacd-1369-4e42-b9ad-e6422b219426-default-certificate\") pod \"router-default-6c96dcf58c-hn2d6\" (UID: \"c590dacd-1369-4e42-b9ad-e6422b219426\") " pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:03:53.742457 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.742375 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a7bebca5-7203-4903-8298-b2d03a8b8b31-serving-cert\") pod \"service-ca-operator-69877444c-lz4mf\" (UID: \"a7bebca5-7203-4903-8298-b2d03a8b8b31\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-lz4mf" Jun 02 19:03:53.742783 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.742748 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3a1232c5-ec81-4d50-ae3b-6197805dd970-installation-pull-secrets\") pod \"image-registry-7474894d9b-m2x4b\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:03:53.743004 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.742986 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3a1232c5-ec81-4d50-ae3b-6197805dd970-image-registry-private-configuration\") pod \"image-registry-7474894d9b-m2x4b\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:03:53.754129 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.754102 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bc9r\" (UniqueName: \"kubernetes.io/projected/6f1f23f4-811b-4aa3-8c26-8d0e018d202d-kube-api-access-9bc9r\") pod \"network-check-source-56d84b9f44-qbblk\" (UID: \"6f1f23f4-811b-4aa3-8c26-8d0e018d202d\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-qbblk" Jun 02 19:03:53.754599 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.754574 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-bound-sa-token\") pod \"image-registry-7474894d9b-m2x4b\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:03:53.755078 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.755056 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8fjl\" (UniqueName: \"kubernetes.io/projected/a7bebca5-7203-4903-8298-b2d03a8b8b31-kube-api-access-l8fjl\") pod \"service-ca-operator-69877444c-lz4mf\" (UID: \"a7bebca5-7203-4903-8298-b2d03a8b8b31\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-lz4mf" Jun 02 19:03:53.755446 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.755427 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58fv7\" (UniqueName: \"kubernetes.io/projected/c590dacd-1369-4e42-b9ad-e6422b219426-kube-api-access-58fv7\") pod \"router-default-6c96dcf58c-hn2d6\" (UID: \"c590dacd-1369-4e42-b9ad-e6422b219426\") " pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:03:53.755620 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.755599 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcs8z\" (UniqueName: \"kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-kube-api-access-mcs8z\") pod \"image-registry-7474894d9b-m2x4b\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:03:53.763013 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.762971 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csxhb\" (UniqueName: \"kubernetes.io/projected/d89bfa95-df32-4295-a085-8f1e0388aa74-kube-api-access-csxhb\") pod \"volume-data-source-validator-7598fd5bd-tc247\" (UID: \"d89bfa95-df32-4295-a085-8f1e0388aa74\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tc247" Jun 02 19:03:53.809375 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.809357 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tc247" Jun 02 19:03:53.834227 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.834046 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-qbblk" Jun 02 19:03:53.839268 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.839244 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/049e9671-1102-4305-b575-93b90999960a-installation-pull-secrets\") pod \"image-registry-6676c7c455-jc7gc\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:03:53.839399 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.839282 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lpfbk\" (UniqueName: \"kubernetes.io/projected/06a683cd-e489-4964-9795-c06845389ce7-kube-api-access-lpfbk\") pod \"insights-operator-788bf58df5-5hlnl\" (UID: \"06a683cd-e489-4964-9795-c06845389ce7\") " pod="openshift-insights/insights-operator-788bf58df5-5hlnl" Jun 02 19:03:53.839399 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.839367 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3-trusted-ca\") pod \"console-operator-86d7c6cc77-kxcxc\" (UID: \"7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" Jun 02 19:03:53.839511 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.839403 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-df9kp\" (UniqueName: \"kubernetes.io/projected/7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3-kube-api-access-df9kp\") pod \"console-operator-86d7c6cc77-kxcxc\" (UID: \"7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" Jun 02 19:03:53.839511 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.839456 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06a683cd-e489-4964-9795-c06845389ce7-tmp\") pod \"insights-operator-788bf58df5-5hlnl\" (UID: \"06a683cd-e489-4964-9795-c06845389ce7\") " pod="openshift-insights/insights-operator-788bf58df5-5hlnl" Jun 02 19:03:53.839511 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.839486 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ba16f49-e177-4b3a-9559-f61b332d28f5-tmp-dir\") pod \"dns-default-l2w9x\" (UID: \"3ba16f49-e177-4b3a-9559-f61b332d28f5\") " pod="openshift-dns/dns-default-l2w9x" Jun 02 19:03:53.839651 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.839529 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vqmfw\" (UniqueName: \"kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-kube-api-access-vqmfw\") pod \"image-registry-6676c7c455-jc7gc\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:03:53.839651 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.839561 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c489102-a181-45b3-b63e-b54e3046b8cc-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-hfhgt\" (UID: \"0c489102-a181-45b3-b63e-b54e3046b8cc\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-hfhgt" Jun 02 19:03:53.839651 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.839588 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/06a683cd-e489-4964-9795-c06845389ce7-snapshots\") pod \"insights-operator-788bf58df5-5hlnl\" (UID: \"06a683cd-e489-4964-9795-c06845389ce7\") " pod="openshift-insights/insights-operator-788bf58df5-5hlnl" Jun 02 19:03:53.839651 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.839615 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/049e9671-1102-4305-b575-93b90999960a-trusted-ca\") pod \"image-registry-6676c7c455-jc7gc\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:03:53.839651 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.839647 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhqg6\" (UniqueName: \"kubernetes.io/projected/3ba16f49-e177-4b3a-9559-f61b332d28f5-kube-api-access-xhqg6\") pod \"dns-default-l2w9x\" (UID: \"3ba16f49-e177-4b3a-9559-f61b332d28f5\") " pod="openshift-dns/dns-default-l2w9x" Jun 02 19:03:53.839877 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.839767 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3ba16f49-e177-4b3a-9559-f61b332d28f5-config-volume\") pod \"dns-default-l2w9x\" (UID: \"3ba16f49-e177-4b3a-9559-f61b332d28f5\") " pod="openshift-dns/dns-default-l2w9x" Jun 02 19:03:53.839927 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.839913 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06a683cd-e489-4964-9795-c06845389ce7-tmp\") pod \"insights-operator-788bf58df5-5hlnl\" (UID: \"06a683cd-e489-4964-9795-c06845389ce7\") " pod="openshift-insights/insights-operator-788bf58df5-5hlnl" Jun 02 19:03:53.840581 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.840302 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0c489102-a181-45b3-b63e-b54e3046b8cc-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-hfhgt\" (UID: \"0c489102-a181-45b3-b63e-b54e3046b8cc\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-hfhgt" Jun 02 19:03:53.840581 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.840417 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/06a683cd-e489-4964-9795-c06845389ce7-snapshots\") pod \"insights-operator-788bf58df5-5hlnl\" (UID: \"06a683cd-e489-4964-9795-c06845389ce7\") " pod="openshift-insights/insights-operator-788bf58df5-5hlnl" Jun 02 19:03:53.840581 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:53.840491 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 19:03:53.840581 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:53.840579 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c489102-a181-45b3-b63e-b54e3046b8cc-networking-console-plugin-cert podName:0c489102-a181-45b3-b63e-b54e3046b8cc nodeName:}" failed. No retries permitted until 2026-06-02 19:03:54.340559676 +0000 UTC m=+38.315461207 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0c489102-a181-45b3-b63e-b54e3046b8cc-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-hfhgt" (UID: "0c489102-a181-45b3-b63e-b54e3046b8cc") : secret "networking-console-plugin-cert" not found Jun 02 19:03:53.840864 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.840606 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/06a683cd-e489-4964-9795-c06845389ce7-serving-cert\") pod \"insights-operator-788bf58df5-5hlnl\" (UID: \"06a683cd-e489-4964-9795-c06845389ce7\") " pod="openshift-insights/insights-operator-788bf58df5-5hlnl" Jun 02 19:03:53.840864 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.840646 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ba16f49-e177-4b3a-9559-f61b332d28f5-metrics-tls\") pod \"dns-default-l2w9x\" (UID: \"3ba16f49-e177-4b3a-9559-f61b332d28f5\") " pod="openshift-dns/dns-default-l2w9x" Jun 02 19:03:53.840864 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.840679 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/049e9671-1102-4305-b575-93b90999960a-image-registry-private-configuration\") pod \"image-registry-6676c7c455-jc7gc\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:03:53.840864 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.840708 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06a683cd-e489-4964-9795-c06845389ce7-service-ca-bundle\") pod \"insights-operator-788bf58df5-5hlnl\" (UID: \"06a683cd-e489-4964-9795-c06845389ce7\") " pod="openshift-insights/insights-operator-788bf58df5-5hlnl" Jun 02 19:03:53.840864 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.840749 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0b95f6c-05eb-4df0-bd51-0c267429a4ed-cert\") pod \"ingress-canary-dxkps\" (UID: \"c0b95f6c-05eb-4df0-bd51-0c267429a4ed\") " pod="openshift-ingress-canary/ingress-canary-dxkps" Jun 02 19:03:53.840864 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.840801 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/049e9671-1102-4305-b575-93b90999960a-registry-certificates\") pod \"image-registry-6676c7c455-jc7gc\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:03:53.840864 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.840833 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3-serving-cert\") pod \"console-operator-86d7c6cc77-kxcxc\" (UID: \"7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" Jun 02 19:03:53.840864 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.840861 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/049e9671-1102-4305-b575-93b90999960a-ca-trust-extracted\") pod \"image-registry-6676c7c455-jc7gc\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:03:53.841257 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.840916 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3-config\") pod \"console-operator-86d7c6cc77-kxcxc\" (UID: \"7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" Jun 02 19:03:53.841257 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.840948 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-bound-sa-token\") pod \"image-registry-6676c7c455-jc7gc\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:03:53.841257 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.840968 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/049e9671-1102-4305-b575-93b90999960a-trusted-ca\") pod \"image-registry-6676c7c455-jc7gc\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:03:53.841257 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.840975 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0c489102-a181-45b3-b63e-b54e3046b8cc-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-hfhgt\" (UID: \"0c489102-a181-45b3-b63e-b54e3046b8cc\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-hfhgt" Jun 02 19:03:53.841257 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.840991 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06a683cd-e489-4964-9795-c06845389ce7-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-5hlnl\" (UID: \"06a683cd-e489-4964-9795-c06845389ce7\") " pod="openshift-insights/insights-operator-788bf58df5-5hlnl" Jun 02 19:03:53.841541 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.841520 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/049e9671-1102-4305-b575-93b90999960a-registry-certificates\") pod \"image-registry-6676c7c455-jc7gc\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:03:53.842820 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.841647 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06a683cd-e489-4964-9795-c06845389ce7-service-ca-bundle\") pod \"insights-operator-788bf58df5-5hlnl\" (UID: \"06a683cd-e489-4964-9795-c06845389ce7\") " pod="openshift-insights/insights-operator-788bf58df5-5hlnl" Jun 02 19:03:53.842820 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.842267 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3-config\") pod \"console-operator-86d7c6cc77-kxcxc\" (UID: \"7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" Jun 02 19:03:53.842820 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.842362 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2htt\" (UniqueName: \"kubernetes.io/projected/c0b95f6c-05eb-4df0-bd51-0c267429a4ed-kube-api-access-s2htt\") pod \"ingress-canary-dxkps\" (UID: \"c0b95f6c-05eb-4df0-bd51-0c267429a4ed\") " pod="openshift-ingress-canary/ingress-canary-dxkps" Jun 02 19:03:53.842820 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.842409 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-registry-tls\") pod \"image-registry-6676c7c455-jc7gc\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:03:53.842820 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:53.842485 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 19:03:53.842820 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:53.842497 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6676c7c455-jc7gc: secret "image-registry-tls" not found Jun 02 19:03:53.842820 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.842500 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06a683cd-e489-4964-9795-c06845389ce7-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-5hlnl\" (UID: \"06a683cd-e489-4964-9795-c06845389ce7\") " pod="openshift-insights/insights-operator-788bf58df5-5hlnl" Jun 02 19:03:53.842820 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:53.842543 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-registry-tls podName:049e9671-1102-4305-b575-93b90999960a nodeName:}" failed. No retries permitted until 2026-06-02 19:03:54.342526259 +0000 UTC m=+38.317427774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-registry-tls") pod "image-registry-6676c7c455-jc7gc" (UID: "049e9671-1102-4305-b575-93b90999960a") : secret "image-registry-tls" not found Jun 02 19:03:53.842820 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.842574 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3-trusted-ca\") pod \"console-operator-86d7c6cc77-kxcxc\" (UID: \"7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" Jun 02 19:03:53.842820 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.842716 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/049e9671-1102-4305-b575-93b90999960a-ca-trust-extracted\") pod \"image-registry-6676c7c455-jc7gc\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:03:53.843353 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.843099 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/049e9671-1102-4305-b575-93b90999960a-installation-pull-secrets\") pod \"image-registry-6676c7c455-jc7gc\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:03:53.843520 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.843479 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3-serving-cert\") pod \"console-operator-86d7c6cc77-kxcxc\" (UID: \"7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" Jun 02 19:03:53.843520 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.843493 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/06a683cd-e489-4964-9795-c06845389ce7-serving-cert\") pod \"insights-operator-788bf58df5-5hlnl\" (UID: \"06a683cd-e489-4964-9795-c06845389ce7\") " pod="openshift-insights/insights-operator-788bf58df5-5hlnl" Jun 02 19:03:53.845583 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.845558 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/049e9671-1102-4305-b575-93b90999960a-image-registry-private-configuration\") pod \"image-registry-6676c7c455-jc7gc\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:03:53.850900 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.850816 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-bound-sa-token\") pod \"image-registry-6676c7c455-jc7gc\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:03:53.851812 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.851793 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqmfw\" (UniqueName: \"kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-kube-api-access-vqmfw\") pod \"image-registry-6676c7c455-jc7gc\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:03:53.853033 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.852991 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpfbk\" (UniqueName: \"kubernetes.io/projected/06a683cd-e489-4964-9795-c06845389ce7-kube-api-access-lpfbk\") pod \"insights-operator-788bf58df5-5hlnl\" (UID: \"06a683cd-e489-4964-9795-c06845389ce7\") " pod="openshift-insights/insights-operator-788bf58df5-5hlnl" Jun 02 19:03:53.853643 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.853605 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-df9kp\" (UniqueName: \"kubernetes.io/projected/7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3-kube-api-access-df9kp\") pod \"console-operator-86d7c6cc77-kxcxc\" (UID: \"7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" Jun 02 19:03:53.863216 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.863191 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-lz4mf" Jun 02 19:03:53.905716 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.905685 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-5hlnl" Jun 02 19:03:53.911912 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.911856 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2pkxz"] Jun 02 19:03:53.919509 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:53.919477 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6d92fd4_4328_46b7_b3e4_448c1b6bce14.slice/crio-d0dd38c258a8c02f4c9ed8ddaf8ee14f9f85f2e7fc2b62f4d1a791d33010c86e WatchSource:0}: Error finding container d0dd38c258a8c02f4c9ed8ddaf8ee14f9f85f2e7fc2b62f4d1a791d33010c86e: Status 404 returned error can't find the container with id d0dd38c258a8c02f4c9ed8ddaf8ee14f9f85f2e7fc2b62f4d1a791d33010c86e Jun 02 19:03:53.932940 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.932481 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" Jun 02 19:03:53.945733 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.943897 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s2htt\" (UniqueName: \"kubernetes.io/projected/c0b95f6c-05eb-4df0-bd51-0c267429a4ed-kube-api-access-s2htt\") pod \"ingress-canary-dxkps\" (UID: \"c0b95f6c-05eb-4df0-bd51-0c267429a4ed\") " pod="openshift-ingress-canary/ingress-canary-dxkps" Jun 02 19:03:53.945733 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.944031 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ba16f49-e177-4b3a-9559-f61b332d28f5-tmp-dir\") pod \"dns-default-l2w9x\" (UID: \"3ba16f49-e177-4b3a-9559-f61b332d28f5\") " pod="openshift-dns/dns-default-l2w9x" Jun 02 19:03:53.945733 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.944090 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xhqg6\" (UniqueName: \"kubernetes.io/projected/3ba16f49-e177-4b3a-9559-f61b332d28f5-kube-api-access-xhqg6\") pod \"dns-default-l2w9x\" (UID: \"3ba16f49-e177-4b3a-9559-f61b332d28f5\") " pod="openshift-dns/dns-default-l2w9x" Jun 02 19:03:53.945733 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.944129 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3ba16f49-e177-4b3a-9559-f61b332d28f5-config-volume\") pod \"dns-default-l2w9x\" (UID: \"3ba16f49-e177-4b3a-9559-f61b332d28f5\") " pod="openshift-dns/dns-default-l2w9x" Jun 02 19:03:53.945733 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.944172 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ba16f49-e177-4b3a-9559-f61b332d28f5-metrics-tls\") pod \"dns-default-l2w9x\" (UID: \"3ba16f49-e177-4b3a-9559-f61b332d28f5\") " pod="openshift-dns/dns-default-l2w9x" Jun 02 19:03:53.945733 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.944206 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0b95f6c-05eb-4df0-bd51-0c267429a4ed-cert\") pod \"ingress-canary-dxkps\" (UID: \"c0b95f6c-05eb-4df0-bd51-0c267429a4ed\") " pod="openshift-ingress-canary/ingress-canary-dxkps" Jun 02 19:03:53.946920 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:53.946443 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:03:53.946920 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:53.946509 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ba16f49-e177-4b3a-9559-f61b332d28f5-metrics-tls podName:3ba16f49-e177-4b3a-9559-f61b332d28f5 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:54.446489023 +0000 UTC m=+38.421390557 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ba16f49-e177-4b3a-9559-f61b332d28f5-metrics-tls") pod "dns-default-l2w9x" (UID: "3ba16f49-e177-4b3a-9559-f61b332d28f5") : secret "dns-default-metrics-tls" not found Jun 02 19:03:53.946920 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:53.946756 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:03:53.946920 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:53.946820 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0b95f6c-05eb-4df0-bd51-0c267429a4ed-cert podName:c0b95f6c-05eb-4df0-bd51-0c267429a4ed nodeName:}" failed. No retries permitted until 2026-06-02 19:03:54.446803085 +0000 UTC m=+38.421704617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c0b95f6c-05eb-4df0-bd51-0c267429a4ed-cert") pod "ingress-canary-dxkps" (UID: "c0b95f6c-05eb-4df0-bd51-0c267429a4ed") : secret "canary-serving-cert" not found Jun 02 19:03:53.946920 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.946877 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ba16f49-e177-4b3a-9559-f61b332d28f5-tmp-dir\") pod \"dns-default-l2w9x\" (UID: \"3ba16f49-e177-4b3a-9559-f61b332d28f5\") " pod="openshift-dns/dns-default-l2w9x" Jun 02 19:03:53.947635 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.947595 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3ba16f49-e177-4b3a-9559-f61b332d28f5-config-volume\") pod \"dns-default-l2w9x\" (UID: \"3ba16f49-e177-4b3a-9559-f61b332d28f5\") " pod="openshift-dns/dns-default-l2w9x" Jun 02 19:03:53.960887 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.960022 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhqg6\" (UniqueName: \"kubernetes.io/projected/3ba16f49-e177-4b3a-9559-f61b332d28f5-kube-api-access-xhqg6\") pod \"dns-default-l2w9x\" (UID: \"3ba16f49-e177-4b3a-9559-f61b332d28f5\") " pod="openshift-dns/dns-default-l2w9x" Jun 02 19:03:53.960887 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.960837 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2htt\" (UniqueName: \"kubernetes.io/projected/c0b95f6c-05eb-4df0-bd51-0c267429a4ed-kube-api-access-s2htt\") pod \"ingress-canary-dxkps\" (UID: \"c0b95f6c-05eb-4df0-bd51-0c267429a4ed\") " pod="openshift-ingress-canary/ingress-canary-dxkps" Jun 02 19:03:53.975369 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:53.975321 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tc247"] Jun 02 19:03:53.981845 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:53.981808 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd89bfa95_df32_4295_a085_8f1e0388aa74.slice/crio-19d75db7ae6029b544a806f1ad2598658228555711bc80f0265e62e8d5e8307c WatchSource:0}: Error finding container 19d75db7ae6029b544a806f1ad2598658228555711bc80f0265e62e8d5e8307c: Status 404 returned error can't find the container with id 19d75db7ae6029b544a806f1ad2598658228555711bc80f0265e62e8d5e8307c Jun 02 19:03:54.014147 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:54.014116 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-qbblk"] Jun 02 19:03:54.021230 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:54.021196 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f1f23f4_811b_4aa3_8c26_8d0e018d202d.slice/crio-c150df9089e2ff1f40aaabcdc3a94ae0c454226ff8c271af8bc8c53adc5447d9 WatchSource:0}: Error finding container c150df9089e2ff1f40aaabcdc3a94ae0c454226ff8c271af8bc8c53adc5447d9: Status 404 returned error can't find the container with id c150df9089e2ff1f40aaabcdc3a94ae0c454226ff8c271af8bc8c53adc5447d9 Jun 02 19:03:54.054249 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:54.054223 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-lz4mf"] Jun 02 19:03:54.058066 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:54.058037 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7bebca5_7203_4903_8298_b2d03a8b8b31.slice/crio-bff58d55e61288b06dd9bcb253ef36a324084d5685519a275c3aa86a93d698db WatchSource:0}: Error finding container bff58d55e61288b06dd9bcb253ef36a324084d5685519a275c3aa86a93d698db: Status 404 returned error can't find the container with id bff58d55e61288b06dd9bcb253ef36a324084d5685519a275c3aa86a93d698db Jun 02 19:03:54.080376 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:54.080350 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-5hlnl"] Jun 02 19:03:54.082867 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:54.082843 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06a683cd_e489_4964_9795_c06845389ce7.slice/crio-2fd98deb6d8a8a1d6b042c9af10e3d71bcd81679363ac5c690c0acb14fd1b0a4 WatchSource:0}: Error finding container 2fd98deb6d8a8a1d6b042c9af10e3d71bcd81679363ac5c690c0acb14fd1b0a4: Status 404 returned error can't find the container with id 2fd98deb6d8a8a1d6b042c9af10e3d71bcd81679363ac5c690c0acb14fd1b0a4 Jun 02 19:03:54.093850 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:54.093825 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-kxcxc"] Jun 02 19:03:54.096401 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:03:54.096376 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a07dbf1_6a3a_497e_ae7f_8e654a88a1a3.slice/crio-ce3b85cf1c422af2b30af46a11a5a6e90be75d2165a7a95ef827b48411365dfc WatchSource:0}: Error finding container ce3b85cf1c422af2b30af46a11a5a6e90be75d2165a7a95ef827b48411365dfc: Status 404 returned error can't find the container with id ce3b85cf1c422af2b30af46a11a5a6e90be75d2165a7a95ef827b48411365dfc Jun 02 19:03:54.145889 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:54.145868 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/17a50869-5f95-4436-9eaf-c2ad111ccd76-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-l2lnk\" (UID: \"17a50869-5f95-4436-9eaf-c2ad111ccd76\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-l2lnk" Jun 02 19:03:54.145993 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:54.145977 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5361bc1f-484a-4b20-803a-02b1bd7aff31-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-gcb84\" (UID: \"5361bc1f-484a-4b20-803a-02b1bd7aff31\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gcb84" Jun 02 19:03:54.146052 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:54.146016 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 19:03:54.146103 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:54.146071 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17a50869-5f95-4436-9eaf-c2ad111ccd76-cluster-monitoring-operator-tls podName:17a50869-5f95-4436-9eaf-c2ad111ccd76 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:55.146054319 +0000 UTC m=+39.120955856 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/17a50869-5f95-4436-9eaf-c2ad111ccd76-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-l2lnk" (UID: "17a50869-5f95-4436-9eaf-c2ad111ccd76") : secret "cluster-monitoring-operator-tls" not found Jun 02 19:03:54.146169 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:54.146098 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 19:03:54.146169 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:54.146157 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5361bc1f-484a-4b20-803a-02b1bd7aff31-samples-operator-tls podName:5361bc1f-484a-4b20-803a-02b1bd7aff31 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:55.146140319 +0000 UTC m=+39.121041850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5361bc1f-484a-4b20-803a-02b1bd7aff31-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-gcb84" (UID: "5361bc1f-484a-4b20-803a-02b1bd7aff31") : secret "samples-operator-tls" not found Jun 02 19:03:54.247351 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:54.247287 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c590dacd-1369-4e42-b9ad-e6422b219426-service-ca-bundle\") pod \"router-default-6c96dcf58c-hn2d6\" (UID: \"c590dacd-1369-4e42-b9ad-e6422b219426\") " pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:03:54.247426 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:54.247405 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c590dacd-1369-4e42-b9ad-e6422b219426-service-ca-bundle podName:c590dacd-1369-4e42-b9ad-e6422b219426 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:55.247392658 +0000 UTC m=+39.222294179 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c590dacd-1369-4e42-b9ad-e6422b219426-service-ca-bundle") pod "router-default-6c96dcf58c-hn2d6" (UID: "c590dacd-1369-4e42-b9ad-e6422b219426") : configmap references non-existent config key: service-ca.crt Jun 02 19:03:54.247529 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:54.247516 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c590dacd-1369-4e42-b9ad-e6422b219426-metrics-certs\") pod \"router-default-6c96dcf58c-hn2d6\" (UID: \"c590dacd-1369-4e42-b9ad-e6422b219426\") " pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:03:54.247569 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:54.247540 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-registry-tls\") pod \"image-registry-7474894d9b-m2x4b\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:03:54.247630 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:54.247620 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 19:03:54.247669 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:54.247631 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7474894d9b-m2x4b: secret "image-registry-tls" not found Jun 02 19:03:54.247669 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:54.247649 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 19:03:54.247669 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:54.247660 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-registry-tls podName:3a1232c5-ec81-4d50-ae3b-6197805dd970 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:55.24765206 +0000 UTC m=+39.222553575 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-registry-tls") pod "image-registry-7474894d9b-m2x4b" (UID: "3a1232c5-ec81-4d50-ae3b-6197805dd970") : secret "image-registry-tls" not found Jun 02 19:03:54.247772 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:54.247698 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c590dacd-1369-4e42-b9ad-e6422b219426-metrics-certs podName:c590dacd-1369-4e42-b9ad-e6422b219426 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:55.247682464 +0000 UTC m=+39.222583986 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c590dacd-1369-4e42-b9ad-e6422b219426-metrics-certs") pod "router-default-6c96dcf58c-hn2d6" (UID: "c590dacd-1369-4e42-b9ad-e6422b219426") : secret "router-metrics-certs-default" not found Jun 02 19:03:54.348456 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:54.348436 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-registry-tls\") pod \"image-registry-6676c7c455-jc7gc\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:03:54.348554 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:54.348508 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c489102-a181-45b3-b63e-b54e3046b8cc-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-hfhgt\" (UID: \"0c489102-a181-45b3-b63e-b54e3046b8cc\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-hfhgt" Jun 02 19:03:54.348609 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:54.348586 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 19:03:54.348609 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:54.348595 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 19:03:54.348715 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:54.348612 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6676c7c455-jc7gc: secret "image-registry-tls" not found Jun 02 19:03:54.348715 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:54.348619 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c489102-a181-45b3-b63e-b54e3046b8cc-networking-console-plugin-cert podName:0c489102-a181-45b3-b63e-b54e3046b8cc nodeName:}" failed. No retries permitted until 2026-06-02 19:03:55.348609383 +0000 UTC m=+39.323510904 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0c489102-a181-45b3-b63e-b54e3046b8cc-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-hfhgt" (UID: "0c489102-a181-45b3-b63e-b54e3046b8cc") : secret "networking-console-plugin-cert" not found Jun 02 19:03:54.348715 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:54.348657 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-registry-tls podName:049e9671-1102-4305-b575-93b90999960a nodeName:}" failed. No retries permitted until 2026-06-02 19:03:55.34864301 +0000 UTC m=+39.323544541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-registry-tls") pod "image-registry-6676c7c455-jc7gc" (UID: "049e9671-1102-4305-b575-93b90999960a") : secret "image-registry-tls" not found Jun 02 19:03:54.449803 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:54.449773 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0b95f6c-05eb-4df0-bd51-0c267429a4ed-cert\") pod \"ingress-canary-dxkps\" (UID: \"c0b95f6c-05eb-4df0-bd51-0c267429a4ed\") " pod="openshift-ingress-canary/ingress-canary-dxkps" Jun 02 19:03:54.449916 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:54.449878 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:03:54.449986 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:54.449939 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0b95f6c-05eb-4df0-bd51-0c267429a4ed-cert podName:c0b95f6c-05eb-4df0-bd51-0c267429a4ed nodeName:}" failed. No retries permitted until 2026-06-02 19:03:55.449923571 +0000 UTC m=+39.424825087 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c0b95f6c-05eb-4df0-bd51-0c267429a4ed-cert") pod "ingress-canary-dxkps" (UID: "c0b95f6c-05eb-4df0-bd51-0c267429a4ed") : secret "canary-serving-cert" not found Jun 02 19:03:54.450047 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:54.450012 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ba16f49-e177-4b3a-9559-f61b332d28f5-metrics-tls\") pod \"dns-default-l2w9x\" (UID: \"3ba16f49-e177-4b3a-9559-f61b332d28f5\") " pod="openshift-dns/dns-default-l2w9x" Jun 02 19:03:54.450104 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:54.450092 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:03:54.450156 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:54.450126 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ba16f49-e177-4b3a-9559-f61b332d28f5-metrics-tls podName:3ba16f49-e177-4b3a-9559-f61b332d28f5 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:55.450115817 +0000 UTC m=+39.425017347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ba16f49-e177-4b3a-9559-f61b332d28f5-metrics-tls") pod "dns-default-l2w9x" (UID: "3ba16f49-e177-4b3a-9559-f61b332d28f5") : secret "dns-default-metrics-tls" not found Jun 02 19:03:54.550355 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:54.550289 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:03:54.550478 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:54.550289 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:03:54.553518 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:54.553425 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dks2v\"" Jun 02 19:03:54.553690 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:54.553642 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mp95k\"" Jun 02 19:03:54.553837 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:54.553820 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 19:03:54.690270 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:54.690215 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" event={"ID":"7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3","Type":"ContainerStarted","Data":"ce3b85cf1c422af2b30af46a11a5a6e90be75d2165a7a95ef827b48411365dfc"} Jun 02 19:03:54.691761 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:54.691736 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-5hlnl" event={"ID":"06a683cd-e489-4964-9795-c06845389ce7","Type":"ContainerStarted","Data":"2fd98deb6d8a8a1d6b042c9af10e3d71bcd81679363ac5c690c0acb14fd1b0a4"} Jun 02 19:03:54.692999 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:54.692976 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-lz4mf" event={"ID":"a7bebca5-7203-4903-8298-b2d03a8b8b31","Type":"ContainerStarted","Data":"bff58d55e61288b06dd9bcb253ef36a324084d5685519a275c3aa86a93d698db"} Jun 02 19:03:54.694286 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:54.694238 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-qbblk" event={"ID":"6f1f23f4-811b-4aa3-8c26-8d0e018d202d","Type":"ContainerStarted","Data":"c150df9089e2ff1f40aaabcdc3a94ae0c454226ff8c271af8bc8c53adc5447d9"} Jun 02 19:03:54.695741 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:54.695707 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tc247" event={"ID":"d89bfa95-df32-4295-a085-8f1e0388aa74","Type":"ContainerStarted","Data":"19d75db7ae6029b544a806f1ad2598658228555711bc80f0265e62e8d5e8307c"} Jun 02 19:03:54.697251 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:54.697230 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2pkxz" event={"ID":"f6d92fd4-4328-46b7-b3e4-448c1b6bce14","Type":"ContainerStarted","Data":"d0dd38c258a8c02f4c9ed8ddaf8ee14f9f85f2e7fc2b62f4d1a791d33010c86e"} Jun 02 19:03:54.701141 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:54.701116 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jr7p2" event={"ID":"0d46be99-6b62-4c3d-8106-257edfbba1ac","Type":"ContainerStarted","Data":"57384e30150a6d35c3e771d4686031c9c6ab745c181cb4e9b459877aa3915d71"} Jun 02 19:03:54.726794 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:54.726677 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jr7p2" podStartSLOduration=5.925955561 podStartE2EDuration="38.726662433s" podCreationTimestamp="2026-06-02 19:03:16 +0000 UTC" firstStartedPulling="2026-06-02 19:03:19.324265093 +0000 UTC m=+3.299166608" lastFinishedPulling="2026-06-02 19:03:52.124971961 +0000 UTC m=+36.099873480" observedRunningTime="2026-06-02 19:03:54.726328003 +0000 UTC m=+38.701229541" watchObservedRunningTime="2026-06-02 19:03:54.726662433 +0000 UTC m=+38.701563974" Jun 02 19:03:55.158514 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.157489 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5361bc1f-484a-4b20-803a-02b1bd7aff31-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-gcb84\" (UID: \"5361bc1f-484a-4b20-803a-02b1bd7aff31\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gcb84" Jun 02 19:03:55.158514 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.157657 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/17a50869-5f95-4436-9eaf-c2ad111ccd76-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-l2lnk\" (UID: \"17a50869-5f95-4436-9eaf-c2ad111ccd76\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-l2lnk" Jun 02 19:03:55.158514 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:55.158002 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 19:03:55.158514 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:55.158063 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17a50869-5f95-4436-9eaf-c2ad111ccd76-cluster-monitoring-operator-tls podName:17a50869-5f95-4436-9eaf-c2ad111ccd76 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:57.158045609 +0000 UTC m=+41.132947129 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/17a50869-5f95-4436-9eaf-c2ad111ccd76-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-l2lnk" (UID: "17a50869-5f95-4436-9eaf-c2ad111ccd76") : secret "cluster-monitoring-operator-tls" not found Jun 02 19:03:55.158514 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:55.158432 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 19:03:55.158514 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:55.158492 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5361bc1f-484a-4b20-803a-02b1bd7aff31-samples-operator-tls podName:5361bc1f-484a-4b20-803a-02b1bd7aff31 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:57.158475591 +0000 UTC m=+41.133377110 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5361bc1f-484a-4b20-803a-02b1bd7aff31-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-gcb84" (UID: "5361bc1f-484a-4b20-803a-02b1bd7aff31") : secret "samples-operator-tls" not found Jun 02 19:03:55.258431 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.258391 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c590dacd-1369-4e42-b9ad-e6422b219426-metrics-certs\") pod \"router-default-6c96dcf58c-hn2d6\" (UID: \"c590dacd-1369-4e42-b9ad-e6422b219426\") " pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:03:55.258605 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.258449 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-registry-tls\") pod \"image-registry-7474894d9b-m2x4b\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:03:55.258605 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.258512 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c590dacd-1369-4e42-b9ad-e6422b219426-service-ca-bundle\") pod \"router-default-6c96dcf58c-hn2d6\" (UID: \"c590dacd-1369-4e42-b9ad-e6422b219426\") " pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:03:55.258809 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:55.258795 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c590dacd-1369-4e42-b9ad-e6422b219426-service-ca-bundle podName:c590dacd-1369-4e42-b9ad-e6422b219426 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:57.258758706 +0000 UTC m=+41.233660227 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c590dacd-1369-4e42-b9ad-e6422b219426-service-ca-bundle") pod "router-default-6c96dcf58c-hn2d6" (UID: "c590dacd-1369-4e42-b9ad-e6422b219426") : configmap references non-existent config key: service-ca.crt Jun 02 19:03:55.259221 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:55.259202 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 19:03:55.259300 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:55.259256 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c590dacd-1369-4e42-b9ad-e6422b219426-metrics-certs podName:c590dacd-1369-4e42-b9ad-e6422b219426 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:57.259241554 +0000 UTC m=+41.234143084 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c590dacd-1369-4e42-b9ad-e6422b219426-metrics-certs") pod "router-default-6c96dcf58c-hn2d6" (UID: "c590dacd-1369-4e42-b9ad-e6422b219426") : secret "router-metrics-certs-default" not found Jun 02 19:03:55.259385 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:55.259334 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 19:03:55.259385 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:55.259345 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7474894d9b-m2x4b: secret "image-registry-tls" not found Jun 02 19:03:55.259385 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:55.259375 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-registry-tls podName:3a1232c5-ec81-4d50-ae3b-6197805dd970 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:57.259364498 +0000 UTC m=+41.234266029 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-registry-tls") pod "image-registry-7474894d9b-m2x4b" (UID: "3a1232c5-ec81-4d50-ae3b-6197805dd970") : secret "image-registry-tls" not found Jun 02 19:03:55.360043 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.360008 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-registry-tls\") pod \"image-registry-6676c7c455-jc7gc\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:03:55.360208 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.360158 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c489102-a181-45b3-b63e-b54e3046b8cc-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-hfhgt\" (UID: \"0c489102-a181-45b3-b63e-b54e3046b8cc\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-hfhgt" Jun 02 19:03:55.360877 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:55.360302 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 19:03:55.360877 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:55.360376 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c489102-a181-45b3-b63e-b54e3046b8cc-networking-console-plugin-cert podName:0c489102-a181-45b3-b63e-b54e3046b8cc nodeName:}" failed. No retries permitted until 2026-06-02 19:03:57.360359841 +0000 UTC m=+41.335261363 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0c489102-a181-45b3-b63e-b54e3046b8cc-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-hfhgt" (UID: "0c489102-a181-45b3-b63e-b54e3046b8cc") : secret "networking-console-plugin-cert" not found Jun 02 19:03:55.360877 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:55.360743 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 19:03:55.360877 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:55.360757 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6676c7c455-jc7gc: secret "image-registry-tls" not found Jun 02 19:03:55.360877 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:55.360806 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-registry-tls podName:049e9671-1102-4305-b575-93b90999960a nodeName:}" failed. No retries permitted until 2026-06-02 19:03:57.360792659 +0000 UTC m=+41.335694179 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-registry-tls") pod "image-registry-6676c7c455-jc7gc" (UID: "049e9671-1102-4305-b575-93b90999960a") : secret "image-registry-tls" not found Jun 02 19:03:55.414902 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.414402 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c76fb8dc-dsqws"] Jun 02 19:03:55.441634 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.441566 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f77f48664-pvrgj"] Jun 02 19:03:55.442695 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.441782 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c76fb8dc-dsqws" Jun 02 19:03:55.448107 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.444767 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 02 19:03:55.448107 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.445034 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 02 19:03:55.448107 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.445227 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 02 19:03:55.448107 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.445517 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 02 19:03:55.458328 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.458261 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f77f48664-pvrgj"] Jun 02 19:03:55.458328 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.458291 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c76fb8dc-dsqws"] Jun 02 19:03:55.458328 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.458319 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh"] Jun 02 19:03:55.459977 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.458690 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f77f48664-pvrgj" Jun 02 19:03:55.461488 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.461465 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ba16f49-e177-4b3a-9559-f61b332d28f5-metrics-tls\") pod \"dns-default-l2w9x\" (UID: \"3ba16f49-e177-4b3a-9559-f61b332d28f5\") " pod="openshift-dns/dns-default-l2w9x" Jun 02 19:03:55.461594 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.461522 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 02 19:03:55.461594 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.461539 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0b95f6c-05eb-4df0-bd51-0c267429a4ed-cert\") pod \"ingress-canary-dxkps\" (UID: \"c0b95f6c-05eb-4df0-bd51-0c267429a4ed\") " pod="openshift-ingress-canary/ingress-canary-dxkps" Jun 02 19:03:55.461834 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:55.461762 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:03:55.461834 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.461816 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-64jjt\"" Jun 02 19:03:55.461834 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:55.461834 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0b95f6c-05eb-4df0-bd51-0c267429a4ed-cert podName:c0b95f6c-05eb-4df0-bd51-0c267429a4ed nodeName:}" failed. No retries permitted until 2026-06-02 19:03:57.461799968 +0000 UTC m=+41.436701507 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c0b95f6c-05eb-4df0-bd51-0c267429a4ed-cert") pod "ingress-canary-dxkps" (UID: "c0b95f6c-05eb-4df0-bd51-0c267429a4ed") : secret "canary-serving-cert" not found Jun 02 19:03:55.462384 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:55.462204 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:03:55.462384 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:55.462267 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ba16f49-e177-4b3a-9559-f61b332d28f5-metrics-tls podName:3ba16f49-e177-4b3a-9559-f61b332d28f5 nodeName:}" failed. No retries permitted until 2026-06-02 19:03:57.462251846 +0000 UTC m=+41.437153378 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ba16f49-e177-4b3a-9559-f61b332d28f5-metrics-tls") pod "dns-default-l2w9x" (UID: "3ba16f49-e177-4b3a-9559-f61b332d28f5") : secret "dns-default-metrics-tls" not found Jun 02 19:03:55.477164 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.476483 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh"] Jun 02 19:03:55.477164 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.476622 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" Jun 02 19:03:55.481416 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.479722 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 02 19:03:55.481416 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.479954 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 02 19:03:55.481416 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.480136 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 02 19:03:55.481416 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.480344 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 02 19:03:55.562492 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.562462 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/45ef74e5-2c02-4ba6-819d-54e3e1aba69b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f77f48664-pvrgj\" (UID: \"45ef74e5-2c02-4ba6-819d-54e3e1aba69b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f77f48664-pvrgj" Jun 02 19:03:55.562637 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.562511 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zl7q\" (UniqueName: \"kubernetes.io/projected/45ef74e5-2c02-4ba6-819d-54e3e1aba69b-kube-api-access-7zl7q\") pod \"managed-serviceaccount-addon-agent-6f77f48664-pvrgj\" (UID: \"45ef74e5-2c02-4ba6-819d-54e3e1aba69b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f77f48664-pvrgj" Jun 02 19:03:55.562700 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.562650 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb6ml\" (UniqueName: \"kubernetes.io/projected/cd156551-231b-4e47-94c0-fe3c6ce13166-kube-api-access-tb6ml\") pod \"klusterlet-addon-workmgr-57c76fb8dc-dsqws\" (UID: \"cd156551-231b-4e47-94c0-fe3c6ce13166\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c76fb8dc-dsqws" Jun 02 19:03:55.562750 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.562709 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/cd156551-231b-4e47-94c0-fe3c6ce13166-klusterlet-config\") pod \"klusterlet-addon-workmgr-57c76fb8dc-dsqws\" (UID: \"cd156551-231b-4e47-94c0-fe3c6ce13166\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c76fb8dc-dsqws" Jun 02 19:03:55.562808 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.562765 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd156551-231b-4e47-94c0-fe3c6ce13166-tmp\") pod \"klusterlet-addon-workmgr-57c76fb8dc-dsqws\" (UID: \"cd156551-231b-4e47-94c0-fe3c6ce13166\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c76fb8dc-dsqws" Jun 02 19:03:55.666170 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.663798 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tb6ml\" (UniqueName: \"kubernetes.io/projected/cd156551-231b-4e47-94c0-fe3c6ce13166-kube-api-access-tb6ml\") pod \"klusterlet-addon-workmgr-57c76fb8dc-dsqws\" (UID: \"cd156551-231b-4e47-94c0-fe3c6ce13166\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c76fb8dc-dsqws" Jun 02 19:03:55.666170 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.664036 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/ae25fd4c-42e3-4611-a270-3ce87e11feac-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-77db6c9b6d-vfvnh\" (UID: \"ae25fd4c-42e3-4611-a270-3ce87e11feac\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" Jun 02 19:03:55.666170 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.664102 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/cd156551-231b-4e47-94c0-fe3c6ce13166-klusterlet-config\") pod \"klusterlet-addon-workmgr-57c76fb8dc-dsqws\" (UID: \"cd156551-231b-4e47-94c0-fe3c6ce13166\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c76fb8dc-dsqws" Jun 02 19:03:55.666170 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.664162 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd156551-231b-4e47-94c0-fe3c6ce13166-tmp\") pod \"klusterlet-addon-workmgr-57c76fb8dc-dsqws\" (UID: \"cd156551-231b-4e47-94c0-fe3c6ce13166\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c76fb8dc-dsqws" Jun 02 19:03:55.666170 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.664203 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae25fd4c-42e3-4611-a270-3ce87e11feac-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77db6c9b6d-vfvnh\" (UID: \"ae25fd4c-42e3-4611-a270-3ce87e11feac\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" Jun 02 19:03:55.666170 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.664251 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/45ef74e5-2c02-4ba6-819d-54e3e1aba69b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f77f48664-pvrgj\" (UID: \"45ef74e5-2c02-4ba6-819d-54e3e1aba69b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f77f48664-pvrgj" Jun 02 19:03:55.666170 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.664283 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7zl7q\" (UniqueName: \"kubernetes.io/projected/45ef74e5-2c02-4ba6-819d-54e3e1aba69b-kube-api-access-7zl7q\") pod \"managed-serviceaccount-addon-agent-6f77f48664-pvrgj\" (UID: \"45ef74e5-2c02-4ba6-819d-54e3e1aba69b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f77f48664-pvrgj" Jun 02 19:03:55.666170 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.664340 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ae25fd4c-42e3-4611-a270-3ce87e11feac-ca\") pod \"cluster-proxy-proxy-agent-77db6c9b6d-vfvnh\" (UID: \"ae25fd4c-42e3-4611-a270-3ce87e11feac\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" Jun 02 19:03:55.666170 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.664405 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ae25fd4c-42e3-4611-a270-3ce87e11feac-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77db6c9b6d-vfvnh\" (UID: \"ae25fd4c-42e3-4611-a270-3ce87e11feac\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" Jun 02 19:03:55.666170 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.664435 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gwk7\" (UniqueName: \"kubernetes.io/projected/ae25fd4c-42e3-4611-a270-3ce87e11feac-kube-api-access-9gwk7\") pod \"cluster-proxy-proxy-agent-77db6c9b6d-vfvnh\" (UID: \"ae25fd4c-42e3-4611-a270-3ce87e11feac\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" Jun 02 19:03:55.666170 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.664520 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ae25fd4c-42e3-4611-a270-3ce87e11feac-hub\") pod \"cluster-proxy-proxy-agent-77db6c9b6d-vfvnh\" (UID: \"ae25fd4c-42e3-4611-a270-3ce87e11feac\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" Jun 02 19:03:55.666170 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.666021 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd156551-231b-4e47-94c0-fe3c6ce13166-tmp\") pod \"klusterlet-addon-workmgr-57c76fb8dc-dsqws\" (UID: \"cd156551-231b-4e47-94c0-fe3c6ce13166\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c76fb8dc-dsqws" Jun 02 19:03:55.670050 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.670004 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/cd156551-231b-4e47-94c0-fe3c6ce13166-klusterlet-config\") pod \"klusterlet-addon-workmgr-57c76fb8dc-dsqws\" (UID: \"cd156551-231b-4e47-94c0-fe3c6ce13166\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c76fb8dc-dsqws" Jun 02 19:03:55.671062 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.670921 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/45ef74e5-2c02-4ba6-819d-54e3e1aba69b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f77f48664-pvrgj\" (UID: \"45ef74e5-2c02-4ba6-819d-54e3e1aba69b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f77f48664-pvrgj" Jun 02 19:03:55.673616 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.673572 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zl7q\" (UniqueName: \"kubernetes.io/projected/45ef74e5-2c02-4ba6-819d-54e3e1aba69b-kube-api-access-7zl7q\") pod \"managed-serviceaccount-addon-agent-6f77f48664-pvrgj\" (UID: \"45ef74e5-2c02-4ba6-819d-54e3e1aba69b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f77f48664-pvrgj" Jun 02 19:03:55.675203 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.675162 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb6ml\" (UniqueName: \"kubernetes.io/projected/cd156551-231b-4e47-94c0-fe3c6ce13166-kube-api-access-tb6ml\") pod \"klusterlet-addon-workmgr-57c76fb8dc-dsqws\" (UID: \"cd156551-231b-4e47-94c0-fe3c6ce13166\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c76fb8dc-dsqws" Jun 02 19:03:55.756993 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.756944 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c76fb8dc-dsqws" Jun 02 19:03:55.767005 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.765165 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae25fd4c-42e3-4611-a270-3ce87e11feac-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77db6c9b6d-vfvnh\" (UID: \"ae25fd4c-42e3-4611-a270-3ce87e11feac\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" Jun 02 19:03:55.767005 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.765242 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ae25fd4c-42e3-4611-a270-3ce87e11feac-ca\") pod \"cluster-proxy-proxy-agent-77db6c9b6d-vfvnh\" (UID: \"ae25fd4c-42e3-4611-a270-3ce87e11feac\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" Jun 02 19:03:55.767005 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.765324 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ae25fd4c-42e3-4611-a270-3ce87e11feac-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77db6c9b6d-vfvnh\" (UID: \"ae25fd4c-42e3-4611-a270-3ce87e11feac\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" Jun 02 19:03:55.767005 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.765359 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9gwk7\" (UniqueName: \"kubernetes.io/projected/ae25fd4c-42e3-4611-a270-3ce87e11feac-kube-api-access-9gwk7\") pod \"cluster-proxy-proxy-agent-77db6c9b6d-vfvnh\" (UID: \"ae25fd4c-42e3-4611-a270-3ce87e11feac\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" Jun 02 19:03:55.767005 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.765438 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ae25fd4c-42e3-4611-a270-3ce87e11feac-hub\") pod \"cluster-proxy-proxy-agent-77db6c9b6d-vfvnh\" (UID: \"ae25fd4c-42e3-4611-a270-3ce87e11feac\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" Jun 02 19:03:55.767005 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.765480 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/ae25fd4c-42e3-4611-a270-3ce87e11feac-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-77db6c9b6d-vfvnh\" (UID: \"ae25fd4c-42e3-4611-a270-3ce87e11feac\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" Jun 02 19:03:55.767005 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.766254 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/ae25fd4c-42e3-4611-a270-3ce87e11feac-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-77db6c9b6d-vfvnh\" (UID: \"ae25fd4c-42e3-4611-a270-3ce87e11feac\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" Jun 02 19:03:55.771860 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.771796 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ae25fd4c-42e3-4611-a270-3ce87e11feac-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77db6c9b6d-vfvnh\" (UID: \"ae25fd4c-42e3-4611-a270-3ce87e11feac\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" Jun 02 19:03:55.773126 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.773069 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae25fd4c-42e3-4611-a270-3ce87e11feac-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77db6c9b6d-vfvnh\" (UID: \"ae25fd4c-42e3-4611-a270-3ce87e11feac\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" Jun 02 19:03:55.773294 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.773270 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ae25fd4c-42e3-4611-a270-3ce87e11feac-ca\") pod \"cluster-proxy-proxy-agent-77db6c9b6d-vfvnh\" (UID: \"ae25fd4c-42e3-4611-a270-3ce87e11feac\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" Jun 02 19:03:55.773483 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.773462 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ae25fd4c-42e3-4611-a270-3ce87e11feac-hub\") pod \"cluster-proxy-proxy-agent-77db6c9b6d-vfvnh\" (UID: \"ae25fd4c-42e3-4611-a270-3ce87e11feac\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" Jun 02 19:03:55.778373 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.778291 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f77f48664-pvrgj" Jun 02 19:03:55.778799 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.778733 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gwk7\" (UniqueName: \"kubernetes.io/projected/ae25fd4c-42e3-4611-a270-3ce87e11feac-kube-api-access-9gwk7\") pod \"cluster-proxy-proxy-agent-77db6c9b6d-vfvnh\" (UID: \"ae25fd4c-42e3-4611-a270-3ce87e11feac\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" Jun 02 19:03:55.789653 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:55.789301 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" Jun 02 19:03:57.178348 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:57.178276 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/17a50869-5f95-4436-9eaf-c2ad111ccd76-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-l2lnk\" (UID: \"17a50869-5f95-4436-9eaf-c2ad111ccd76\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-l2lnk" Jun 02 19:03:57.178978 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:57.178467 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 19:03:57.178978 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:57.178569 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 19:03:57.178978 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:57.178471 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5361bc1f-484a-4b20-803a-02b1bd7aff31-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-gcb84\" (UID: \"5361bc1f-484a-4b20-803a-02b1bd7aff31\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gcb84" Jun 02 19:03:57.178978 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:57.178614 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17a50869-5f95-4436-9eaf-c2ad111ccd76-cluster-monitoring-operator-tls podName:17a50869-5f95-4436-9eaf-c2ad111ccd76 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:01.178595491 +0000 UTC m=+45.153497020 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/17a50869-5f95-4436-9eaf-c2ad111ccd76-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-l2lnk" (UID: "17a50869-5f95-4436-9eaf-c2ad111ccd76") : secret "cluster-monitoring-operator-tls" not found Jun 02 19:03:57.178978 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:57.178706 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5361bc1f-484a-4b20-803a-02b1bd7aff31-samples-operator-tls podName:5361bc1f-484a-4b20-803a-02b1bd7aff31 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:01.178675969 +0000 UTC m=+45.153577495 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5361bc1f-484a-4b20-803a-02b1bd7aff31-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-gcb84" (UID: "5361bc1f-484a-4b20-803a-02b1bd7aff31") : secret "samples-operator-tls" not found Jun 02 19:03:57.280090 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:57.280054 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c590dacd-1369-4e42-b9ad-e6422b219426-metrics-certs\") pod \"router-default-6c96dcf58c-hn2d6\" (UID: \"c590dacd-1369-4e42-b9ad-e6422b219426\") " pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:03:57.280251 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:57.280109 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-registry-tls\") pod \"image-registry-7474894d9b-m2x4b\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:03:57.280251 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:57.280181 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c590dacd-1369-4e42-b9ad-e6422b219426-service-ca-bundle\") pod \"router-default-6c96dcf58c-hn2d6\" (UID: \"c590dacd-1369-4e42-b9ad-e6422b219426\") " pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:03:57.280251 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:57.280215 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 19:03:57.280496 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:57.280280 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c590dacd-1369-4e42-b9ad-e6422b219426-metrics-certs podName:c590dacd-1369-4e42-b9ad-e6422b219426 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:01.280263562 +0000 UTC m=+45.255165079 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c590dacd-1369-4e42-b9ad-e6422b219426-metrics-certs") pod "router-default-6c96dcf58c-hn2d6" (UID: "c590dacd-1369-4e42-b9ad-e6422b219426") : secret "router-metrics-certs-default" not found Jun 02 19:03:57.280496 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:57.280322 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 19:03:57.280496 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:57.280343 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7474894d9b-m2x4b: secret "image-registry-tls" not found Jun 02 19:03:57.280496 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:57.280410 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c590dacd-1369-4e42-b9ad-e6422b219426-service-ca-bundle podName:c590dacd-1369-4e42-b9ad-e6422b219426 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:01.280394393 +0000 UTC m=+45.255295918 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c590dacd-1369-4e42-b9ad-e6422b219426-service-ca-bundle") pod "router-default-6c96dcf58c-hn2d6" (UID: "c590dacd-1369-4e42-b9ad-e6422b219426") : configmap references non-existent config key: service-ca.crt Jun 02 19:03:57.280496 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:57.280439 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-registry-tls podName:3a1232c5-ec81-4d50-ae3b-6197805dd970 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:01.280423069 +0000 UTC m=+45.255324597 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-registry-tls") pod "image-registry-7474894d9b-m2x4b" (UID: "3a1232c5-ec81-4d50-ae3b-6197805dd970") : secret "image-registry-tls" not found Jun 02 19:03:57.381131 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:57.381103 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-registry-tls\") pod \"image-registry-6676c7c455-jc7gc\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:03:57.381293 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:57.381218 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c489102-a181-45b3-b63e-b54e3046b8cc-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-hfhgt\" (UID: \"0c489102-a181-45b3-b63e-b54e3046b8cc\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-hfhgt" Jun 02 19:03:57.381373 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:57.381294 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 19:03:57.381373 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:57.381330 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6676c7c455-jc7gc: secret "image-registry-tls" not found Jun 02 19:03:57.381373 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:57.381349 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 19:03:57.381519 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:57.381409 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-registry-tls podName:049e9671-1102-4305-b575-93b90999960a nodeName:}" failed. No retries permitted until 2026-06-02 19:04:01.381391214 +0000 UTC m=+45.356292754 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-registry-tls") pod "image-registry-6676c7c455-jc7gc" (UID: "049e9671-1102-4305-b575-93b90999960a") : secret "image-registry-tls" not found Jun 02 19:03:57.381519 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:57.381457 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c489102-a181-45b3-b63e-b54e3046b8cc-networking-console-plugin-cert podName:0c489102-a181-45b3-b63e-b54e3046b8cc nodeName:}" failed. No retries permitted until 2026-06-02 19:04:01.381423644 +0000 UTC m=+45.356325177 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0c489102-a181-45b3-b63e-b54e3046b8cc-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-hfhgt" (UID: "0c489102-a181-45b3-b63e-b54e3046b8cc") : secret "networking-console-plugin-cert" not found Jun 02 19:03:57.482083 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:57.481987 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ba16f49-e177-4b3a-9559-f61b332d28f5-metrics-tls\") pod \"dns-default-l2w9x\" (UID: \"3ba16f49-e177-4b3a-9559-f61b332d28f5\") " pod="openshift-dns/dns-default-l2w9x" Jun 02 19:03:57.482083 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:57.482041 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0b95f6c-05eb-4df0-bd51-0c267429a4ed-cert\") pod \"ingress-canary-dxkps\" (UID: \"c0b95f6c-05eb-4df0-bd51-0c267429a4ed\") " pod="openshift-ingress-canary/ingress-canary-dxkps" Jun 02 19:03:57.482295 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:57.482103 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:03:57.482295 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:57.482174 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ba16f49-e177-4b3a-9559-f61b332d28f5-metrics-tls podName:3ba16f49-e177-4b3a-9559-f61b332d28f5 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:01.482154313 +0000 UTC m=+45.457055828 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ba16f49-e177-4b3a-9559-f61b332d28f5-metrics-tls") pod "dns-default-l2w9x" (UID: "3ba16f49-e177-4b3a-9559-f61b332d28f5") : secret "dns-default-metrics-tls" not found Jun 02 19:03:57.482295 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:57.482203 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:03:57.482295 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:03:57.482266 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0b95f6c-05eb-4df0-bd51-0c267429a4ed-cert podName:c0b95f6c-05eb-4df0-bd51-0c267429a4ed nodeName:}" failed. No retries permitted until 2026-06-02 19:04:01.482252709 +0000 UTC m=+45.457154241 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c0b95f6c-05eb-4df0-bd51-0c267429a4ed-cert") pod "ingress-canary-dxkps" (UID: "c0b95f6c-05eb-4df0-bd51-0c267429a4ed") : secret "canary-serving-cert" not found Jun 02 19:03:58.080999 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:58.080962 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-8qx9x"] Jun 02 19:03:58.115851 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:58.115818 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8qx9x"] Jun 02 19:03:58.116020 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:58.115966 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qx9x" Jun 02 19:03:58.119470 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:58.119445 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 19:03:58.290043 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:58.290017 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2a72f625-c946-4a04-a6b4-6a37b15307e9-original-pull-secret\") pod \"global-pull-secret-syncer-8qx9x\" (UID: \"2a72f625-c946-4a04-a6b4-6a37b15307e9\") " pod="kube-system/global-pull-secret-syncer-8qx9x" Jun 02 19:03:58.290420 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:58.290077 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2a72f625-c946-4a04-a6b4-6a37b15307e9-kubelet-config\") pod \"global-pull-secret-syncer-8qx9x\" (UID: \"2a72f625-c946-4a04-a6b4-6a37b15307e9\") " pod="kube-system/global-pull-secret-syncer-8qx9x" Jun 02 19:03:58.290420 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:58.290150 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2a72f625-c946-4a04-a6b4-6a37b15307e9-dbus\") pod \"global-pull-secret-syncer-8qx9x\" (UID: \"2a72f625-c946-4a04-a6b4-6a37b15307e9\") " pod="kube-system/global-pull-secret-syncer-8qx9x" Jun 02 19:03:58.390632 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:58.390580 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2a72f625-c946-4a04-a6b4-6a37b15307e9-kubelet-config\") pod \"global-pull-secret-syncer-8qx9x\" (UID: \"2a72f625-c946-4a04-a6b4-6a37b15307e9\") " pod="kube-system/global-pull-secret-syncer-8qx9x" Jun 02 19:03:58.390718 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:58.390697 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2a72f625-c946-4a04-a6b4-6a37b15307e9-kubelet-config\") pod \"global-pull-secret-syncer-8qx9x\" (UID: \"2a72f625-c946-4a04-a6b4-6a37b15307e9\") " pod="kube-system/global-pull-secret-syncer-8qx9x" Jun 02 19:03:58.390752 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:58.390723 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2a72f625-c946-4a04-a6b4-6a37b15307e9-dbus\") pod \"global-pull-secret-syncer-8qx9x\" (UID: \"2a72f625-c946-4a04-a6b4-6a37b15307e9\") " pod="kube-system/global-pull-secret-syncer-8qx9x" Jun 02 19:03:58.390792 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:58.390782 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2a72f625-c946-4a04-a6b4-6a37b15307e9-original-pull-secret\") pod \"global-pull-secret-syncer-8qx9x\" (UID: \"2a72f625-c946-4a04-a6b4-6a37b15307e9\") " pod="kube-system/global-pull-secret-syncer-8qx9x" Jun 02 19:03:58.390937 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:58.390920 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2a72f625-c946-4a04-a6b4-6a37b15307e9-dbus\") pod \"global-pull-secret-syncer-8qx9x\" (UID: \"2a72f625-c946-4a04-a6b4-6a37b15307e9\") " pod="kube-system/global-pull-secret-syncer-8qx9x" Jun 02 19:03:58.392881 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:58.392859 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2a72f625-c946-4a04-a6b4-6a37b15307e9-original-pull-secret\") pod \"global-pull-secret-syncer-8qx9x\" (UID: \"2a72f625-c946-4a04-a6b4-6a37b15307e9\") " pod="kube-system/global-pull-secret-syncer-8qx9x" Jun 02 19:03:58.439359 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:03:58.439335 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qx9x" Jun 02 19:04:00.067329 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:00.067285 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh"] Jun 02 19:04:00.534950 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:04:00.534916 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae25fd4c_42e3_4611_a270_3ce87e11feac.slice/crio-05a4aba6bf92a3a115da0c6638370eeda45d1cd511a966888694a0f6fa87775a WatchSource:0}: Error finding container 05a4aba6bf92a3a115da0c6638370eeda45d1cd511a966888694a0f6fa87775a: Status 404 returned error can't find the container with id 05a4aba6bf92a3a115da0c6638370eeda45d1cd511a966888694a0f6fa87775a Jun 02 19:04:00.706431 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:00.706168 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c76fb8dc-dsqws"] Jun 02 19:04:00.713218 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:00.712905 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8qx9x"] Jun 02 19:04:00.717788 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:00.717514 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f77f48664-pvrgj"] Jun 02 19:04:00.718678 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:00.718515 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" event={"ID":"ae25fd4c-42e3-4611-a270-3ce87e11feac","Type":"ContainerStarted","Data":"05a4aba6bf92a3a115da0c6638370eeda45d1cd511a966888694a0f6fa87775a"} Jun 02 19:04:00.721436 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:00.721296 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-5hlnl" event={"ID":"06a683cd-e489-4964-9795-c06845389ce7","Type":"ContainerStarted","Data":"1fe408a235ee43e0c778c77a09e6fb10ffd1729b6579be670a25226f16135ec1"} Jun 02 19:04:00.722998 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:00.722970 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-lz4mf" event={"ID":"a7bebca5-7203-4903-8298-b2d03a8b8b31","Type":"ContainerStarted","Data":"cf57d5f78b4b6f71b9941306edf1f1d717ca54199684791c0b1f1cb2a7a89c17"} Jun 02 19:04:00.724230 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:00.724210 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tc247" event={"ID":"d89bfa95-df32-4295-a085-8f1e0388aa74","Type":"ContainerStarted","Data":"ecead357c8069feb4a2392d0d71f13be30d8bc5ecddbe43f1f8d3fafa30b1851"} Jun 02 19:04:00.739924 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:00.739696 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-5hlnl" podStartSLOduration=35.285344762 podStartE2EDuration="41.739677148s" podCreationTimestamp="2026-06-02 19:03:19 +0000 UTC" firstStartedPulling="2026-06-02 19:03:54.08458172 +0000 UTC m=+38.059483235" lastFinishedPulling="2026-06-02 19:04:00.538914107 +0000 UTC m=+44.513815621" observedRunningTime="2026-06-02 19:04:00.739102884 +0000 UTC m=+44.714004423" watchObservedRunningTime="2026-06-02 19:04:00.739677148 +0000 UTC m=+44.714578690" Jun 02 19:04:00.761103 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:00.761026 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-lz4mf" podStartSLOduration=35.28558752 podStartE2EDuration="41.761007186s" podCreationTimestamp="2026-06-02 19:03:19 +0000 UTC" firstStartedPulling="2026-06-02 19:03:54.060381933 +0000 UTC m=+38.035283463" lastFinishedPulling="2026-06-02 19:04:00.535801599 +0000 UTC m=+44.510703129" observedRunningTime="2026-06-02 19:04:00.760699131 +0000 UTC m=+44.735600706" watchObservedRunningTime="2026-06-02 19:04:00.761007186 +0000 UTC m=+44.735908725" Jun 02 19:04:00.785438 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:00.785299 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tc247" podStartSLOduration=35.23583476 podStartE2EDuration="41.785279855s" podCreationTimestamp="2026-06-02 19:03:19 +0000 UTC" firstStartedPulling="2026-06-02 19:03:53.984917553 +0000 UTC m=+37.959819069" lastFinishedPulling="2026-06-02 19:04:00.534362632 +0000 UTC m=+44.509264164" observedRunningTime="2026-06-02 19:04:00.785101131 +0000 UTC m=+44.760002669" watchObservedRunningTime="2026-06-02 19:04:00.785279855 +0000 UTC m=+44.760181408" Jun 02 19:04:01.213451 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:01.213223 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/17a50869-5f95-4436-9eaf-c2ad111ccd76-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-l2lnk\" (UID: \"17a50869-5f95-4436-9eaf-c2ad111ccd76\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-l2lnk" Jun 02 19:04:01.214048 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:01.213361 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 19:04:01.214048 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:01.213579 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17a50869-5f95-4436-9eaf-c2ad111ccd76-cluster-monitoring-operator-tls podName:17a50869-5f95-4436-9eaf-c2ad111ccd76 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:09.213560917 +0000 UTC m=+53.188462454 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/17a50869-5f95-4436-9eaf-c2ad111ccd76-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-l2lnk" (UID: "17a50869-5f95-4436-9eaf-c2ad111ccd76") : secret "cluster-monitoring-operator-tls" not found Jun 02 19:04:01.214048 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:01.213628 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5361bc1f-484a-4b20-803a-02b1bd7aff31-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-gcb84\" (UID: \"5361bc1f-484a-4b20-803a-02b1bd7aff31\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gcb84" Jun 02 19:04:01.214048 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:01.213777 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 19:04:01.214048 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:01.213830 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5361bc1f-484a-4b20-803a-02b1bd7aff31-samples-operator-tls podName:5361bc1f-484a-4b20-803a-02b1bd7aff31 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:09.213813505 +0000 UTC m=+53.188715031 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5361bc1f-484a-4b20-803a-02b1bd7aff31-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-gcb84" (UID: "5361bc1f-484a-4b20-803a-02b1bd7aff31") : secret "samples-operator-tls" not found Jun 02 19:04:01.314714 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:01.314687 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c590dacd-1369-4e42-b9ad-e6422b219426-service-ca-bundle\") pod \"router-default-6c96dcf58c-hn2d6\" (UID: \"c590dacd-1369-4e42-b9ad-e6422b219426\") " pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:04:01.314932 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:01.314800 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c590dacd-1369-4e42-b9ad-e6422b219426-metrics-certs\") pod \"router-default-6c96dcf58c-hn2d6\" (UID: \"c590dacd-1369-4e42-b9ad-e6422b219426\") " pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:04:01.314932 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:01.314820 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-registry-tls\") pod \"image-registry-7474894d9b-m2x4b\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:04:01.314932 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:01.314924 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 19:04:01.314932 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:01.314934 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7474894d9b-m2x4b: secret "image-registry-tls" not found Jun 02 19:04:01.315133 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:01.314972 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-registry-tls podName:3a1232c5-ec81-4d50-ae3b-6197805dd970 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:09.314960676 +0000 UTC m=+53.289862191 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-registry-tls") pod "image-registry-7474894d9b-m2x4b" (UID: "3a1232c5-ec81-4d50-ae3b-6197805dd970") : secret "image-registry-tls" not found Jun 02 19:04:01.315278 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:01.315258 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c590dacd-1369-4e42-b9ad-e6422b219426-service-ca-bundle podName:c590dacd-1369-4e42-b9ad-e6422b219426 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:09.31524557 +0000 UTC m=+53.290147085 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c590dacd-1369-4e42-b9ad-e6422b219426-service-ca-bundle") pod "router-default-6c96dcf58c-hn2d6" (UID: "c590dacd-1369-4e42-b9ad-e6422b219426") : configmap references non-existent config key: service-ca.crt Jun 02 19:04:01.315421 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:01.315292 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 19:04:01.315421 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:01.315373 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c590dacd-1369-4e42-b9ad-e6422b219426-metrics-certs podName:c590dacd-1369-4e42-b9ad-e6422b219426 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:09.315357319 +0000 UTC m=+53.290258847 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c590dacd-1369-4e42-b9ad-e6422b219426-metrics-certs") pod "router-default-6c96dcf58c-hn2d6" (UID: "c590dacd-1369-4e42-b9ad-e6422b219426") : secret "router-metrics-certs-default" not found Jun 02 19:04:01.415923 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:01.415892 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c489102-a181-45b3-b63e-b54e3046b8cc-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-hfhgt\" (UID: \"0c489102-a181-45b3-b63e-b54e3046b8cc\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-hfhgt" Jun 02 19:04:01.416104 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:01.416026 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-registry-tls\") pod \"image-registry-6676c7c455-jc7gc\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:04:01.416104 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:01.416050 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 19:04:01.416371 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:01.416123 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c489102-a181-45b3-b63e-b54e3046b8cc-networking-console-plugin-cert podName:0c489102-a181-45b3-b63e-b54e3046b8cc nodeName:}" failed. No retries permitted until 2026-06-02 19:04:09.416105682 +0000 UTC m=+53.391007203 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0c489102-a181-45b3-b63e-b54e3046b8cc-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-hfhgt" (UID: "0c489102-a181-45b3-b63e-b54e3046b8cc") : secret "networking-console-plugin-cert" not found Jun 02 19:04:01.416371 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:01.416158 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 19:04:01.416371 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:01.416173 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6676c7c455-jc7gc: secret "image-registry-tls" not found Jun 02 19:04:01.416371 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:01.416224 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-registry-tls podName:049e9671-1102-4305-b575-93b90999960a nodeName:}" failed. No retries permitted until 2026-06-02 19:04:09.416207838 +0000 UTC m=+53.391109367 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-registry-tls") pod "image-registry-6676c7c455-jc7gc" (UID: "049e9671-1102-4305-b575-93b90999960a") : secret "image-registry-tls" not found Jun 02 19:04:01.516739 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:01.516677 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ba16f49-e177-4b3a-9559-f61b332d28f5-metrics-tls\") pod \"dns-default-l2w9x\" (UID: \"3ba16f49-e177-4b3a-9559-f61b332d28f5\") " pod="openshift-dns/dns-default-l2w9x" Jun 02 19:04:01.516739 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:01.516722 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0b95f6c-05eb-4df0-bd51-0c267429a4ed-cert\") pod \"ingress-canary-dxkps\" (UID: \"c0b95f6c-05eb-4df0-bd51-0c267429a4ed\") " pod="openshift-ingress-canary/ingress-canary-dxkps" Jun 02 19:04:01.516945 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:01.516925 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:04:01.517050 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:01.516977 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0b95f6c-05eb-4df0-bd51-0c267429a4ed-cert podName:c0b95f6c-05eb-4df0-bd51-0c267429a4ed nodeName:}" failed. No retries permitted until 2026-06-02 19:04:09.516961899 +0000 UTC m=+53.491863418 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c0b95f6c-05eb-4df0-bd51-0c267429a4ed-cert") pod "ingress-canary-dxkps" (UID: "c0b95f6c-05eb-4df0-bd51-0c267429a4ed") : secret "canary-serving-cert" not found Jun 02 19:04:01.517301 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:01.517285 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:04:01.517400 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:01.517344 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ba16f49-e177-4b3a-9559-f61b332d28f5-metrics-tls podName:3ba16f49-e177-4b3a-9559-f61b332d28f5 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:09.517331525 +0000 UTC m=+53.492233046 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ba16f49-e177-4b3a-9559-f61b332d28f5-metrics-tls") pod "dns-default-l2w9x" (UID: "3ba16f49-e177-4b3a-9559-f61b332d28f5") : secret "dns-default-metrics-tls" not found Jun 02 19:04:01.739469 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:01.739245 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8qx9x" event={"ID":"2a72f625-c946-4a04-a6b4-6a37b15307e9","Type":"ContainerStarted","Data":"dfce34752f14dc8d958b9865e1833d525ff8a008e5539f6cfc9e5e036013d69f"} Jun 02 19:04:01.745781 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:01.742322 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c76fb8dc-dsqws" event={"ID":"cd156551-231b-4e47-94c0-fe3c6ce13166","Type":"ContainerStarted","Data":"36a81cfe01e750944e5840e7d7d5ab154dcc0b26779c2f5d6cdf72e629b24ecd"} Jun 02 19:04:01.747639 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:01.746524 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-kxcxc_7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3/console-operator/0.log" Jun 02 19:04:01.747639 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:01.746557 2557 generic.go:358] "Generic (PLEG): container finished" podID="7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3" containerID="17a3ed6d88226ec9dd4e15b96ff8eafae3c72f8d5bea05f246c5038c0c29f640" exitCode=255 Jun 02 19:04:01.747639 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:01.746616 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" event={"ID":"7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3","Type":"ContainerDied","Data":"17a3ed6d88226ec9dd4e15b96ff8eafae3c72f8d5bea05f246c5038c0c29f640"} Jun 02 19:04:01.747639 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:01.746946 2557 scope.go:117] "RemoveContainer" containerID="17a3ed6d88226ec9dd4e15b96ff8eafae3c72f8d5bea05f246c5038c0c29f640" Jun 02 19:04:01.757585 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:01.757561 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-qbblk" event={"ID":"6f1f23f4-811b-4aa3-8c26-8d0e018d202d","Type":"ContainerStarted","Data":"b924c174e4d02ea6183f58ffb37359c3b3e215904d8b77966f31a10f5ab3cdf1"} Jun 02 19:04:01.770905 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:01.770738 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2pkxz" event={"ID":"f6d92fd4-4328-46b7-b3e4-448c1b6bce14","Type":"ContainerStarted","Data":"f3180b7f6eb398ed9d3fcd46c2c7ae83b020b77ca0ca471123ac2f1116639351"} Jun 02 19:04:01.774246 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:01.773510 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f77f48664-pvrgj" event={"ID":"45ef74e5-2c02-4ba6-819d-54e3e1aba69b","Type":"ContainerStarted","Data":"bd89d71e6d95225066cb8f76d434c1000cafe86a47be4968a66aa5a3b33af52d"} Jun 02 19:04:01.879127 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:01.878728 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2pkxz" podStartSLOduration=36.261376624 podStartE2EDuration="42.878709399s" podCreationTimestamp="2026-06-02 19:03:19 +0000 UTC" firstStartedPulling="2026-06-02 19:03:53.921859515 +0000 UTC m=+37.896761050" lastFinishedPulling="2026-06-02 19:04:00.539192309 +0000 UTC m=+44.514093825" observedRunningTime="2026-06-02 19:04:01.827207248 +0000 UTC m=+45.802108787" watchObservedRunningTime="2026-06-02 19:04:01.878709399 +0000 UTC m=+45.853610938" Jun 02 19:04:01.879127 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:01.878826 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-qbblk" podStartSLOduration=36.363226111 podStartE2EDuration="42.878821357s" podCreationTimestamp="2026-06-02 19:03:19 +0000 UTC" firstStartedPulling="2026-06-02 19:03:54.023614839 +0000 UTC m=+37.998516357" lastFinishedPulling="2026-06-02 19:04:00.539210082 +0000 UTC m=+44.514111603" observedRunningTime="2026-06-02 19:04:01.876666135 +0000 UTC m=+45.851567673" watchObservedRunningTime="2026-06-02 19:04:01.878821357 +0000 UTC m=+45.853722898" Jun 02 19:04:02.786348 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:02.786237 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-kxcxc_7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3/console-operator/1.log" Jun 02 19:04:02.789159 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:02.787184 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-kxcxc_7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3/console-operator/0.log" Jun 02 19:04:02.789159 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:02.787218 2557 generic.go:358] "Generic (PLEG): container finished" podID="7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3" containerID="86c1f19e562a7e473d15e2aab35144b0f697e035ca07c5be09f122d7170b5e66" exitCode=255 Jun 02 19:04:02.789159 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:02.788036 2557 scope.go:117] "RemoveContainer" containerID="86c1f19e562a7e473d15e2aab35144b0f697e035ca07c5be09f122d7170b5e66" Jun 02 19:04:02.789159 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:02.788212 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-kxcxc_openshift-console-operator(7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" podUID="7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3" Jun 02 19:04:02.789159 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:02.788444 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" event={"ID":"7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3","Type":"ContainerDied","Data":"86c1f19e562a7e473d15e2aab35144b0f697e035ca07c5be09f122d7170b5e66"} Jun 02 19:04:02.789159 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:02.788480 2557 scope.go:117] "RemoveContainer" containerID="17a3ed6d88226ec9dd4e15b96ff8eafae3c72f8d5bea05f246c5038c0c29f640" Jun 02 19:04:03.432072 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:03.431723 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gr66k_712dc734-631f-4fc5-bfa4-7b036c53cad0/dns-node-resolver/0.log" Jun 02 19:04:03.632362 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:03.631084 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-wt4dt"] Jun 02 19:04:03.654295 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:03.654267 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-wt4dt"] Jun 02 19:04:03.654474 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:03.654412 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-wt4dt" Jun 02 19:04:03.657997 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:03.657250 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 02 19:04:03.657997 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:03.657549 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-vnmzz\"" Jun 02 19:04:03.658668 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:03.658512 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 02 19:04:03.757480 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:03.757209 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxmdh\" (UniqueName: \"kubernetes.io/projected/3fe9da6f-ec9b-4b52-b357-a7ba092cfc4c-kube-api-access-pxmdh\") pod \"migrator-96c6f749-wt4dt\" (UID: \"3fe9da6f-ec9b-4b52-b357-a7ba092cfc4c\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-wt4dt" Jun 02 19:04:03.792913 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:03.792886 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-kxcxc_7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3/console-operator/1.log" Jun 02 19:04:03.793350 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:03.793277 2557 scope.go:117] "RemoveContainer" containerID="86c1f19e562a7e473d15e2aab35144b0f697e035ca07c5be09f122d7170b5e66" Jun 02 19:04:03.793708 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:03.793495 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-kxcxc_openshift-console-operator(7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" podUID="7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3" Jun 02 19:04:03.858326 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:03.858247 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pxmdh\" (UniqueName: \"kubernetes.io/projected/3fe9da6f-ec9b-4b52-b357-a7ba092cfc4c-kube-api-access-pxmdh\") pod \"migrator-96c6f749-wt4dt\" (UID: \"3fe9da6f-ec9b-4b52-b357-a7ba092cfc4c\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-wt4dt" Jun 02 19:04:03.875328 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:03.875270 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxmdh\" (UniqueName: \"kubernetes.io/projected/3fe9da6f-ec9b-4b52-b357-a7ba092cfc4c-kube-api-access-pxmdh\") pod \"migrator-96c6f749-wt4dt\" (UID: \"3fe9da6f-ec9b-4b52-b357-a7ba092cfc4c\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-wt4dt" Jun 02 19:04:03.933487 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:03.933459 2557 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" Jun 02 19:04:03.933652 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:03.933517 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" Jun 02 19:04:03.975148 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:03.975120 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-wt4dt" Jun 02 19:04:04.027162 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:04.027079 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6ddrs_b0840a32-3528-4cef-aec6-d62b0f977e98/node-ca/0.log" Jun 02 19:04:04.167100 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:04.167065 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-zbmxl"] Jun 02 19:04:04.184896 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:04.184870 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-zbmxl"] Jun 02 19:04:04.185039 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:04.185000 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-zbmxl" Jun 02 19:04:04.188333 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:04.188294 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 02 19:04:04.188333 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:04.188303 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 02 19:04:04.188504 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:04.188402 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 02 19:04:04.188627 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:04.188611 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 02 19:04:04.189515 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:04.189494 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-4h5dl\"" Jun 02 19:04:04.262403 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:04.262368 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2ad915ae-dc50-4713-b23b-137bcde3e2bf-signing-cabundle\") pod \"service-ca-685df94d57-zbmxl\" (UID: \"2ad915ae-dc50-4713-b23b-137bcde3e2bf\") " pod="openshift-service-ca/service-ca-685df94d57-zbmxl" Jun 02 19:04:04.262538 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:04.262434 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2ad915ae-dc50-4713-b23b-137bcde3e2bf-signing-key\") pod \"service-ca-685df94d57-zbmxl\" (UID: \"2ad915ae-dc50-4713-b23b-137bcde3e2bf\") " pod="openshift-service-ca/service-ca-685df94d57-zbmxl" Jun 02 19:04:04.262538 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:04.262454 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59qz7\" (UniqueName: \"kubernetes.io/projected/2ad915ae-dc50-4713-b23b-137bcde3e2bf-kube-api-access-59qz7\") pod \"service-ca-685df94d57-zbmxl\" (UID: \"2ad915ae-dc50-4713-b23b-137bcde3e2bf\") " pod="openshift-service-ca/service-ca-685df94d57-zbmxl" Jun 02 19:04:04.364076 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:04.364043 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2ad915ae-dc50-4713-b23b-137bcde3e2bf-signing-cabundle\") pod \"service-ca-685df94d57-zbmxl\" (UID: \"2ad915ae-dc50-4713-b23b-137bcde3e2bf\") " pod="openshift-service-ca/service-ca-685df94d57-zbmxl" Jun 02 19:04:04.364247 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:04.364109 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2ad915ae-dc50-4713-b23b-137bcde3e2bf-signing-key\") pod \"service-ca-685df94d57-zbmxl\" (UID: \"2ad915ae-dc50-4713-b23b-137bcde3e2bf\") " pod="openshift-service-ca/service-ca-685df94d57-zbmxl" Jun 02 19:04:04.364247 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:04.364134 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-59qz7\" (UniqueName: \"kubernetes.io/projected/2ad915ae-dc50-4713-b23b-137bcde3e2bf-kube-api-access-59qz7\") pod \"service-ca-685df94d57-zbmxl\" (UID: \"2ad915ae-dc50-4713-b23b-137bcde3e2bf\") " pod="openshift-service-ca/service-ca-685df94d57-zbmxl" Jun 02 19:04:04.364845 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:04.364824 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2ad915ae-dc50-4713-b23b-137bcde3e2bf-signing-cabundle\") pod \"service-ca-685df94d57-zbmxl\" (UID: \"2ad915ae-dc50-4713-b23b-137bcde3e2bf\") " pod="openshift-service-ca/service-ca-685df94d57-zbmxl" Jun 02 19:04:04.367011 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:04.366967 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2ad915ae-dc50-4713-b23b-137bcde3e2bf-signing-key\") pod \"service-ca-685df94d57-zbmxl\" (UID: \"2ad915ae-dc50-4713-b23b-137bcde3e2bf\") " pod="openshift-service-ca/service-ca-685df94d57-zbmxl" Jun 02 19:04:04.374902 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:04.373979 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59qz7\" (UniqueName: \"kubernetes.io/projected/2ad915ae-dc50-4713-b23b-137bcde3e2bf-kube-api-access-59qz7\") pod \"service-ca-685df94d57-zbmxl\" (UID: \"2ad915ae-dc50-4713-b23b-137bcde3e2bf\") " pod="openshift-service-ca/service-ca-685df94d57-zbmxl" Jun 02 19:04:04.497398 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:04.497364 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-zbmxl" Jun 02 19:04:04.796573 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:04.796471 2557 scope.go:117] "RemoveContainer" containerID="86c1f19e562a7e473d15e2aab35144b0f697e035ca07c5be09f122d7170b5e66" Jun 02 19:04:04.796989 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:04.796678 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-kxcxc_openshift-console-operator(7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" podUID="7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3" Jun 02 19:04:05.798997 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:05.798969 2557 scope.go:117] "RemoveContainer" containerID="86c1f19e562a7e473d15e2aab35144b0f697e035ca07c5be09f122d7170b5e66" Jun 02 19:04:05.799447 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:05.799195 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-kxcxc_openshift-console-operator(7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" podUID="7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3" Jun 02 19:04:09.311589 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:09.311553 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/17a50869-5f95-4436-9eaf-c2ad111ccd76-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-l2lnk\" (UID: \"17a50869-5f95-4436-9eaf-c2ad111ccd76\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-l2lnk" Jun 02 19:04:09.311988 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:09.311710 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5361bc1f-484a-4b20-803a-02b1bd7aff31-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-gcb84\" (UID: \"5361bc1f-484a-4b20-803a-02b1bd7aff31\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gcb84" Jun 02 19:04:09.311988 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:09.311714 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 19:04:09.311988 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:09.311792 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17a50869-5f95-4436-9eaf-c2ad111ccd76-cluster-monitoring-operator-tls podName:17a50869-5f95-4436-9eaf-c2ad111ccd76 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:25.311768908 +0000 UTC m=+69.286670427 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/17a50869-5f95-4436-9eaf-c2ad111ccd76-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-l2lnk" (UID: "17a50869-5f95-4436-9eaf-c2ad111ccd76") : secret "cluster-monitoring-operator-tls" not found Jun 02 19:04:09.311988 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:09.311847 2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 19:04:09.311988 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:09.311900 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5361bc1f-484a-4b20-803a-02b1bd7aff31-samples-operator-tls podName:5361bc1f-484a-4b20-803a-02b1bd7aff31 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:25.311887107 +0000 UTC m=+69.286788628 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5361bc1f-484a-4b20-803a-02b1bd7aff31-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-gcb84" (UID: "5361bc1f-484a-4b20-803a-02b1bd7aff31") : secret "samples-operator-tls" not found Jun 02 19:04:09.412475 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:09.412446 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c590dacd-1369-4e42-b9ad-e6422b219426-metrics-certs\") pod \"router-default-6c96dcf58c-hn2d6\" (UID: \"c590dacd-1369-4e42-b9ad-e6422b219426\") " pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:04:09.412475 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:09.412481 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-registry-tls\") pod \"image-registry-7474894d9b-m2x4b\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:04:09.412691 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:09.412536 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c590dacd-1369-4e42-b9ad-e6422b219426-service-ca-bundle\") pod \"router-default-6c96dcf58c-hn2d6\" (UID: \"c590dacd-1369-4e42-b9ad-e6422b219426\") " pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:04:09.412691 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:09.412594 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 19:04:09.412691 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:09.412661 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c590dacd-1369-4e42-b9ad-e6422b219426-metrics-certs podName:c590dacd-1369-4e42-b9ad-e6422b219426 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:25.41264397 +0000 UTC m=+69.387545488 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c590dacd-1369-4e42-b9ad-e6422b219426-metrics-certs") pod "router-default-6c96dcf58c-hn2d6" (UID: "c590dacd-1369-4e42-b9ad-e6422b219426") : secret "router-metrics-certs-default" not found Jun 02 19:04:09.412691 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:09.412676 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 19:04:09.412875 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:09.412698 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7474894d9b-m2x4b: secret "image-registry-tls" not found Jun 02 19:04:09.412875 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:09.412716 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c590dacd-1369-4e42-b9ad-e6422b219426-service-ca-bundle podName:c590dacd-1369-4e42-b9ad-e6422b219426 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:25.412705094 +0000 UTC m=+69.387606610 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c590dacd-1369-4e42-b9ad-e6422b219426-service-ca-bundle") pod "router-default-6c96dcf58c-hn2d6" (UID: "c590dacd-1369-4e42-b9ad-e6422b219426") : configmap references non-existent config key: service-ca.crt Jun 02 19:04:09.412875 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:09.412755 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-registry-tls podName:3a1232c5-ec81-4d50-ae3b-6197805dd970 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:25.412738434 +0000 UTC m=+69.387639962 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-registry-tls") pod "image-registry-7474894d9b-m2x4b" (UID: "3a1232c5-ec81-4d50-ae3b-6197805dd970") : secret "image-registry-tls" not found Jun 02 19:04:09.513511 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:09.513473 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c489102-a181-45b3-b63e-b54e3046b8cc-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-hfhgt\" (UID: \"0c489102-a181-45b3-b63e-b54e3046b8cc\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-hfhgt" Jun 02 19:04:09.513682 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:09.513622 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-registry-tls\") pod \"image-registry-6676c7c455-jc7gc\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:04:09.513682 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:09.513629 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 19:04:09.513805 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:09.513696 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c489102-a181-45b3-b63e-b54e3046b8cc-networking-console-plugin-cert podName:0c489102-a181-45b3-b63e-b54e3046b8cc nodeName:}" failed. No retries permitted until 2026-06-02 19:04:25.513677301 +0000 UTC m=+69.488578831 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0c489102-a181-45b3-b63e-b54e3046b8cc-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-hfhgt" (UID: "0c489102-a181-45b3-b63e-b54e3046b8cc") : secret "networking-console-plugin-cert" not found Jun 02 19:04:09.513805 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:09.513742 2557 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 19:04:09.513805 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:09.513757 2557 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6676c7c455-jc7gc: secret "image-registry-tls" not found Jun 02 19:04:09.514002 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:09.513809 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-registry-tls podName:049e9671-1102-4305-b575-93b90999960a nodeName:}" failed. No retries permitted until 2026-06-02 19:04:25.513794118 +0000 UTC m=+69.488695641 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-registry-tls") pod "image-registry-6676c7c455-jc7gc" (UID: "049e9671-1102-4305-b575-93b90999960a") : secret "image-registry-tls" not found Jun 02 19:04:09.614464 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:09.614427 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0b95f6c-05eb-4df0-bd51-0c267429a4ed-cert\") pod \"ingress-canary-dxkps\" (UID: \"c0b95f6c-05eb-4df0-bd51-0c267429a4ed\") " pod="openshift-ingress-canary/ingress-canary-dxkps" Jun 02 19:04:09.614641 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:09.614592 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 19:04:09.614703 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:09.614640 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ba16f49-e177-4b3a-9559-f61b332d28f5-metrics-tls\") pod \"dns-default-l2w9x\" (UID: \"3ba16f49-e177-4b3a-9559-f61b332d28f5\") " pod="openshift-dns/dns-default-l2w9x" Jun 02 19:04:09.614703 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:09.614667 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0b95f6c-05eb-4df0-bd51-0c267429a4ed-cert podName:c0b95f6c-05eb-4df0-bd51-0c267429a4ed nodeName:}" failed. No retries permitted until 2026-06-02 19:04:25.614649249 +0000 UTC m=+69.589550778 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c0b95f6c-05eb-4df0-bd51-0c267429a4ed-cert") pod "ingress-canary-dxkps" (UID: "c0b95f6c-05eb-4df0-bd51-0c267429a4ed") : secret "canary-serving-cert" not found Jun 02 19:04:09.614818 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:09.614721 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 19:04:09.614818 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:09.614770 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ba16f49-e177-4b3a-9559-f61b332d28f5-metrics-tls podName:3ba16f49-e177-4b3a-9559-f61b332d28f5 nodeName:}" failed. No retries permitted until 2026-06-02 19:04:25.614754336 +0000 UTC m=+69.589655866 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ba16f49-e177-4b3a-9559-f61b332d28f5-metrics-tls") pod "dns-default-l2w9x" (UID: "3ba16f49-e177-4b3a-9559-f61b332d28f5") : secret "dns-default-metrics-tls" not found Jun 02 19:04:09.933599 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:09.933572 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-wt4dt"] Jun 02 19:04:09.944137 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:09.944010 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-zbmxl"] Jun 02 19:04:10.090719 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:04:10.090688 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fe9da6f_ec9b_4b52_b357_a7ba092cfc4c.slice/crio-6cc59b1e816ed07d1c87b832fa395c75afcfc9bd5b08bcb9886619bd4edb9fc4 WatchSource:0}: Error finding container 6cc59b1e816ed07d1c87b832fa395c75afcfc9bd5b08bcb9886619bd4edb9fc4: Status 404 returned error can't find the container with id 6cc59b1e816ed07d1c87b832fa395c75afcfc9bd5b08bcb9886619bd4edb9fc4 Jun 02 19:04:10.091259 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:04:10.091239 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ad915ae_dc50_4713_b23b_137bcde3e2bf.slice/crio-9ddf5f9a19e8a1b4ae63984975ad511df7d17d97f4a5f7fc2858b4b1f31654d6 WatchSource:0}: Error finding container 9ddf5f9a19e8a1b4ae63984975ad511df7d17d97f4a5f7fc2858b4b1f31654d6: Status 404 returned error can't find the container with id 9ddf5f9a19e8a1b4ae63984975ad511df7d17d97f4a5f7fc2858b4b1f31654d6 Jun 02 19:04:10.815268 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:10.815231 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" event={"ID":"ae25fd4c-42e3-4611-a270-3ce87e11feac","Type":"ContainerStarted","Data":"5a587192f8225d49b9830e4713c9f15ab03e82a1de91a44808f8cc5af2b504fc"} Jun 02 19:04:10.816541 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:10.816520 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f77f48664-pvrgj" event={"ID":"45ef74e5-2c02-4ba6-819d-54e3e1aba69b","Type":"ContainerStarted","Data":"6fa6a186c947de623d7cf71a2ec8dbb796a0700048e7aec7017ea7cc0292943d"} Jun 02 19:04:10.817887 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:10.817862 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8qx9x" event={"ID":"2a72f625-c946-4a04-a6b4-6a37b15307e9","Type":"ContainerStarted","Data":"8a0675417427184af026a54b46963c3ce4f347081ed0979ae725f63e1655492c"} Jun 02 19:04:10.819231 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:10.819203 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c76fb8dc-dsqws" event={"ID":"cd156551-231b-4e47-94c0-fe3c6ce13166","Type":"ContainerStarted","Data":"ac71656dcb23c099e60c39550ca270f04c3c5091b688d6c089b501c6bac90f78"} Jun 02 19:04:10.819455 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:10.819438 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c76fb8dc-dsqws" Jun 02 19:04:10.821086 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:10.821054 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-wt4dt" event={"ID":"3fe9da6f-ec9b-4b52-b357-a7ba092cfc4c","Type":"ContainerStarted","Data":"6cc59b1e816ed07d1c87b832fa395c75afcfc9bd5b08bcb9886619bd4edb9fc4"} Jun 02 19:04:10.823954 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:10.823933 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c76fb8dc-dsqws" Jun 02 19:04:10.824671 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:10.824650 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-zbmxl" event={"ID":"2ad915ae-dc50-4713-b23b-137bcde3e2bf","Type":"ContainerStarted","Data":"992c508924cea851ef953654fe7fb27562de4121f1f88aaa0487b9a71a092f1a"} Jun 02 19:04:10.824780 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:10.824677 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-zbmxl" event={"ID":"2ad915ae-dc50-4713-b23b-137bcde3e2bf","Type":"ContainerStarted","Data":"9ddf5f9a19e8a1b4ae63984975ad511df7d17d97f4a5f7fc2858b4b1f31654d6"} Jun 02 19:04:10.866209 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:10.866165 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f77f48664-pvrgj" podStartSLOduration=8.353363665 podStartE2EDuration="15.866150944s" podCreationTimestamp="2026-06-02 19:03:55 +0000 UTC" firstStartedPulling="2026-06-02 19:04:00.825732511 +0000 UTC m=+44.800634030" lastFinishedPulling="2026-06-02 19:04:08.338519794 +0000 UTC m=+52.313421309" observedRunningTime="2026-06-02 19:04:10.865722404 +0000 UTC m=+54.840623926" watchObservedRunningTime="2026-06-02 19:04:10.866150944 +0000 UTC m=+54.841052479" Jun 02 19:04:10.907410 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:10.907371 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-zbmxl" podStartSLOduration=6.907358923 podStartE2EDuration="6.907358923s" podCreationTimestamp="2026-06-02 19:04:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:04:10.906477445 +0000 UTC m=+54.881378983" watchObservedRunningTime="2026-06-02 19:04:10.907358923 +0000 UTC m=+54.882260489" Jun 02 19:04:10.923288 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:10.923243 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8qx9x" podStartSLOduration=3.617885985 podStartE2EDuration="12.923229495s" podCreationTimestamp="2026-06-02 19:03:58 +0000 UTC" firstStartedPulling="2026-06-02 19:04:00.825976753 +0000 UTC m=+44.800878275" lastFinishedPulling="2026-06-02 19:04:10.131320271 +0000 UTC m=+54.106221785" observedRunningTime="2026-06-02 19:04:10.922787642 +0000 UTC m=+54.897689180" watchObservedRunningTime="2026-06-02 19:04:10.923229495 +0000 UTC m=+54.898131034" Jun 02 19:04:10.941527 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:10.941489 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57c76fb8dc-dsqws" podStartSLOduration=6.978327895 podStartE2EDuration="15.941480545s" podCreationTimestamp="2026-06-02 19:03:55 +0000 UTC" firstStartedPulling="2026-06-02 19:04:00.825390933 +0000 UTC m=+44.800292456" lastFinishedPulling="2026-06-02 19:04:09.788543572 +0000 UTC m=+53.763445106" observedRunningTime="2026-06-02 19:04:10.941208413 +0000 UTC m=+54.916109950" watchObservedRunningTime="2026-06-02 19:04:10.941480545 +0000 UTC m=+54.916382081" Jun 02 19:04:12.834381 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:12.834343 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-wt4dt" event={"ID":"3fe9da6f-ec9b-4b52-b357-a7ba092cfc4c","Type":"ContainerStarted","Data":"ce5a680bc9715d14a472ea594e728b061103c731702a0231c0356b5cfa1b2f1b"} Jun 02 19:04:12.834776 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:12.834387 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-wt4dt" event={"ID":"3fe9da6f-ec9b-4b52-b357-a7ba092cfc4c","Type":"ContainerStarted","Data":"3098ee8cc4fecf200f21721f73cb125bd5a8fa3df1eebd097a9fc7922f9f0a69"} Jun 02 19:04:12.836089 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:12.836066 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" event={"ID":"ae25fd4c-42e3-4611-a270-3ce87e11feac","Type":"ContainerStarted","Data":"d482a21bcf783dbb0ef043b56f0d699ae4a24d1b9253cac0f5f8f44b68098430"} Jun 02 19:04:12.836195 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:12.836096 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" event={"ID":"ae25fd4c-42e3-4611-a270-3ce87e11feac","Type":"ContainerStarted","Data":"850af183fe1e863c73a286257f415355d2e6741eca0f3b22365fbe67784110d1"} Jun 02 19:04:12.853564 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:12.853522 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-wt4dt" podStartSLOduration=7.337179271 podStartE2EDuration="9.853509622s" podCreationTimestamp="2026-06-02 19:04:03 +0000 UTC" firstStartedPulling="2026-06-02 19:04:10.119731934 +0000 UTC m=+54.094633449" lastFinishedPulling="2026-06-02 19:04:12.636062274 +0000 UTC m=+56.610963800" observedRunningTime="2026-06-02 19:04:12.853223366 +0000 UTC m=+56.828124900" watchObservedRunningTime="2026-06-02 19:04:12.853509622 +0000 UTC m=+56.828411164" Jun 02 19:04:12.873817 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:12.873779 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" podStartSLOduration=5.772336585 podStartE2EDuration="17.873768546s" podCreationTimestamp="2026-06-02 19:03:55 +0000 UTC" firstStartedPulling="2026-06-02 19:04:00.537997053 +0000 UTC m=+44.512898570" lastFinishedPulling="2026-06-02 19:04:12.639429013 +0000 UTC m=+56.614330531" observedRunningTime="2026-06-02 19:04:12.872699378 +0000 UTC m=+56.847600915" watchObservedRunningTime="2026-06-02 19:04:12.873768546 +0000 UTC m=+56.848670099" Jun 02 19:04:15.792250 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:15.792204 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" podUID="ae25fd4c-42e3-4611-a270-3ce87e11feac" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 19:04:16.551387 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:16.551355 2557 scope.go:117] "RemoveContainer" containerID="86c1f19e562a7e473d15e2aab35144b0f697e035ca07c5be09f122d7170b5e66" Jun 02 19:04:16.847413 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:16.847391 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-kxcxc_7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3/console-operator/2.log" Jun 02 19:04:16.847772 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:16.847758 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-kxcxc_7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3/console-operator/1.log" Jun 02 19:04:16.847810 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:16.847789 2557 generic.go:358] "Generic (PLEG): container finished" podID="7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3" containerID="6bff5152bcfc00052bcfc4407bfcf02a17782f14cdd2c2dac2b011ad3de5673f" exitCode=255 Jun 02 19:04:16.847844 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:16.847835 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" event={"ID":"7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3","Type":"ContainerDied","Data":"6bff5152bcfc00052bcfc4407bfcf02a17782f14cdd2c2dac2b011ad3de5673f"} Jun 02 19:04:16.847881 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:16.847865 2557 scope.go:117] "RemoveContainer" containerID="86c1f19e562a7e473d15e2aab35144b0f697e035ca07c5be09f122d7170b5e66" Jun 02 19:04:16.848117 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:16.848098 2557 scope.go:117] "RemoveContainer" containerID="6bff5152bcfc00052bcfc4407bfcf02a17782f14cdd2c2dac2b011ad3de5673f" Jun 02 19:04:16.848292 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:16.848272 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-kxcxc_openshift-console-operator(7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" podUID="7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3" Jun 02 19:04:17.851881 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:17.851854 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-kxcxc_7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3/console-operator/2.log" Jun 02 19:04:18.688138 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:18.688108 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hstll" Jun 02 19:04:22.229167 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:22.229136 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c06cfb25-324b-408a-a07f-63de6128d0f3-metrics-certs\") pod \"network-metrics-daemon-rtm24\" (UID: \"c06cfb25-324b-408a-a07f-63de6128d0f3\") " pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:04:22.231994 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:22.231978 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 19:04:22.242507 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:22.242487 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c06cfb25-324b-408a-a07f-63de6128d0f3-metrics-certs\") pod \"network-metrics-daemon-rtm24\" (UID: \"c06cfb25-324b-408a-a07f-63de6128d0f3\") " pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:04:22.330114 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:22.330088 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2sczk\" (UniqueName: \"kubernetes.io/projected/4d905ff7-fad0-4198-a83a-4256a1106d7d-kube-api-access-2sczk\") pod \"network-check-target-pzkk4\" (UID: \"4d905ff7-fad0-4198-a83a-4256a1106d7d\") " pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:04:22.332404 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:22.332377 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sczk\" (UniqueName: \"kubernetes.io/projected/4d905ff7-fad0-4198-a83a-4256a1106d7d-kube-api-access-2sczk\") pod \"network-check-target-pzkk4\" (UID: \"4d905ff7-fad0-4198-a83a-4256a1106d7d\") " pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:04:22.465541 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:22.465520 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dks2v\"" Jun 02 19:04:22.471830 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:22.471813 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mp95k\"" Jun 02 19:04:22.473834 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:22.473821 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rtm24" Jun 02 19:04:22.479908 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:22.479838 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:04:22.633212 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:22.633184 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rtm24"] Jun 02 19:04:22.635808 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:04:22.635779 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc06cfb25_324b_408a_a07f_63de6128d0f3.slice/crio-b6fefcd7cc45fd51dc2fc639c21584bb8ba5756dd6c47b189b4eb992f65508f1 WatchSource:0}: Error finding container b6fefcd7cc45fd51dc2fc639c21584bb8ba5756dd6c47b189b4eb992f65508f1: Status 404 returned error can't find the container with id b6fefcd7cc45fd51dc2fc639c21584bb8ba5756dd6c47b189b4eb992f65508f1 Jun 02 19:04:22.645416 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:22.645393 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pzkk4"] Jun 02 19:04:22.648026 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:04:22.647986 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d905ff7_fad0_4198_a83a_4256a1106d7d.slice/crio-bcfb6370894dcba37ca271b26ebbf75ee46c2018d49c8cc43893d8d0b6b2248f WatchSource:0}: Error finding container bcfb6370894dcba37ca271b26ebbf75ee46c2018d49c8cc43893d8d0b6b2248f: Status 404 returned error can't find the container with id bcfb6370894dcba37ca271b26ebbf75ee46c2018d49c8cc43893d8d0b6b2248f Jun 02 19:04:22.864349 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:22.864318 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pzkk4" event={"ID":"4d905ff7-fad0-4198-a83a-4256a1106d7d","Type":"ContainerStarted","Data":"4b04c05fb7ac40475a6dce84e21607ddfe8e330b7e38ddd12355ee98c59bb658"} Jun 02 19:04:22.864349 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:22.864349 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pzkk4" event={"ID":"4d905ff7-fad0-4198-a83a-4256a1106d7d","Type":"ContainerStarted","Data":"bcfb6370894dcba37ca271b26ebbf75ee46c2018d49c8cc43893d8d0b6b2248f"} Jun 02 19:04:22.864518 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:22.864378 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:04:22.865335 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:22.865301 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rtm24" event={"ID":"c06cfb25-324b-408a-a07f-63de6128d0f3","Type":"ContainerStarted","Data":"b6fefcd7cc45fd51dc2fc639c21584bb8ba5756dd6c47b189b4eb992f65508f1"} Jun 02 19:04:22.885880 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:22.885839 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pzkk4" podStartSLOduration=66.885825475 podStartE2EDuration="1m6.885825475s" podCreationTimestamp="2026-06-02 19:03:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:04:22.884215157 +0000 UTC m=+66.859116693" watchObservedRunningTime="2026-06-02 19:04:22.885825475 +0000 UTC m=+66.860727012" Jun 02 19:04:23.933217 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:23.933184 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" Jun 02 19:04:23.933217 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:23.933216 2557 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" Jun 02 19:04:23.933757 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:23.933630 2557 scope.go:117] "RemoveContainer" containerID="6bff5152bcfc00052bcfc4407bfcf02a17782f14cdd2c2dac2b011ad3de5673f" Jun 02 19:04:23.933907 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:23.933839 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-kxcxc_openshift-console-operator(7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" podUID="7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3" Jun 02 19:04:24.871838 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:24.871808 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rtm24" event={"ID":"c06cfb25-324b-408a-a07f-63de6128d0f3","Type":"ContainerStarted","Data":"2a0a0b94f09d9cd41ab171d5cf9dd98546150c0b742e3801f3c6a78bba6ee885"} Jun 02 19:04:24.871838 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:24.871839 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rtm24" event={"ID":"c06cfb25-324b-408a-a07f-63de6128d0f3","Type":"ContainerStarted","Data":"08dff8870c53e8d9eaaec4e35c45e821eef0621673e730033273e9660655b373"} Jun 02 19:04:24.888476 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:24.888435 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rtm24" podStartSLOduration=67.25561806 podStartE2EDuration="1m8.888422108s" podCreationTimestamp="2026-06-02 19:03:16 +0000 UTC" firstStartedPulling="2026-06-02 19:04:22.637658745 +0000 UTC m=+66.612560260" lastFinishedPulling="2026-06-02 19:04:24.270462782 +0000 UTC m=+68.245364308" observedRunningTime="2026-06-02 19:04:24.886953203 +0000 UTC m=+68.861854747" watchObservedRunningTime="2026-06-02 19:04:24.888422108 +0000 UTC m=+68.863323644" Jun 02 19:04:25.358297 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.358265 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5361bc1f-484a-4b20-803a-02b1bd7aff31-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-gcb84\" (UID: \"5361bc1f-484a-4b20-803a-02b1bd7aff31\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gcb84" Jun 02 19:04:25.358680 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.358366 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/17a50869-5f95-4436-9eaf-c2ad111ccd76-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-l2lnk\" (UID: \"17a50869-5f95-4436-9eaf-c2ad111ccd76\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-l2lnk" Jun 02 19:04:25.360708 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.360683 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/17a50869-5f95-4436-9eaf-c2ad111ccd76-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-l2lnk\" (UID: \"17a50869-5f95-4436-9eaf-c2ad111ccd76\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-l2lnk" Jun 02 19:04:25.360708 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.360703 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5361bc1f-484a-4b20-803a-02b1bd7aff31-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-gcb84\" (UID: \"5361bc1f-484a-4b20-803a-02b1bd7aff31\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gcb84" Jun 02 19:04:25.458681 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.458656 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c590dacd-1369-4e42-b9ad-e6422b219426-metrics-certs\") pod \"router-default-6c96dcf58c-hn2d6\" (UID: \"c590dacd-1369-4e42-b9ad-e6422b219426\") " pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:04:25.458797 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.458685 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-registry-tls\") pod \"image-registry-7474894d9b-m2x4b\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:04:25.458797 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.458718 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c590dacd-1369-4e42-b9ad-e6422b219426-service-ca-bundle\") pod \"router-default-6c96dcf58c-hn2d6\" (UID: \"c590dacd-1369-4e42-b9ad-e6422b219426\") " pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:04:25.459337 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.459297 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c590dacd-1369-4e42-b9ad-e6422b219426-service-ca-bundle\") pod \"router-default-6c96dcf58c-hn2d6\" (UID: \"c590dacd-1369-4e42-b9ad-e6422b219426\") " pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:04:25.460876 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.460850 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c590dacd-1369-4e42-b9ad-e6422b219426-metrics-certs\") pod \"router-default-6c96dcf58c-hn2d6\" (UID: \"c590dacd-1369-4e42-b9ad-e6422b219426\") " pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:04:25.460955 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.460894 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-registry-tls\") pod \"image-registry-7474894d9b-m2x4b\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:04:25.542009 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.541986 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mxfc9\"" Jun 02 19:04:25.550296 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.550281 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gcb84" Jun 02 19:04:25.559185 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.559162 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-registry-tls\") pod \"image-registry-6676c7c455-jc7gc\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:04:25.559281 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.559216 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c489102-a181-45b3-b63e-b54e3046b8cc-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-hfhgt\" (UID: \"0c489102-a181-45b3-b63e-b54e3046b8cc\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-hfhgt" Jun 02 19:04:25.561879 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.561862 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-registry-tls\") pod \"image-registry-6676c7c455-jc7gc\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:04:25.561983 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.561933 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0c489102-a181-45b3-b63e-b54e3046b8cc-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-hfhgt\" (UID: \"0c489102-a181-45b3-b63e-b54e3046b8cc\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-hfhgt" Jun 02 19:04:25.566323 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.566289 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2th5d\"" Jun 02 19:04:25.574567 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.574550 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-l2lnk" Jun 02 19:04:25.587846 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.587829 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fds9f\"" Jun 02 19:04:25.596815 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.596717 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:04:25.654601 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.654570 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dzvrh\"" Jun 02 19:04:25.661090 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.660609 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ba16f49-e177-4b3a-9559-f61b332d28f5-metrics-tls\") pod \"dns-default-l2w9x\" (UID: \"3ba16f49-e177-4b3a-9559-f61b332d28f5\") " pod="openshift-dns/dns-default-l2w9x" Jun 02 19:04:25.661090 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.660642 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0b95f6c-05eb-4df0-bd51-0c267429a4ed-cert\") pod \"ingress-canary-dxkps\" (UID: \"c0b95f6c-05eb-4df0-bd51-0c267429a4ed\") " pod="openshift-ingress-canary/ingress-canary-dxkps" Jun 02 19:04:25.666469 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.662035 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:04:25.666469 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.664390 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0b95f6c-05eb-4df0-bd51-0c267429a4ed-cert\") pod \"ingress-canary-dxkps\" (UID: \"c0b95f6c-05eb-4df0-bd51-0c267429a4ed\") " pod="openshift-ingress-canary/ingress-canary-dxkps" Jun 02 19:04:25.666469 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.665701 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ba16f49-e177-4b3a-9559-f61b332d28f5-metrics-tls\") pod \"dns-default-l2w9x\" (UID: \"3ba16f49-e177-4b3a-9559-f61b332d28f5\") " pod="openshift-dns/dns-default-l2w9x" Jun 02 19:04:25.687852 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.687698 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-c7p8h\"" Jun 02 19:04:25.697631 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.696886 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-hfhgt" Jun 02 19:04:25.699547 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.699502 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gcb84"] Jun 02 19:04:25.736033 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.735264 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-l2lnk"] Jun 02 19:04:25.740452 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:04:25.740103 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17a50869_5f95_4436_9eaf_c2ad111ccd76.slice/crio-985ad15aa2a96a2985508fa27f15305ce475297f0662da7b910806ee828e102b WatchSource:0}: Error finding container 985ad15aa2a96a2985508fa27f15305ce475297f0662da7b910806ee828e102b: Status 404 returned error can't find the container with id 985ad15aa2a96a2985508fa27f15305ce475297f0662da7b910806ee828e102b Jun 02 19:04:25.762572 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.762514 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7474894d9b-m2x4b"] Jun 02 19:04:25.763681 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.763466 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:04:25.765842 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:04:25.765553 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a1232c5_ec81_4d50_ae3b_6197805dd970.slice/crio-0e67de53576e0830a8d05a67aaba82b2ece5648b6fbe0ebb46a66942878b5f32 WatchSource:0}: Error finding container 0e67de53576e0830a8d05a67aaba82b2ece5648b6fbe0ebb46a66942878b5f32: Status 404 returned error can't find the container with id 0e67de53576e0830a8d05a67aaba82b2ece5648b6fbe0ebb46a66942878b5f32 Jun 02 19:04:25.788358 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.787867 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z6cjs\"" Jun 02 19:04:25.790736 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.790704 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" podUID="ae25fd4c-42e3-4611-a270-3ce87e11feac" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 19:04:25.796471 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.796177 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dxkps" Jun 02 19:04:25.815804 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.815766 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t48t7\"" Jun 02 19:04:25.824387 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.824045 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l2w9x" Jun 02 19:04:25.829191 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.829146 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6c96dcf58c-hn2d6"] Jun 02 19:04:25.841058 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:04:25.841018 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc590dacd_1369_4e42_b9ad_e6422b219426.slice/crio-70d74db5197547a146c2849880116a817f0f13e5568484cd7f7bd10e6153d647 WatchSource:0}: Error finding container 70d74db5197547a146c2849880116a817f0f13e5568484cd7f7bd10e6153d647: Status 404 returned error can't find the container with id 70d74db5197547a146c2849880116a817f0f13e5568484cd7f7bd10e6153d647 Jun 02 19:04:25.856403 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.856363 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-hfhgt"] Jun 02 19:04:25.866521 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:04:25.865096 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c489102_a181_45b3_b63e_b54e3046b8cc.slice/crio-5f04fde5d30d810634cc303e4cd3b14037387bc963045d7a96b56f16d543f9ce WatchSource:0}: Error finding container 5f04fde5d30d810634cc303e4cd3b14037387bc963045d7a96b56f16d543f9ce: Status 404 returned error can't find the container with id 5f04fde5d30d810634cc303e4cd3b14037387bc963045d7a96b56f16d543f9ce Jun 02 19:04:25.887250 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.887149 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" event={"ID":"c590dacd-1369-4e42-b9ad-e6422b219426","Type":"ContainerStarted","Data":"70d74db5197547a146c2849880116a817f0f13e5568484cd7f7bd10e6153d647"} Jun 02 19:04:25.888672 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.888635 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-hfhgt" event={"ID":"0c489102-a181-45b3-b63e-b54e3046b8cc","Type":"ContainerStarted","Data":"5f04fde5d30d810634cc303e4cd3b14037387bc963045d7a96b56f16d543f9ce"} Jun 02 19:04:25.890400 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.890357 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gcb84" event={"ID":"5361bc1f-484a-4b20-803a-02b1bd7aff31","Type":"ContainerStarted","Data":"14ba318c3f453524b897517ce2bd73be454482d0854c683688e1c51d15bca268"} Jun 02 19:04:25.891536 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.891498 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-l2lnk" event={"ID":"17a50869-5f95-4436-9eaf-c2ad111ccd76","Type":"ContainerStarted","Data":"985ad15aa2a96a2985508fa27f15305ce475297f0662da7b910806ee828e102b"} Jun 02 19:04:25.892722 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.892681 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" event={"ID":"3a1232c5-ec81-4d50-ae3b-6197805dd970","Type":"ContainerStarted","Data":"0e67de53576e0830a8d05a67aaba82b2ece5648b6fbe0ebb46a66942878b5f32"} Jun 02 19:04:25.931119 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.930816 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6676c7c455-jc7gc"] Jun 02 19:04:25.934640 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:04:25.934612 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod049e9671_1102_4305_b575_93b90999960a.slice/crio-88ab263bf850ee26f273afca58d9841d51155201f8ed76d5dcff3280a64a83b1 WatchSource:0}: Error finding container 88ab263bf850ee26f273afca58d9841d51155201f8ed76d5dcff3280a64a83b1: Status 404 returned error can't find the container with id 88ab263bf850ee26f273afca58d9841d51155201f8ed76d5dcff3280a64a83b1 Jun 02 19:04:25.969675 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.969500 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dxkps"] Jun 02 19:04:25.972762 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:04:25.972736 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0b95f6c_05eb_4df0_bd51_0c267429a4ed.slice/crio-8a8c6529c0aaf510fde9f863d7279d0653d17d42d6a99ab2d8afcd198af08783 WatchSource:0}: Error finding container 8a8c6529c0aaf510fde9f863d7279d0653d17d42d6a99ab2d8afcd198af08783: Status 404 returned error can't find the container with id 8a8c6529c0aaf510fde9f863d7279d0653d17d42d6a99ab2d8afcd198af08783 Jun 02 19:04:25.988256 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:25.988229 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l2w9x"] Jun 02 19:04:25.991233 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:04:25.991208 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ba16f49_e177_4b3a_9559_f61b332d28f5.slice/crio-8f14ecb9f48bdf6fd280a4568563d86f49ef3f30a563e5f7cb510abe70785776 WatchSource:0}: Error finding container 8f14ecb9f48bdf6fd280a4568563d86f49ef3f30a563e5f7cb510abe70785776: Status 404 returned error can't find the container with id 8f14ecb9f48bdf6fd280a4568563d86f49ef3f30a563e5f7cb510abe70785776 Jun 02 19:04:26.899955 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:26.899870 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l2w9x" event={"ID":"3ba16f49-e177-4b3a-9559-f61b332d28f5","Type":"ContainerStarted","Data":"8f14ecb9f48bdf6fd280a4568563d86f49ef3f30a563e5f7cb510abe70785776"} Jun 02 19:04:26.902062 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:26.902022 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dxkps" event={"ID":"c0b95f6c-05eb-4df0-bd51-0c267429a4ed","Type":"ContainerStarted","Data":"8a8c6529c0aaf510fde9f863d7279d0653d17d42d6a99ab2d8afcd198af08783"} Jun 02 19:04:26.904597 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:26.904572 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" event={"ID":"3a1232c5-ec81-4d50-ae3b-6197805dd970","Type":"ContainerStarted","Data":"4ccdca77cb608637efb29e4d9407c503baeb167a8ead151922a917d4885b8f61"} Jun 02 19:04:26.904683 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:26.904670 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:04:26.908026 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:26.907801 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" event={"ID":"c590dacd-1369-4e42-b9ad-e6422b219426","Type":"ContainerStarted","Data":"599068527d13c2b28d81099918f20933e4a37e0f50a63ab29cfd1f980028168e"} Jun 02 19:04:26.909601 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:26.909578 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" event={"ID":"049e9671-1102-4305-b575-93b90999960a","Type":"ContainerStarted","Data":"8f2bbda9662403a93fb73181458b2647bf0edda03daed159b827a39841365e78"} Jun 02 19:04:26.909601 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:26.909610 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" event={"ID":"049e9671-1102-4305-b575-93b90999960a","Type":"ContainerStarted","Data":"88ab263bf850ee26f273afca58d9841d51155201f8ed76d5dcff3280a64a83b1"} Jun 02 19:04:26.909809 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:26.909738 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:04:26.927666 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:26.927624 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" podStartSLOduration=67.927609754 podStartE2EDuration="1m7.927609754s" podCreationTimestamp="2026-06-02 19:03:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:04:26.926504068 +0000 UTC m=+70.901405627" watchObservedRunningTime="2026-06-02 19:04:26.927609754 +0000 UTC m=+70.902511293" Jun 02 19:04:26.949236 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:26.948918 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" podStartSLOduration=67.948905041 podStartE2EDuration="1m7.948905041s" podCreationTimestamp="2026-06-02 19:03:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:04:26.94685409 +0000 UTC m=+70.921755627" watchObservedRunningTime="2026-06-02 19:04:26.948905041 +0000 UTC m=+70.923806580" Jun 02 19:04:26.969097 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:26.968802 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" podStartSLOduration=67.968789012 podStartE2EDuration="1m7.968789012s" podCreationTimestamp="2026-06-02 19:03:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:04:26.966731527 +0000 UTC m=+70.941633068" watchObservedRunningTime="2026-06-02 19:04:26.968789012 +0000 UTC m=+70.943690552" Jun 02 19:04:27.662956 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:27.662922 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:04:27.665908 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:27.665885 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:04:27.913710 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:27.913618 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:04:27.914848 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:27.914827 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6c96dcf58c-hn2d6" Jun 02 19:04:28.806944 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:28.806914 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zmnsn"] Jun 02 19:04:28.821756 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:28.821733 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7474894d9b-m2x4b"] Jun 02 19:04:28.821871 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:28.821858 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zmnsn" Jun 02 19:04:28.824796 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:28.824761 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 19:04:28.824796 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:28.824784 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jcshd\"" Jun 02 19:04:28.824972 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:28.824955 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 19:04:28.828296 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:28.828273 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zmnsn"] Jun 02 19:04:28.993085 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:28.993003 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2442935b-316b-48d5-b8c8-bf1b49e53aae-crio-socket\") pod \"insights-runtime-extractor-zmnsn\" (UID: \"2442935b-316b-48d5-b8c8-bf1b49e53aae\") " pod="openshift-insights/insights-runtime-extractor-zmnsn" Jun 02 19:04:28.993602 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:28.993126 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2442935b-316b-48d5-b8c8-bf1b49e53aae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zmnsn\" (UID: \"2442935b-316b-48d5-b8c8-bf1b49e53aae\") " pod="openshift-insights/insights-runtime-extractor-zmnsn" Jun 02 19:04:28.993602 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:28.993168 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2442935b-316b-48d5-b8c8-bf1b49e53aae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zmnsn\" (UID: \"2442935b-316b-48d5-b8c8-bf1b49e53aae\") " pod="openshift-insights/insights-runtime-extractor-zmnsn" Jun 02 19:04:28.993602 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:28.993227 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2442935b-316b-48d5-b8c8-bf1b49e53aae-data-volume\") pod \"insights-runtime-extractor-zmnsn\" (UID: \"2442935b-316b-48d5-b8c8-bf1b49e53aae\") " pod="openshift-insights/insights-runtime-extractor-zmnsn" Jun 02 19:04:28.993602 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:28.993385 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqq62\" (UniqueName: \"kubernetes.io/projected/2442935b-316b-48d5-b8c8-bf1b49e53aae-kube-api-access-bqq62\") pod \"insights-runtime-extractor-zmnsn\" (UID: \"2442935b-316b-48d5-b8c8-bf1b49e53aae\") " pod="openshift-insights/insights-runtime-extractor-zmnsn" Jun 02 19:04:29.094046 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:29.094018 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2442935b-316b-48d5-b8c8-bf1b49e53aae-crio-socket\") pod \"insights-runtime-extractor-zmnsn\" (UID: \"2442935b-316b-48d5-b8c8-bf1b49e53aae\") " pod="openshift-insights/insights-runtime-extractor-zmnsn" Jun 02 19:04:29.094216 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:29.094074 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2442935b-316b-48d5-b8c8-bf1b49e53aae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zmnsn\" (UID: \"2442935b-316b-48d5-b8c8-bf1b49e53aae\") " pod="openshift-insights/insights-runtime-extractor-zmnsn" Jun 02 19:04:29.094216 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:29.094104 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2442935b-316b-48d5-b8c8-bf1b49e53aae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zmnsn\" (UID: \"2442935b-316b-48d5-b8c8-bf1b49e53aae\") " pod="openshift-insights/insights-runtime-extractor-zmnsn" Jun 02 19:04:29.094216 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:29.094144 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2442935b-316b-48d5-b8c8-bf1b49e53aae-data-volume\") pod \"insights-runtime-extractor-zmnsn\" (UID: \"2442935b-316b-48d5-b8c8-bf1b49e53aae\") " pod="openshift-insights/insights-runtime-extractor-zmnsn" Jun 02 19:04:29.094216 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:29.094145 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2442935b-316b-48d5-b8c8-bf1b49e53aae-crio-socket\") pod \"insights-runtime-extractor-zmnsn\" (UID: \"2442935b-316b-48d5-b8c8-bf1b49e53aae\") " pod="openshift-insights/insights-runtime-extractor-zmnsn" Jun 02 19:04:29.094216 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:29.094216 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bqq62\" (UniqueName: \"kubernetes.io/projected/2442935b-316b-48d5-b8c8-bf1b49e53aae-kube-api-access-bqq62\") pod \"insights-runtime-extractor-zmnsn\" (UID: \"2442935b-316b-48d5-b8c8-bf1b49e53aae\") " pod="openshift-insights/insights-runtime-extractor-zmnsn" Jun 02 19:04:29.094544 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:29.094517 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2442935b-316b-48d5-b8c8-bf1b49e53aae-data-volume\") pod \"insights-runtime-extractor-zmnsn\" (UID: \"2442935b-316b-48d5-b8c8-bf1b49e53aae\") " pod="openshift-insights/insights-runtime-extractor-zmnsn" Jun 02 19:04:29.095120 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:29.095083 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2442935b-316b-48d5-b8c8-bf1b49e53aae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zmnsn\" (UID: \"2442935b-316b-48d5-b8c8-bf1b49e53aae\") " pod="openshift-insights/insights-runtime-extractor-zmnsn" Jun 02 19:04:29.096934 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:29.096912 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2442935b-316b-48d5-b8c8-bf1b49e53aae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zmnsn\" (UID: \"2442935b-316b-48d5-b8c8-bf1b49e53aae\") " pod="openshift-insights/insights-runtime-extractor-zmnsn" Jun 02 19:04:29.121949 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:29.121928 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqq62\" (UniqueName: \"kubernetes.io/projected/2442935b-316b-48d5-b8c8-bf1b49e53aae-kube-api-access-bqq62\") pod \"insights-runtime-extractor-zmnsn\" (UID: \"2442935b-316b-48d5-b8c8-bf1b49e53aae\") " pod="openshift-insights/insights-runtime-extractor-zmnsn" Jun 02 19:04:29.131769 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:29.131751 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zmnsn" Jun 02 19:04:30.699367 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:30.698453 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zmnsn"] Jun 02 19:04:30.703671 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:04:30.703646 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2442935b_316b_48d5_b8c8_bf1b49e53aae.slice/crio-e48de778cb047bb8b067235a09acada03c5d15521bd957c79151b8fcffbd777f WatchSource:0}: Error finding container e48de778cb047bb8b067235a09acada03c5d15521bd957c79151b8fcffbd777f: Status 404 returned error can't find the container with id e48de778cb047bb8b067235a09acada03c5d15521bd957c79151b8fcffbd777f Jun 02 19:04:30.928360 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:30.928255 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gcb84" event={"ID":"5361bc1f-484a-4b20-803a-02b1bd7aff31","Type":"ContainerStarted","Data":"599de33a4aaca4042b12baf76babb29e56cbb7351bb564ec04e350c17be02eab"} Jun 02 19:04:30.928360 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:30.928300 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gcb84" event={"ID":"5361bc1f-484a-4b20-803a-02b1bd7aff31","Type":"ContainerStarted","Data":"15a4a2a8ce72c1639e6fb63c077f28b607c9f5952d15e18c55846bd208c77924"} Jun 02 19:04:30.930212 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:30.929824 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-l2lnk" event={"ID":"17a50869-5f95-4436-9eaf-c2ad111ccd76","Type":"ContainerStarted","Data":"fff43811c2e62cbe0de3025118eb7d1bd9ece50b97c3db37a00b95e790cf68d2"} Jun 02 19:04:30.931663 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:30.931639 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dxkps" event={"ID":"c0b95f6c-05eb-4df0-bd51-0c267429a4ed","Type":"ContainerStarted","Data":"b0cd42d1dae682dd5694edd88fe01a8e42bb284778d9c29b4cc1cd9e68f04e27"} Jun 02 19:04:30.933548 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:30.933526 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zmnsn" event={"ID":"2442935b-316b-48d5-b8c8-bf1b49e53aae","Type":"ContainerStarted","Data":"cf5e993c337311294dcdd88cf81311d4921d539219f5f17d4d586cc962fb1f5e"} Jun 02 19:04:30.933620 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:30.933555 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zmnsn" event={"ID":"2442935b-316b-48d5-b8c8-bf1b49e53aae","Type":"ContainerStarted","Data":"e48de778cb047bb8b067235a09acada03c5d15521bd957c79151b8fcffbd777f"} Jun 02 19:04:30.934848 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:30.934826 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-hfhgt" event={"ID":"0c489102-a181-45b3-b63e-b54e3046b8cc","Type":"ContainerStarted","Data":"9125c8f20a1301d2e5f0608f4bfb79620fb484a42721da6cd353972a5cae382b"} Jun 02 19:04:30.936635 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:30.936615 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l2w9x" event={"ID":"3ba16f49-e177-4b3a-9559-f61b332d28f5","Type":"ContainerStarted","Data":"03d0e58993017ec881e77a42a736223958fa57f0b337d7e9f9e6565e320a4a31"} Jun 02 19:04:30.954123 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:30.954074 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-l2lnk" podStartSLOduration=67.135716211 podStartE2EDuration="1m11.95406239s" podCreationTimestamp="2026-06-02 19:03:19 +0000 UTC" firstStartedPulling="2026-06-02 19:04:25.741680059 +0000 UTC m=+69.716581574" lastFinishedPulling="2026-06-02 19:04:30.560026232 +0000 UTC m=+74.534927753" observedRunningTime="2026-06-02 19:04:30.952151313 +0000 UTC m=+74.927052850" watchObservedRunningTime="2026-06-02 19:04:30.95406239 +0000 UTC m=+74.928963958" Jun 02 19:04:30.973271 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:30.972467 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dxkps" podStartSLOduration=33.387095952 podStartE2EDuration="37.97245016s" podCreationTimestamp="2026-06-02 19:03:53 +0000 UTC" firstStartedPulling="2026-06-02 19:04:25.974640077 +0000 UTC m=+69.949541595" lastFinishedPulling="2026-06-02 19:04:30.559994277 +0000 UTC m=+74.534895803" observedRunningTime="2026-06-02 19:04:30.971009631 +0000 UTC m=+74.945911169" watchObservedRunningTime="2026-06-02 19:04:30.97245016 +0000 UTC m=+74.947351698" Jun 02 19:04:31.225104 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:31.225046 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-hfhgt" podStartSLOduration=67.533174698 podStartE2EDuration="1m12.225026944s" podCreationTimestamp="2026-06-02 19:03:19 +0000 UTC" firstStartedPulling="2026-06-02 19:04:25.868143245 +0000 UTC m=+69.843044773" lastFinishedPulling="2026-06-02 19:04:30.559995499 +0000 UTC m=+74.534897019" observedRunningTime="2026-06-02 19:04:30.996631495 +0000 UTC m=+74.971533033" watchObservedRunningTime="2026-06-02 19:04:31.225026944 +0000 UTC m=+75.199928545" Jun 02 19:04:31.226177 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:31.226154 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-t2kws"] Jun 02 19:04:31.247752 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:31.247718 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-t2kws"] Jun 02 19:04:31.247846 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:31.247772 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-t2kws" Jun 02 19:04:31.250697 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:31.250677 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-mrfhr\"" Jun 02 19:04:31.250940 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:31.250922 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 02 19:04:31.415087 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:31.415057 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4bfe5df8-4f03-4727-af5e-99658cf38d98-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-t2kws\" (UID: \"4bfe5df8-4f03-4727-af5e-99658cf38d98\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-t2kws" Jun 02 19:04:31.516519 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:31.516450 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4bfe5df8-4f03-4727-af5e-99658cf38d98-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-t2kws\" (UID: \"4bfe5df8-4f03-4727-af5e-99658cf38d98\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-t2kws" Jun 02 19:04:31.518962 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:31.518940 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4bfe5df8-4f03-4727-af5e-99658cf38d98-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-t2kws\" (UID: \"4bfe5df8-4f03-4727-af5e-99658cf38d98\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-t2kws" Jun 02 19:04:31.557182 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:31.557158 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-t2kws" Jun 02 19:04:31.743786 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:31.743757 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-t2kws"] Jun 02 19:04:31.746427 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:04:31.746398 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bfe5df8_4f03_4727_af5e_99658cf38d98.slice/crio-c6b72047a746f3579fd71956257db4c13a094d01749a364dfe0ee3cf25ff4f36 WatchSource:0}: Error finding container c6b72047a746f3579fd71956257db4c13a094d01749a364dfe0ee3cf25ff4f36: Status 404 returned error can't find the container with id c6b72047a746f3579fd71956257db4c13a094d01749a364dfe0ee3cf25ff4f36 Jun 02 19:04:31.940373 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:31.940343 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-t2kws" event={"ID":"4bfe5df8-4f03-4727-af5e-99658cf38d98","Type":"ContainerStarted","Data":"c6b72047a746f3579fd71956257db4c13a094d01749a364dfe0ee3cf25ff4f36"} Jun 02 19:04:31.941917 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:31.941888 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l2w9x" event={"ID":"3ba16f49-e177-4b3a-9559-f61b332d28f5","Type":"ContainerStarted","Data":"61072b74883efc1ed2407248bd969c53b51294edcb3fa0f24aab440802a5f81c"} Jun 02 19:04:31.942419 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:31.942398 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-l2w9x" Jun 02 19:04:31.960497 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:31.960460 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-l2w9x" podStartSLOduration=34.394826384 podStartE2EDuration="38.960448528s" podCreationTimestamp="2026-06-02 19:03:53 +0000 UTC" firstStartedPulling="2026-06-02 19:04:25.993195601 +0000 UTC m=+69.968097116" lastFinishedPulling="2026-06-02 19:04:30.558817728 +0000 UTC m=+74.533719260" observedRunningTime="2026-06-02 19:04:31.958268518 +0000 UTC m=+75.933170078" watchObservedRunningTime="2026-06-02 19:04:31.960448528 +0000 UTC m=+75.935350065" Jun 02 19:04:31.973823 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:31.973784 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-gcb84" podStartSLOduration=68.200289718 podStartE2EDuration="1m12.973772725s" podCreationTimestamp="2026-06-02 19:03:19 +0000 UTC" firstStartedPulling="2026-06-02 19:04:25.788106014 +0000 UTC m=+69.763007534" lastFinishedPulling="2026-06-02 19:04:30.561589024 +0000 UTC m=+74.536490541" observedRunningTime="2026-06-02 19:04:31.972716118 +0000 UTC m=+75.947617666" watchObservedRunningTime="2026-06-02 19:04:31.973772725 +0000 UTC m=+75.948674289" Jun 02 19:04:32.946633 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:32.946603 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-t2kws" event={"ID":"4bfe5df8-4f03-4727-af5e-99658cf38d98","Type":"ContainerStarted","Data":"aaab682c80d5901dda17831b701f9cd23c9e9eacdc930016e9cf230c7abc6782"} Jun 02 19:04:32.947010 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:32.946789 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-t2kws" Jun 02 19:04:32.948359 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:32.948331 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zmnsn" event={"ID":"2442935b-316b-48d5-b8c8-bf1b49e53aae","Type":"ContainerStarted","Data":"00e3aa2b2e297a33f65cf82c2983a2c5d53cd8cf7dc005f2b6d81ca9d44624f6"} Jun 02 19:04:32.952588 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:32.952563 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-t2kws" Jun 02 19:04:32.963037 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:32.962998 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-t2kws" podStartSLOduration=0.912704449 podStartE2EDuration="1.96298447s" podCreationTimestamp="2026-06-02 19:04:31 +0000 UTC" firstStartedPulling="2026-06-02 19:04:31.748406358 +0000 UTC m=+75.723307872" lastFinishedPulling="2026-06-02 19:04:32.798686367 +0000 UTC m=+76.773587893" observedRunningTime="2026-06-02 19:04:32.961667461 +0000 UTC m=+76.936569000" watchObservedRunningTime="2026-06-02 19:04:32.96298447 +0000 UTC m=+76.937886010" Jun 02 19:04:33.287541 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:33.287508 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-ltcd8"] Jun 02 19:04:33.295244 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:33.295220 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ltcd8" Jun 02 19:04:33.298176 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:33.297998 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 02 19:04:33.298504 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:33.298484 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-ltcd8"] Jun 02 19:04:33.299165 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:33.299146 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-f9qcc\"" Jun 02 19:04:33.299248 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:33.299194 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 02 19:04:33.299389 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:33.299364 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 19:04:33.432583 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:33.432548 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zv9v\" (UniqueName: \"kubernetes.io/projected/ede16251-4799-43f5-b2c8-796337a5cf0c-kube-api-access-2zv9v\") pod \"prometheus-operator-658bcd8bdf-ltcd8\" (UID: \"ede16251-4799-43f5-b2c8-796337a5cf0c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ltcd8" Jun 02 19:04:33.432743 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:33.432602 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ede16251-4799-43f5-b2c8-796337a5cf0c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-ltcd8\" (UID: \"ede16251-4799-43f5-b2c8-796337a5cf0c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ltcd8" Jun 02 19:04:33.432743 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:33.432699 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ede16251-4799-43f5-b2c8-796337a5cf0c-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-ltcd8\" (UID: \"ede16251-4799-43f5-b2c8-796337a5cf0c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ltcd8" Jun 02 19:04:33.432874 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:33.432747 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ede16251-4799-43f5-b2c8-796337a5cf0c-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-ltcd8\" (UID: \"ede16251-4799-43f5-b2c8-796337a5cf0c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ltcd8" Jun 02 19:04:33.533259 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:33.533210 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2zv9v\" (UniqueName: \"kubernetes.io/projected/ede16251-4799-43f5-b2c8-796337a5cf0c-kube-api-access-2zv9v\") pod \"prometheus-operator-658bcd8bdf-ltcd8\" (UID: \"ede16251-4799-43f5-b2c8-796337a5cf0c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ltcd8" Jun 02 19:04:33.533259 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:33.533263 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ede16251-4799-43f5-b2c8-796337a5cf0c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-ltcd8\" (UID: \"ede16251-4799-43f5-b2c8-796337a5cf0c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ltcd8" Jun 02 19:04:33.533498 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:33.533290 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ede16251-4799-43f5-b2c8-796337a5cf0c-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-ltcd8\" (UID: \"ede16251-4799-43f5-b2c8-796337a5cf0c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ltcd8" Jun 02 19:04:33.533498 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:33.533327 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ede16251-4799-43f5-b2c8-796337a5cf0c-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-ltcd8\" (UID: \"ede16251-4799-43f5-b2c8-796337a5cf0c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ltcd8" Jun 02 19:04:33.534107 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:33.534086 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ede16251-4799-43f5-b2c8-796337a5cf0c-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-ltcd8\" (UID: \"ede16251-4799-43f5-b2c8-796337a5cf0c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ltcd8" Jun 02 19:04:33.536024 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:33.536000 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ede16251-4799-43f5-b2c8-796337a5cf0c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-ltcd8\" (UID: \"ede16251-4799-43f5-b2c8-796337a5cf0c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ltcd8" Jun 02 19:04:33.536124 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:33.536099 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ede16251-4799-43f5-b2c8-796337a5cf0c-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-ltcd8\" (UID: \"ede16251-4799-43f5-b2c8-796337a5cf0c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ltcd8" Jun 02 19:04:33.542566 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:33.542515 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zv9v\" (UniqueName: \"kubernetes.io/projected/ede16251-4799-43f5-b2c8-796337a5cf0c-kube-api-access-2zv9v\") pod \"prometheus-operator-658bcd8bdf-ltcd8\" (UID: \"ede16251-4799-43f5-b2c8-796337a5cf0c\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ltcd8" Jun 02 19:04:33.608916 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:33.608894 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ltcd8" Jun 02 19:04:33.945731 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:33.945701 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-ltcd8"] Jun 02 19:04:33.947959 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:04:33.947934 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podede16251_4799_43f5_b2c8_796337a5cf0c.slice/crio-8335a307dfcfa3afdd6decb397b02c488063d36f133c666a4d00b0d6bf4dadf1 WatchSource:0}: Error finding container 8335a307dfcfa3afdd6decb397b02c488063d36f133c666a4d00b0d6bf4dadf1: Status 404 returned error can't find the container with id 8335a307dfcfa3afdd6decb397b02c488063d36f133c666a4d00b0d6bf4dadf1 Jun 02 19:04:33.952977 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:33.952945 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zmnsn" event={"ID":"2442935b-316b-48d5-b8c8-bf1b49e53aae","Type":"ContainerStarted","Data":"f4dc25e497b804d2f50fc96f4c4b323bf8531109426a1035c5766e68c7751b68"} Jun 02 19:04:33.954221 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:33.954191 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ltcd8" event={"ID":"ede16251-4799-43f5-b2c8-796337a5cf0c","Type":"ContainerStarted","Data":"8335a307dfcfa3afdd6decb397b02c488063d36f133c666a4d00b0d6bf4dadf1"} Jun 02 19:04:33.971723 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:33.971682 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zmnsn" podStartSLOduration=2.947826246 podStartE2EDuration="5.971668894s" podCreationTimestamp="2026-06-02 19:04:28 +0000 UTC" firstStartedPulling="2026-06-02 19:04:30.823213329 +0000 UTC m=+74.798114859" lastFinishedPulling="2026-06-02 19:04:33.847055977 +0000 UTC m=+77.821957507" observedRunningTime="2026-06-02 19:04:33.970736612 +0000 UTC m=+77.945638177" watchObservedRunningTime="2026-06-02 19:04:33.971668894 +0000 UTC m=+77.946570431" Jun 02 19:04:35.790786 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:35.790710 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" podUID="ae25fd4c-42e3-4611-a270-3ce87e11feac" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 19:04:35.790786 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:35.790782 2557 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" Jun 02 19:04:35.791386 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:35.791352 2557 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"d482a21bcf783dbb0ef043b56f0d699ae4a24d1b9253cac0f5f8f44b68098430"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 02 19:04:35.791433 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:35.791410 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" podUID="ae25fd4c-42e3-4611-a270-3ce87e11feac" containerName="service-proxy" containerID="cri-o://d482a21bcf783dbb0ef043b56f0d699ae4a24d1b9253cac0f5f8f44b68098430" gracePeriod=30 Jun 02 19:04:35.962001 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:35.961979 2557 generic.go:358] "Generic (PLEG): container finished" podID="ae25fd4c-42e3-4611-a270-3ce87e11feac" containerID="d482a21bcf783dbb0ef043b56f0d699ae4a24d1b9253cac0f5f8f44b68098430" exitCode=2 Jun 02 19:04:35.962106 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:35.962033 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" event={"ID":"ae25fd4c-42e3-4611-a270-3ce87e11feac","Type":"ContainerDied","Data":"d482a21bcf783dbb0ef043b56f0d699ae4a24d1b9253cac0f5f8f44b68098430"} Jun 02 19:04:35.962106 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:35.962066 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77db6c9b6d-vfvnh" event={"ID":"ae25fd4c-42e3-4611-a270-3ce87e11feac","Type":"ContainerStarted","Data":"af05a40ed20e401c7b6e7212d4ec5acac26c3ea7c19965f9a07677b1caf3be7f"} Jun 02 19:04:35.963773 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:35.963754 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ltcd8" event={"ID":"ede16251-4799-43f5-b2c8-796337a5cf0c","Type":"ContainerStarted","Data":"d532237ee1cf3ef9816d1ffc618cc67b33e9a862809e8e05c44e3d5f6970c48b"} Jun 02 19:04:35.963856 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:35.963778 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ltcd8" event={"ID":"ede16251-4799-43f5-b2c8-796337a5cf0c","Type":"ContainerStarted","Data":"364c76178ee4f6d59b32a6240fea5b741417cbf845feca7b205f19990dad2c21"} Jun 02 19:04:36.003004 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:36.002942 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-ltcd8" podStartSLOduration=1.501325868 podStartE2EDuration="3.002927728s" podCreationTimestamp="2026-06-02 19:04:33 +0000 UTC" firstStartedPulling="2026-06-02 19:04:33.94985822 +0000 UTC m=+77.924759738" lastFinishedPulling="2026-06-02 19:04:35.451460079 +0000 UTC m=+79.426361598" observedRunningTime="2026-06-02 19:04:36.002465231 +0000 UTC m=+79.977366769" watchObservedRunningTime="2026-06-02 19:04:36.002927728 +0000 UTC m=+79.977829260" Jun 02 19:04:37.550747 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.550716 2557 scope.go:117] "RemoveContainer" containerID="6bff5152bcfc00052bcfc4407bfcf02a17782f14cdd2c2dac2b011ad3de5673f" Jun 02 19:04:37.680507 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.680478 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bcjgh"] Jun 02 19:04:37.683045 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.683025 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bcjgh" Jun 02 19:04:37.686064 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.686039 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 19:04:37.686488 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.686286 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 19:04:37.686715 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.686694 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-52x9g\"" Jun 02 19:04:37.686889 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.686694 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 19:04:37.866753 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.866728 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7ea1907c-2071-41dc-9a51-73845e90c62f-node-exporter-accelerators-collector-config\") pod \"node-exporter-bcjgh\" (UID: \"7ea1907c-2071-41dc-9a51-73845e90c62f\") " pod="openshift-monitoring/node-exporter-bcjgh" Jun 02 19:04:37.866880 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.866783 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7ea1907c-2071-41dc-9a51-73845e90c62f-node-exporter-textfile\") pod \"node-exporter-bcjgh\" (UID: \"7ea1907c-2071-41dc-9a51-73845e90c62f\") " pod="openshift-monitoring/node-exporter-bcjgh" Jun 02 19:04:37.866926 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.866879 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ea1907c-2071-41dc-9a51-73845e90c62f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bcjgh\" (UID: \"7ea1907c-2071-41dc-9a51-73845e90c62f\") " pod="openshift-monitoring/node-exporter-bcjgh" Jun 02 19:04:37.866926 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.866914 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ea1907c-2071-41dc-9a51-73845e90c62f-metrics-client-ca\") pod \"node-exporter-bcjgh\" (UID: \"7ea1907c-2071-41dc-9a51-73845e90c62f\") " pod="openshift-monitoring/node-exporter-bcjgh" Jun 02 19:04:37.867005 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.866947 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7ea1907c-2071-41dc-9a51-73845e90c62f-node-exporter-wtmp\") pod \"node-exporter-bcjgh\" (UID: \"7ea1907c-2071-41dc-9a51-73845e90c62f\") " pod="openshift-monitoring/node-exporter-bcjgh" Jun 02 19:04:37.867063 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.867010 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ea1907c-2071-41dc-9a51-73845e90c62f-sys\") pod \"node-exporter-bcjgh\" (UID: \"7ea1907c-2071-41dc-9a51-73845e90c62f\") " pod="openshift-monitoring/node-exporter-bcjgh" Jun 02 19:04:37.867063 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.867043 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7ea1907c-2071-41dc-9a51-73845e90c62f-node-exporter-tls\") pod \"node-exporter-bcjgh\" (UID: \"7ea1907c-2071-41dc-9a51-73845e90c62f\") " pod="openshift-monitoring/node-exporter-bcjgh" Jun 02 19:04:37.867141 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.867073 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7ea1907c-2071-41dc-9a51-73845e90c62f-root\") pod \"node-exporter-bcjgh\" (UID: \"7ea1907c-2071-41dc-9a51-73845e90c62f\") " pod="openshift-monitoring/node-exporter-bcjgh" Jun 02 19:04:37.867141 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.867127 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kl2l\" (UniqueName: \"kubernetes.io/projected/7ea1907c-2071-41dc-9a51-73845e90c62f-kube-api-access-9kl2l\") pod \"node-exporter-bcjgh\" (UID: \"7ea1907c-2071-41dc-9a51-73845e90c62f\") " pod="openshift-monitoring/node-exporter-bcjgh" Jun 02 19:04:37.967479 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.967452 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7ea1907c-2071-41dc-9a51-73845e90c62f-node-exporter-textfile\") pod \"node-exporter-bcjgh\" (UID: \"7ea1907c-2071-41dc-9a51-73845e90c62f\") " pod="openshift-monitoring/node-exporter-bcjgh" Jun 02 19:04:37.967604 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.967501 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ea1907c-2071-41dc-9a51-73845e90c62f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bcjgh\" (UID: \"7ea1907c-2071-41dc-9a51-73845e90c62f\") " pod="openshift-monitoring/node-exporter-bcjgh" Jun 02 19:04:37.967604 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.967526 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ea1907c-2071-41dc-9a51-73845e90c62f-metrics-client-ca\") pod \"node-exporter-bcjgh\" (UID: \"7ea1907c-2071-41dc-9a51-73845e90c62f\") " pod="openshift-monitoring/node-exporter-bcjgh" Jun 02 19:04:37.967604 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.967551 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7ea1907c-2071-41dc-9a51-73845e90c62f-node-exporter-wtmp\") pod \"node-exporter-bcjgh\" (UID: \"7ea1907c-2071-41dc-9a51-73845e90c62f\") " pod="openshift-monitoring/node-exporter-bcjgh" Jun 02 19:04:37.967604 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.967582 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ea1907c-2071-41dc-9a51-73845e90c62f-sys\") pod \"node-exporter-bcjgh\" (UID: \"7ea1907c-2071-41dc-9a51-73845e90c62f\") " pod="openshift-monitoring/node-exporter-bcjgh" Jun 02 19:04:37.967812 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.967632 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7ea1907c-2071-41dc-9a51-73845e90c62f-node-exporter-tls\") pod \"node-exporter-bcjgh\" (UID: \"7ea1907c-2071-41dc-9a51-73845e90c62f\") " pod="openshift-monitoring/node-exporter-bcjgh" Jun 02 19:04:37.967812 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.967683 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7ea1907c-2071-41dc-9a51-73845e90c62f-root\") pod \"node-exporter-bcjgh\" (UID: \"7ea1907c-2071-41dc-9a51-73845e90c62f\") " pod="openshift-monitoring/node-exporter-bcjgh" Jun 02 19:04:37.967812 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.967732 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9kl2l\" (UniqueName: \"kubernetes.io/projected/7ea1907c-2071-41dc-9a51-73845e90c62f-kube-api-access-9kl2l\") pod \"node-exporter-bcjgh\" (UID: \"7ea1907c-2071-41dc-9a51-73845e90c62f\") " pod="openshift-monitoring/node-exporter-bcjgh" Jun 02 19:04:37.967812 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.967768 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7ea1907c-2071-41dc-9a51-73845e90c62f-node-exporter-accelerators-collector-config\") pod \"node-exporter-bcjgh\" (UID: \"7ea1907c-2071-41dc-9a51-73845e90c62f\") " pod="openshift-monitoring/node-exporter-bcjgh" Jun 02 19:04:37.967998 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.967822 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7ea1907c-2071-41dc-9a51-73845e90c62f-node-exporter-textfile\") pod \"node-exporter-bcjgh\" (UID: \"7ea1907c-2071-41dc-9a51-73845e90c62f\") " pod="openshift-monitoring/node-exporter-bcjgh" Jun 02 19:04:37.967998 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.967976 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7ea1907c-2071-41dc-9a51-73845e90c62f-node-exporter-wtmp\") pod \"node-exporter-bcjgh\" (UID: \"7ea1907c-2071-41dc-9a51-73845e90c62f\") " pod="openshift-monitoring/node-exporter-bcjgh" Jun 02 19:04:37.968165 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.968138 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ea1907c-2071-41dc-9a51-73845e90c62f-metrics-client-ca\") pod \"node-exporter-bcjgh\" (UID: \"7ea1907c-2071-41dc-9a51-73845e90c62f\") " pod="openshift-monitoring/node-exporter-bcjgh" Jun 02 19:04:37.968232 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.968216 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7ea1907c-2071-41dc-9a51-73845e90c62f-root\") pod \"node-exporter-bcjgh\" (UID: \"7ea1907c-2071-41dc-9a51-73845e90c62f\") " pod="openshift-monitoring/node-exporter-bcjgh" Jun 02 19:04:37.968288 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.968256 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7ea1907c-2071-41dc-9a51-73845e90c62f-node-exporter-accelerators-collector-config\") pod \"node-exporter-bcjgh\" (UID: \"7ea1907c-2071-41dc-9a51-73845e90c62f\") " pod="openshift-monitoring/node-exporter-bcjgh" Jun 02 19:04:37.968396 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.968375 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ea1907c-2071-41dc-9a51-73845e90c62f-sys\") pod \"node-exporter-bcjgh\" (UID: \"7ea1907c-2071-41dc-9a51-73845e90c62f\") " pod="openshift-monitoring/node-exporter-bcjgh" Jun 02 19:04:37.970715 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.970693 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ea1907c-2071-41dc-9a51-73845e90c62f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bcjgh\" (UID: \"7ea1907c-2071-41dc-9a51-73845e90c62f\") " pod="openshift-monitoring/node-exporter-bcjgh" Jun 02 19:04:37.970926 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.970902 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7ea1907c-2071-41dc-9a51-73845e90c62f-node-exporter-tls\") pod \"node-exporter-bcjgh\" (UID: \"7ea1907c-2071-41dc-9a51-73845e90c62f\") " pod="openshift-monitoring/node-exporter-bcjgh" Jun 02 19:04:37.972041 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.972025 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-kxcxc_7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3/console-operator/2.log" Jun 02 19:04:37.972123 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.972076 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" event={"ID":"7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3","Type":"ContainerStarted","Data":"674f5a5e5a0a4c70792cd78f3f360c76f71eb6cdfaf701a92f70900001eef91e"} Jun 02 19:04:37.972426 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.972409 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" Jun 02 19:04:37.977393 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.977370 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kl2l\" (UniqueName: \"kubernetes.io/projected/7ea1907c-2071-41dc-9a51-73845e90c62f-kube-api-access-9kl2l\") pod \"node-exporter-bcjgh\" (UID: \"7ea1907c-2071-41dc-9a51-73845e90c62f\") " pod="openshift-monitoring/node-exporter-bcjgh" Jun 02 19:04:37.991060 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.990969 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" podStartSLOduration=72.25490738 podStartE2EDuration="1m18.990955472s" podCreationTimestamp="2026-06-02 19:03:19 +0000 UTC" firstStartedPulling="2026-06-02 19:03:54.098043824 +0000 UTC m=+38.072945339" lastFinishedPulling="2026-06-02 19:04:00.834091903 +0000 UTC m=+44.808993431" observedRunningTime="2026-06-02 19:04:37.989854347 +0000 UTC m=+81.964755886" watchObservedRunningTime="2026-06-02 19:04:37.990955472 +0000 UTC m=+81.965857011" Jun 02 19:04:37.993903 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:37.993884 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bcjgh" Jun 02 19:04:38.006534 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:04:38.006511 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ea1907c_2071_41dc_9a51_73845e90c62f.slice/crio-82a98fa9dc236ad14be845ef8bfebb1cb566108b2fa88936a4c623d91e71465f WatchSource:0}: Error finding container 82a98fa9dc236ad14be845ef8bfebb1cb566108b2fa88936a4c623d91e71465f: Status 404 returned error can't find the container with id 82a98fa9dc236ad14be845ef8bfebb1cb566108b2fa88936a4c623d91e71465f Jun 02 19:04:38.333501 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:38.333470 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-kxcxc" Jun 02 19:04:38.984679 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:38.984606 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bcjgh" event={"ID":"7ea1907c-2071-41dc-9a51-73845e90c62f","Type":"ContainerStarted","Data":"82a98fa9dc236ad14be845ef8bfebb1cb566108b2fa88936a4c623d91e71465f"} Jun 02 19:04:39.990672 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:39.990625 2557 generic.go:358] "Generic (PLEG): container finished" podID="7ea1907c-2071-41dc-9a51-73845e90c62f" containerID="11896ec8609cd1446bae68528165e9d410f8373d51e22aa498a01c12cc20dbdf" exitCode=0 Jun 02 19:04:39.991191 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:39.990720 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bcjgh" event={"ID":"7ea1907c-2071-41dc-9a51-73845e90c62f","Type":"ContainerDied","Data":"11896ec8609cd1446bae68528165e9d410f8373d51e22aa498a01c12cc20dbdf"} Jun 02 19:04:40.996221 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:40.996179 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bcjgh" event={"ID":"7ea1907c-2071-41dc-9a51-73845e90c62f","Type":"ContainerStarted","Data":"46703f85e9436e77ea1996a2b0f2760f3291a88494d3df737b1835504b585fec"} Jun 02 19:04:40.996221 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:40.996219 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bcjgh" event={"ID":"7ea1907c-2071-41dc-9a51-73845e90c62f","Type":"ContainerStarted","Data":"1c655744058af92fb82c1f19b3978c0b4e34a8232b99bacbbf5351da0477de28"} Jun 02 19:04:41.019810 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:41.019766 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bcjgh" podStartSLOduration=2.980648056 podStartE2EDuration="4.01975365s" podCreationTimestamp="2026-06-02 19:04:37 +0000 UTC" firstStartedPulling="2026-06-02 19:04:38.009198535 +0000 UTC m=+81.984100064" lastFinishedPulling="2026-06-02 19:04:39.048304134 +0000 UTC m=+83.023205658" observedRunningTime="2026-06-02 19:04:41.017156138 +0000 UTC m=+84.992057674" watchObservedRunningTime="2026-06-02 19:04:41.01975365 +0000 UTC m=+84.994655187" Jun 02 19:04:42.956581 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:42.956552 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-l2w9x" Jun 02 19:04:45.768121 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:45.768081 2557 patch_prober.go:28] interesting pod/image-registry-6676c7c455-jc7gc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 02 19:04:45.768572 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:45.768144 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" podUID="049e9671-1102-4305-b575-93b90999960a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 19:04:47.917073 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:47.917044 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:04:48.921441 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:48.921416 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:04:53.870701 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:53.870669 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pzkk4" Jun 02 19:04:53.945011 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:53.944958 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" podUID="3a1232c5-ec81-4d50-ae3b-6197805dd970" containerName="registry" containerID="cri-o://4ccdca77cb608637efb29e4d9407c503baeb167a8ead151922a917d4885b8f61" gracePeriod=30 Jun 02 19:04:54.182196 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:54.182175 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:04:54.274436 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:54.273506 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-registry-tls\") pod \"3a1232c5-ec81-4d50-ae3b-6197805dd970\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " Jun 02 19:04:54.274436 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:54.273561 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcs8z\" (UniqueName: \"kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-kube-api-access-mcs8z\") pod \"3a1232c5-ec81-4d50-ae3b-6197805dd970\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " Jun 02 19:04:54.274436 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:54.273635 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-bound-sa-token\") pod \"3a1232c5-ec81-4d50-ae3b-6197805dd970\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " Jun 02 19:04:54.274436 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:54.273665 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3a1232c5-ec81-4d50-ae3b-6197805dd970-installation-pull-secrets\") pod \"3a1232c5-ec81-4d50-ae3b-6197805dd970\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " Jun 02 19:04:54.277296 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:54.276924 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3a1232c5-ec81-4d50-ae3b-6197805dd970" (UID: "3a1232c5-ec81-4d50-ae3b-6197805dd970"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:04:54.277296 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:54.276947 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a1232c5-ec81-4d50-ae3b-6197805dd970-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3a1232c5-ec81-4d50-ae3b-6197805dd970" (UID: "3a1232c5-ec81-4d50-ae3b-6197805dd970"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:04:54.279369 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:54.279301 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-kube-api-access-mcs8z" (OuterVolumeSpecName: "kube-api-access-mcs8z") pod "3a1232c5-ec81-4d50-ae3b-6197805dd970" (UID: "3a1232c5-ec81-4d50-ae3b-6197805dd970"). InnerVolumeSpecName "kube-api-access-mcs8z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:04:54.279753 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:54.279730 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3a1232c5-ec81-4d50-ae3b-6197805dd970" (UID: "3a1232c5-ec81-4d50-ae3b-6197805dd970"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:04:54.374725 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:54.374701 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3a1232c5-ec81-4d50-ae3b-6197805dd970-trusted-ca\") pod \"3a1232c5-ec81-4d50-ae3b-6197805dd970\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " Jun 02 19:04:54.374871 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:54.374731 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3a1232c5-ec81-4d50-ae3b-6197805dd970-registry-certificates\") pod \"3a1232c5-ec81-4d50-ae3b-6197805dd970\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " Jun 02 19:04:54.374871 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:54.374751 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3a1232c5-ec81-4d50-ae3b-6197805dd970-image-registry-private-configuration\") pod \"3a1232c5-ec81-4d50-ae3b-6197805dd970\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " Jun 02 19:04:54.374871 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:54.374773 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3a1232c5-ec81-4d50-ae3b-6197805dd970-ca-trust-extracted\") pod \"3a1232c5-ec81-4d50-ae3b-6197805dd970\" (UID: \"3a1232c5-ec81-4d50-ae3b-6197805dd970\") " Jun 02 19:04:54.375035 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:54.375010 2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-registry-tls\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 19:04:54.375035 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:54.375029 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcs8z\" (UniqueName: \"kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-kube-api-access-mcs8z\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 19:04:54.375139 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:54.375044 2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a1232c5-ec81-4d50-ae3b-6197805dd970-bound-sa-token\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 19:04:54.375139 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:54.375060 2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3a1232c5-ec81-4d50-ae3b-6197805dd970-installation-pull-secrets\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 19:04:54.375139 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:54.375128 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a1232c5-ec81-4d50-ae3b-6197805dd970-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3a1232c5-ec81-4d50-ae3b-6197805dd970" (UID: "3a1232c5-ec81-4d50-ae3b-6197805dd970"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:04:54.375250 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:54.375158 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a1232c5-ec81-4d50-ae3b-6197805dd970-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3a1232c5-ec81-4d50-ae3b-6197805dd970" (UID: "3a1232c5-ec81-4d50-ae3b-6197805dd970"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:04:54.376577 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:54.376555 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a1232c5-ec81-4d50-ae3b-6197805dd970-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3a1232c5-ec81-4d50-ae3b-6197805dd970" (UID: "3a1232c5-ec81-4d50-ae3b-6197805dd970"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:04:54.382011 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:54.381991 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a1232c5-ec81-4d50-ae3b-6197805dd970-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3a1232c5-ec81-4d50-ae3b-6197805dd970" (UID: "3a1232c5-ec81-4d50-ae3b-6197805dd970"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:04:54.476275 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:54.476218 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3a1232c5-ec81-4d50-ae3b-6197805dd970-trusted-ca\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 19:04:54.476275 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:54.476249 2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3a1232c5-ec81-4d50-ae3b-6197805dd970-registry-certificates\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 19:04:54.476275 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:54.476261 2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3a1232c5-ec81-4d50-ae3b-6197805dd970-image-registry-private-configuration\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 19:04:54.476275 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:54.476271 2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3a1232c5-ec81-4d50-ae3b-6197805dd970-ca-trust-extracted\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 19:04:55.045396 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:55.045363 2557 generic.go:358] "Generic (PLEG): container finished" podID="3a1232c5-ec81-4d50-ae3b-6197805dd970" containerID="4ccdca77cb608637efb29e4d9407c503baeb167a8ead151922a917d4885b8f61" exitCode=0 Jun 02 19:04:55.045755 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:55.045456 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" Jun 02 19:04:55.045755 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:55.045453 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" event={"ID":"3a1232c5-ec81-4d50-ae3b-6197805dd970","Type":"ContainerDied","Data":"4ccdca77cb608637efb29e4d9407c503baeb167a8ead151922a917d4885b8f61"} Jun 02 19:04:55.045755 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:55.045492 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7474894d9b-m2x4b" event={"ID":"3a1232c5-ec81-4d50-ae3b-6197805dd970","Type":"ContainerDied","Data":"0e67de53576e0830a8d05a67aaba82b2ece5648b6fbe0ebb46a66942878b5f32"} Jun 02 19:04:55.045755 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:55.045508 2557 scope.go:117] "RemoveContainer" containerID="4ccdca77cb608637efb29e4d9407c503baeb167a8ead151922a917d4885b8f61" Jun 02 19:04:55.053029 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:55.053014 2557 scope.go:117] "RemoveContainer" containerID="4ccdca77cb608637efb29e4d9407c503baeb167a8ead151922a917d4885b8f61" Jun 02 19:04:55.053291 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:04:55.053271 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ccdca77cb608637efb29e4d9407c503baeb167a8ead151922a917d4885b8f61\": container with ID starting with 4ccdca77cb608637efb29e4d9407c503baeb167a8ead151922a917d4885b8f61 not found: ID does not exist" containerID="4ccdca77cb608637efb29e4d9407c503baeb167a8ead151922a917d4885b8f61" Jun 02 19:04:55.053421 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:55.053304 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ccdca77cb608637efb29e4d9407c503baeb167a8ead151922a917d4885b8f61"} err="failed to get container status \"4ccdca77cb608637efb29e4d9407c503baeb167a8ead151922a917d4885b8f61\": rpc error: code = NotFound desc = could not find container \"4ccdca77cb608637efb29e4d9407c503baeb167a8ead151922a917d4885b8f61\": container with ID starting with 4ccdca77cb608637efb29e4d9407c503baeb167a8ead151922a917d4885b8f61 not found: ID does not exist" Jun 02 19:04:55.064740 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:55.064721 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7474894d9b-m2x4b"] Jun 02 19:04:55.070484 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:55.070466 2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7474894d9b-m2x4b"] Jun 02 19:04:56.553749 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:56.553720 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a1232c5-ec81-4d50-ae3b-6197805dd970" path="/var/lib/kubelet/pods/3a1232c5-ec81-4d50-ae3b-6197805dd970/volumes" Jun 02 19:04:57.919589 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:04:57.919556 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6676c7c455-jc7gc"] Jun 02 19:05:06.333163 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:05:06.333135 2557 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06a683cd_e489_4964_9795_c06845389ce7.slice/crio-conmon-1fe408a235ee43e0c778c77a09e6fb10ffd1729b6579be670a25226f16135ec1.scope\": RecentStats: unable to find data in memory cache]" Jun 02 19:05:07.087266 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:07.087235 2557 generic.go:358] "Generic (PLEG): container finished" podID="06a683cd-e489-4964-9795-c06845389ce7" containerID="1fe408a235ee43e0c778c77a09e6fb10ffd1729b6579be670a25226f16135ec1" exitCode=0 Jun 02 19:05:07.087439 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:07.087335 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-5hlnl" event={"ID":"06a683cd-e489-4964-9795-c06845389ce7","Type":"ContainerDied","Data":"1fe408a235ee43e0c778c77a09e6fb10ffd1729b6579be670a25226f16135ec1"} Jun 02 19:05:07.087750 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:07.087733 2557 scope.go:117] "RemoveContainer" containerID="1fe408a235ee43e0c778c77a09e6fb10ffd1729b6579be670a25226f16135ec1" Jun 02 19:05:08.092182 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:08.092149 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-5hlnl" event={"ID":"06a683cd-e489-4964-9795-c06845389ce7","Type":"ContainerStarted","Data":"c81aa71c3c688d5d3775702cf25b2bea4b8c71ac1b8a1cd4a2d4786a6560447c"} Jun 02 19:05:10.330554 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:10.330526 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-l2lnk_17a50869-5f95-4436-9eaf-c2ad111ccd76/cluster-monitoring-operator/0.log" Jun 02 19:05:11.527793 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:11.527766 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bcjgh_7ea1907c-2071-41dc-9a51-73845e90c62f/init-textfile/0.log" Jun 02 19:05:11.729118 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:11.729090 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bcjgh_7ea1907c-2071-41dc-9a51-73845e90c62f/node-exporter/0.log" Jun 02 19:05:11.927011 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:11.926978 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bcjgh_7ea1907c-2071-41dc-9a51-73845e90c62f/kube-rbac-proxy/0.log" Jun 02 19:05:15.330542 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:15.330511 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-ltcd8_ede16251-4799-43f5-b2c8-796337a5cf0c/prometheus-operator/0.log" Jun 02 19:05:15.528051 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:15.528014 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-ltcd8_ede16251-4799-43f5-b2c8-796337a5cf0c/kube-rbac-proxy/0.log" Jun 02 19:05:15.727408 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:15.727335 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-t2kws_4bfe5df8-4f03-4727-af5e-99658cf38d98/prometheus-operator-admission-webhook/0.log" Jun 02 19:05:17.728218 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:17.728189 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-hfhgt_0c489102-a181-45b3-b63e-b54e3046b8cc/networking-console-plugin/0.log" Jun 02 19:05:17.926936 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:17.926905 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-kxcxc_7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3/console-operator/2.log" Jun 02 19:05:18.130917 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:18.130891 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-kxcxc_7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3/console-operator/3.log" Jun 02 19:05:18.928739 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:18.928711 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c96dcf58c-hn2d6_c590dacd-1369-4e42-b9ad-e6422b219426/router/0.log" Jun 02 19:05:19.127682 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:19.127656 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dxkps_c0b95f6c-05eb-4df0-bd51-0c267429a4ed/serve-healthcheck-canary/0.log" Jun 02 19:05:22.939868 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:22.939796 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" podUID="049e9671-1102-4305-b575-93b90999960a" containerName="registry" containerID="cri-o://8f2bbda9662403a93fb73181458b2647bf0edda03daed159b827a39841365e78" gracePeriod=30 Jun 02 19:05:24.145642 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:24.145615 2557 generic.go:358] "Generic (PLEG): container finished" podID="049e9671-1102-4305-b575-93b90999960a" containerID="8f2bbda9662403a93fb73181458b2647bf0edda03daed159b827a39841365e78" exitCode=0 Jun 02 19:05:24.145966 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:24.145663 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" event={"ID":"049e9671-1102-4305-b575-93b90999960a","Type":"ContainerDied","Data":"8f2bbda9662403a93fb73181458b2647bf0edda03daed159b827a39841365e78"} Jun 02 19:05:24.194110 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:24.194088 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:05:24.301715 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:24.301653 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-registry-tls\") pod \"049e9671-1102-4305-b575-93b90999960a\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " Jun 02 19:05:24.301715 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:24.301686 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-bound-sa-token\") pod \"049e9671-1102-4305-b575-93b90999960a\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " Jun 02 19:05:24.301715 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:24.301711 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/049e9671-1102-4305-b575-93b90999960a-ca-trust-extracted\") pod \"049e9671-1102-4305-b575-93b90999960a\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " Jun 02 19:05:24.301909 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:24.301765 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/049e9671-1102-4305-b575-93b90999960a-trusted-ca\") pod \"049e9671-1102-4305-b575-93b90999960a\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " Jun 02 19:05:24.301909 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:24.301813 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/049e9671-1102-4305-b575-93b90999960a-installation-pull-secrets\") pod \"049e9671-1102-4305-b575-93b90999960a\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " Jun 02 19:05:24.301909 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:24.301857 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/049e9671-1102-4305-b575-93b90999960a-image-registry-private-configuration\") pod \"049e9671-1102-4305-b575-93b90999960a\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " Jun 02 19:05:24.301909 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:24.301888 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/049e9671-1102-4305-b575-93b90999960a-registry-certificates\") pod \"049e9671-1102-4305-b575-93b90999960a\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " Jun 02 19:05:24.302097 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:24.301928 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqmfw\" (UniqueName: \"kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-kube-api-access-vqmfw\") pod \"049e9671-1102-4305-b575-93b90999960a\" (UID: \"049e9671-1102-4305-b575-93b90999960a\") " Jun 02 19:05:24.302526 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:24.302447 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/049e9671-1102-4305-b575-93b90999960a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "049e9671-1102-4305-b575-93b90999960a" (UID: "049e9671-1102-4305-b575-93b90999960a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:05:24.302806 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:24.302772 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/049e9671-1102-4305-b575-93b90999960a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "049e9671-1102-4305-b575-93b90999960a" (UID: "049e9671-1102-4305-b575-93b90999960a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:05:24.304141 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:24.304112 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/049e9671-1102-4305-b575-93b90999960a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "049e9671-1102-4305-b575-93b90999960a" (UID: "049e9671-1102-4305-b575-93b90999960a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:05:24.304141 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:24.304123 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "049e9671-1102-4305-b575-93b90999960a" (UID: "049e9671-1102-4305-b575-93b90999960a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:05:24.304456 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:24.304418 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "049e9671-1102-4305-b575-93b90999960a" (UID: "049e9671-1102-4305-b575-93b90999960a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:05:24.304590 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:24.304499 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/049e9671-1102-4305-b575-93b90999960a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "049e9671-1102-4305-b575-93b90999960a" (UID: "049e9671-1102-4305-b575-93b90999960a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 19:05:24.304590 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:24.304556 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-kube-api-access-vqmfw" (OuterVolumeSpecName: "kube-api-access-vqmfw") pod "049e9671-1102-4305-b575-93b90999960a" (UID: "049e9671-1102-4305-b575-93b90999960a"). InnerVolumeSpecName "kube-api-access-vqmfw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:05:24.310534 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:24.310509 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/049e9671-1102-4305-b575-93b90999960a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "049e9671-1102-4305-b575-93b90999960a" (UID: "049e9671-1102-4305-b575-93b90999960a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:05:24.403266 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:24.403236 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/049e9671-1102-4305-b575-93b90999960a-trusted-ca\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 19:05:24.403266 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:24.403266 2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/049e9671-1102-4305-b575-93b90999960a-installation-pull-secrets\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 19:05:24.403416 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:24.403277 2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/049e9671-1102-4305-b575-93b90999960a-image-registry-private-configuration\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 19:05:24.403416 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:24.403287 2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/049e9671-1102-4305-b575-93b90999960a-registry-certificates\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 19:05:24.403416 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:24.403296 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqmfw\" (UniqueName: \"kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-kube-api-access-vqmfw\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 19:05:24.403416 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:24.403322 2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-registry-tls\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 19:05:24.403416 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:24.403330 2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/049e9671-1102-4305-b575-93b90999960a-bound-sa-token\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 19:05:24.403416 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:24.403338 2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/049e9671-1102-4305-b575-93b90999960a-ca-trust-extracted\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 19:05:25.149060 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:25.149026 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" event={"ID":"049e9671-1102-4305-b575-93b90999960a","Type":"ContainerDied","Data":"88ab263bf850ee26f273afca58d9841d51155201f8ed76d5dcff3280a64a83b1"} Jun 02 19:05:25.149060 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:25.149047 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6676c7c455-jc7gc" Jun 02 19:05:25.149476 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:25.149077 2557 scope.go:117] "RemoveContainer" containerID="8f2bbda9662403a93fb73181458b2647bf0edda03daed159b827a39841365e78" Jun 02 19:05:25.168556 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:25.168528 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6676c7c455-jc7gc"] Jun 02 19:05:25.175194 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:25.175169 2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6676c7c455-jc7gc"] Jun 02 19:05:26.553546 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:26.553479 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="049e9671-1102-4305-b575-93b90999960a" path="/var/lib/kubelet/pods/049e9671-1102-4305-b575-93b90999960a/volumes" Jun 02 19:05:27.156866 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:27.156834 2557 generic.go:358] "Generic (PLEG): container finished" podID="a7bebca5-7203-4903-8298-b2d03a8b8b31" containerID="cf57d5f78b4b6f71b9941306edf1f1d717ca54199684791c0b1f1cb2a7a89c17" exitCode=0 Jun 02 19:05:27.157023 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:27.156908 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-lz4mf" event={"ID":"a7bebca5-7203-4903-8298-b2d03a8b8b31","Type":"ContainerDied","Data":"cf57d5f78b4b6f71b9941306edf1f1d717ca54199684791c0b1f1cb2a7a89c17"} Jun 02 19:05:27.157245 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:27.157229 2557 scope.go:117] "RemoveContainer" containerID="cf57d5f78b4b6f71b9941306edf1f1d717ca54199684791c0b1f1cb2a7a89c17" Jun 02 19:05:27.158241 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:27.158216 2557 generic.go:358] "Generic (PLEG): container finished" podID="f6d92fd4-4328-46b7-b3e4-448c1b6bce14" containerID="f3180b7f6eb398ed9d3fcd46c2c7ae83b020b77ca0ca471123ac2f1116639351" exitCode=0 Jun 02 19:05:27.158379 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:27.158242 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2pkxz" event={"ID":"f6d92fd4-4328-46b7-b3e4-448c1b6bce14","Type":"ContainerDied","Data":"f3180b7f6eb398ed9d3fcd46c2c7ae83b020b77ca0ca471123ac2f1116639351"} Jun 02 19:05:27.158615 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:27.158508 2557 scope.go:117] "RemoveContainer" containerID="f3180b7f6eb398ed9d3fcd46c2c7ae83b020b77ca0ca471123ac2f1116639351" Jun 02 19:05:28.162779 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:28.162743 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-lz4mf" event={"ID":"a7bebca5-7203-4903-8298-b2d03a8b8b31","Type":"ContainerStarted","Data":"268e55d798aec3fd4456a4d5a4be79afba98856b9495285697b6579b2703e984"} Jun 02 19:05:28.164362 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:05:28.164338 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-2pkxz" event={"ID":"f6d92fd4-4328-46b7-b3e4-448c1b6bce14","Type":"ContainerStarted","Data":"15b603b2fd48ed75d1ffa5c30c1c9bb076b85d6da99b4f6aff7d01524d7c9798"} Jun 02 19:07:39.693013 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:39.692942 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69b56f574b-gpfx2"] Jun 02 19:07:39.693503 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:39.693298 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a1232c5-ec81-4d50-ae3b-6197805dd970" containerName="registry" Jun 02 19:07:39.693503 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:39.693328 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a1232c5-ec81-4d50-ae3b-6197805dd970" containerName="registry" Jun 02 19:07:39.693503 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:39.693344 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="049e9671-1102-4305-b575-93b90999960a" containerName="registry" Jun 02 19:07:39.693503 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:39.693350 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="049e9671-1102-4305-b575-93b90999960a" containerName="registry" Jun 02 19:07:39.693503 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:39.693402 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="3a1232c5-ec81-4d50-ae3b-6197805dd970" containerName="registry" Jun 02 19:07:39.693503 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:39.693411 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="049e9671-1102-4305-b575-93b90999960a" containerName="registry" Jun 02 19:07:39.696136 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:39.696122 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69b56f574b-gpfx2" Jun 02 19:07:39.698757 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:39.698732 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 19:07:39.698877 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:39.698839 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 19:07:39.698877 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:39.698851 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 19:07:39.698995 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:39.698872 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 19:07:39.699184 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:39.699170 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wnhl7\"" Jun 02 19:07:39.708062 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:39.708040 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69b56f574b-gpfx2"] Jun 02 19:07:39.850368 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:39.850336 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx4pb\" (UniqueName: \"kubernetes.io/projected/bbf59331-3124-486b-957f-303b8637167b-kube-api-access-gx4pb\") pod \"opendatahub-operator-controller-manager-69b56f574b-gpfx2\" (UID: \"bbf59331-3124-486b-957f-303b8637167b\") " pod="opendatahub/opendatahub-operator-controller-manager-69b56f574b-gpfx2" Jun 02 19:07:39.850475 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:39.850384 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bbf59331-3124-486b-957f-303b8637167b-manifests\") pod \"opendatahub-operator-controller-manager-69b56f574b-gpfx2\" (UID: \"bbf59331-3124-486b-957f-303b8637167b\") " pod="opendatahub/opendatahub-operator-controller-manager-69b56f574b-gpfx2" Jun 02 19:07:39.850475 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:39.850456 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bbf59331-3124-486b-957f-303b8637167b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69b56f574b-gpfx2\" (UID: \"bbf59331-3124-486b-957f-303b8637167b\") " pod="opendatahub/opendatahub-operator-controller-manager-69b56f574b-gpfx2" Jun 02 19:07:39.850587 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:39.850499 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bbf59331-3124-486b-957f-303b8637167b-webhook-cert\") pod \"opendatahub-operator-controller-manager-69b56f574b-gpfx2\" (UID: \"bbf59331-3124-486b-957f-303b8637167b\") " pod="opendatahub/opendatahub-operator-controller-manager-69b56f574b-gpfx2" Jun 02 19:07:39.850587 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:39.850523 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbf59331-3124-486b-957f-303b8637167b-tmp\") pod \"opendatahub-operator-controller-manager-69b56f574b-gpfx2\" (UID: \"bbf59331-3124-486b-957f-303b8637167b\") " pod="opendatahub/opendatahub-operator-controller-manager-69b56f574b-gpfx2" Jun 02 19:07:39.951014 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:39.950946 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bbf59331-3124-486b-957f-303b8637167b-webhook-cert\") pod \"opendatahub-operator-controller-manager-69b56f574b-gpfx2\" (UID: \"bbf59331-3124-486b-957f-303b8637167b\") " pod="opendatahub/opendatahub-operator-controller-manager-69b56f574b-gpfx2" Jun 02 19:07:39.951014 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:39.950983 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbf59331-3124-486b-957f-303b8637167b-tmp\") pod \"opendatahub-operator-controller-manager-69b56f574b-gpfx2\" (UID: \"bbf59331-3124-486b-957f-303b8637167b\") " pod="opendatahub/opendatahub-operator-controller-manager-69b56f574b-gpfx2" Jun 02 19:07:39.951188 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:39.951027 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gx4pb\" (UniqueName: \"kubernetes.io/projected/bbf59331-3124-486b-957f-303b8637167b-kube-api-access-gx4pb\") pod \"opendatahub-operator-controller-manager-69b56f574b-gpfx2\" (UID: \"bbf59331-3124-486b-957f-303b8637167b\") " pod="opendatahub/opendatahub-operator-controller-manager-69b56f574b-gpfx2" Jun 02 19:07:39.951188 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:39.951062 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bbf59331-3124-486b-957f-303b8637167b-manifests\") pod \"opendatahub-operator-controller-manager-69b56f574b-gpfx2\" (UID: \"bbf59331-3124-486b-957f-303b8637167b\") " pod="opendatahub/opendatahub-operator-controller-manager-69b56f574b-gpfx2" Jun 02 19:07:39.951188 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:39.951107 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bbf59331-3124-486b-957f-303b8637167b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69b56f574b-gpfx2\" (UID: \"bbf59331-3124-486b-957f-303b8637167b\") " pod="opendatahub/opendatahub-operator-controller-manager-69b56f574b-gpfx2" Jun 02 19:07:39.951484 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:39.951458 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bbf59331-3124-486b-957f-303b8637167b-manifests\") pod \"opendatahub-operator-controller-manager-69b56f574b-gpfx2\" (UID: \"bbf59331-3124-486b-957f-303b8637167b\") " pod="opendatahub/opendatahub-operator-controller-manager-69b56f574b-gpfx2" Jun 02 19:07:39.953290 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:39.953260 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bbf59331-3124-486b-957f-303b8637167b-tmp\") pod \"opendatahub-operator-controller-manager-69b56f574b-gpfx2\" (UID: \"bbf59331-3124-486b-957f-303b8637167b\") " pod="opendatahub/opendatahub-operator-controller-manager-69b56f574b-gpfx2" Jun 02 19:07:39.953422 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:39.953404 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bbf59331-3124-486b-957f-303b8637167b-webhook-cert\") pod \"opendatahub-operator-controller-manager-69b56f574b-gpfx2\" (UID: \"bbf59331-3124-486b-957f-303b8637167b\") " pod="opendatahub/opendatahub-operator-controller-manager-69b56f574b-gpfx2" Jun 02 19:07:39.953495 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:39.953479 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bbf59331-3124-486b-957f-303b8637167b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69b56f574b-gpfx2\" (UID: \"bbf59331-3124-486b-957f-303b8637167b\") " pod="opendatahub/opendatahub-operator-controller-manager-69b56f574b-gpfx2" Jun 02 19:07:39.959240 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:39.959221 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx4pb\" (UniqueName: \"kubernetes.io/projected/bbf59331-3124-486b-957f-303b8637167b-kube-api-access-gx4pb\") pod \"opendatahub-operator-controller-manager-69b56f574b-gpfx2\" (UID: \"bbf59331-3124-486b-957f-303b8637167b\") " pod="opendatahub/opendatahub-operator-controller-manager-69b56f574b-gpfx2" Jun 02 19:07:40.007236 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:40.007211 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69b56f574b-gpfx2" Jun 02 19:07:40.137438 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:40.137406 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69b56f574b-gpfx2"] Jun 02 19:07:40.140981 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:07:40.140953 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbf59331_3124_486b_957f_303b8637167b.slice/crio-35a4ef84c950218539a2df317e88eafd11f4bf0bd5f1615f87860bbaeb880422 WatchSource:0}: Error finding container 35a4ef84c950218539a2df317e88eafd11f4bf0bd5f1615f87860bbaeb880422: Status 404 returned error can't find the container with id 35a4ef84c950218539a2df317e88eafd11f4bf0bd5f1615f87860bbaeb880422 Jun 02 19:07:40.537529 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:40.537496 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69b56f574b-gpfx2" event={"ID":"bbf59331-3124-486b-957f-303b8637167b","Type":"ContainerStarted","Data":"35a4ef84c950218539a2df317e88eafd11f4bf0bd5f1615f87860bbaeb880422"} Jun 02 19:07:43.548781 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:43.548748 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69b56f574b-gpfx2" event={"ID":"bbf59331-3124-486b-957f-303b8637167b","Type":"ContainerStarted","Data":"5f10fc8f378c785c9700ddc11da7637a7bebee24b7f3096aea7d5317cebd31db"} Jun 02 19:07:44.554064 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:44.554039 2557 generic.go:358] "Generic (PLEG): container finished" podID="bbf59331-3124-486b-957f-303b8637167b" containerID="5f10fc8f378c785c9700ddc11da7637a7bebee24b7f3096aea7d5317cebd31db" exitCode=0 Jun 02 19:07:44.554386 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:44.554365 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69b56f574b-gpfx2" event={"ID":"bbf59331-3124-486b-957f-303b8637167b","Type":"ContainerDied","Data":"5f10fc8f378c785c9700ddc11da7637a7bebee24b7f3096aea7d5317cebd31db"} Jun 02 19:07:45.559287 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:45.559251 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69b56f574b-gpfx2" event={"ID":"bbf59331-3124-486b-957f-303b8637167b","Type":"ContainerStarted","Data":"fe0ec28f8b3a76fdfe26e46a24c6065d8ab3ed717023eb1dc6709d303123887f"} Jun 02 19:07:45.559801 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:45.559416 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-69b56f574b-gpfx2" Jun 02 19:07:45.581854 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:45.581794 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-69b56f574b-gpfx2" podStartSLOduration=1.879163659 podStartE2EDuration="6.581777326s" podCreationTimestamp="2026-06-02 19:07:39 +0000 UTC" firstStartedPulling="2026-06-02 19:07:40.142546491 +0000 UTC m=+264.117448006" lastFinishedPulling="2026-06-02 19:07:44.845160155 +0000 UTC m=+268.820061673" observedRunningTime="2026-06-02 19:07:45.580054318 +0000 UTC m=+269.554955855" watchObservedRunningTime="2026-06-02 19:07:45.581777326 +0000 UTC m=+269.556678864" Jun 02 19:07:56.564779 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:56.564752 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-69b56f574b-gpfx2" Jun 02 19:07:59.068970 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:59.068935 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6f9d7d5cb6-gf4d4"] Jun 02 19:07:59.079684 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:59.079655 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6f9d7d5cb6-gf4d4" Jun 02 19:07:59.083153 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:59.083128 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 02 19:07:59.083295 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:59.083258 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-fg6w8\"" Jun 02 19:07:59.083390 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:59.083353 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 02 19:07:59.094410 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:59.094389 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6f9d7d5cb6-gf4d4"] Jun 02 19:07:59.192288 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:59.192254 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6b669db-1193-4d2e-ae9a-3d0e7a913120-tls-certs\") pod \"kube-auth-proxy-6f9d7d5cb6-gf4d4\" (UID: \"f6b669db-1193-4d2e-ae9a-3d0e7a913120\") " pod="openshift-ingress/kube-auth-proxy-6f9d7d5cb6-gf4d4" Jun 02 19:07:59.192459 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:59.192322 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgz6m\" (UniqueName: \"kubernetes.io/projected/f6b669db-1193-4d2e-ae9a-3d0e7a913120-kube-api-access-wgz6m\") pod \"kube-auth-proxy-6f9d7d5cb6-gf4d4\" (UID: \"f6b669db-1193-4d2e-ae9a-3d0e7a913120\") " pod="openshift-ingress/kube-auth-proxy-6f9d7d5cb6-gf4d4" Jun 02 19:07:59.192459 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:59.192354 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6b669db-1193-4d2e-ae9a-3d0e7a913120-tmp\") pod \"kube-auth-proxy-6f9d7d5cb6-gf4d4\" (UID: \"f6b669db-1193-4d2e-ae9a-3d0e7a913120\") " pod="openshift-ingress/kube-auth-proxy-6f9d7d5cb6-gf4d4" Jun 02 19:07:59.293107 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:59.293075 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6b669db-1193-4d2e-ae9a-3d0e7a913120-tls-certs\") pod \"kube-auth-proxy-6f9d7d5cb6-gf4d4\" (UID: \"f6b669db-1193-4d2e-ae9a-3d0e7a913120\") " pod="openshift-ingress/kube-auth-proxy-6f9d7d5cb6-gf4d4" Jun 02 19:07:59.293275 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:59.293134 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wgz6m\" (UniqueName: \"kubernetes.io/projected/f6b669db-1193-4d2e-ae9a-3d0e7a913120-kube-api-access-wgz6m\") pod \"kube-auth-proxy-6f9d7d5cb6-gf4d4\" (UID: \"f6b669db-1193-4d2e-ae9a-3d0e7a913120\") " pod="openshift-ingress/kube-auth-proxy-6f9d7d5cb6-gf4d4" Jun 02 19:07:59.293275 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:59.293157 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6b669db-1193-4d2e-ae9a-3d0e7a913120-tmp\") pod \"kube-auth-proxy-6f9d7d5cb6-gf4d4\" (UID: \"f6b669db-1193-4d2e-ae9a-3d0e7a913120\") " pod="openshift-ingress/kube-auth-proxy-6f9d7d5cb6-gf4d4" Jun 02 19:07:59.295623 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:59.295595 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6b669db-1193-4d2e-ae9a-3d0e7a913120-tmp\") pod \"kube-auth-proxy-6f9d7d5cb6-gf4d4\" (UID: \"f6b669db-1193-4d2e-ae9a-3d0e7a913120\") " pod="openshift-ingress/kube-auth-proxy-6f9d7d5cb6-gf4d4" Jun 02 19:07:59.295844 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:59.295827 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6b669db-1193-4d2e-ae9a-3d0e7a913120-tls-certs\") pod \"kube-auth-proxy-6f9d7d5cb6-gf4d4\" (UID: \"f6b669db-1193-4d2e-ae9a-3d0e7a913120\") " pod="openshift-ingress/kube-auth-proxy-6f9d7d5cb6-gf4d4" Jun 02 19:07:59.296889 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:59.296865 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-76588b95-lpmcx"] Jun 02 19:07:59.299505 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:59.299486 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-lpmcx" Jun 02 19:07:59.302443 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:59.302419 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 02 19:07:59.302576 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:59.302455 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-g569l\"" Jun 02 19:07:59.306055 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:59.306031 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgz6m\" (UniqueName: \"kubernetes.io/projected/f6b669db-1193-4d2e-ae9a-3d0e7a913120-kube-api-access-wgz6m\") pod \"kube-auth-proxy-6f9d7d5cb6-gf4d4\" (UID: \"f6b669db-1193-4d2e-ae9a-3d0e7a913120\") " pod="openshift-ingress/kube-auth-proxy-6f9d7d5cb6-gf4d4" Jun 02 19:07:59.309978 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:59.309959 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-lpmcx"] Jun 02 19:07:59.390146 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:59.390114 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6f9d7d5cb6-gf4d4" Jun 02 19:07:59.494940 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:59.494907 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72330e33-f830-4b6b-9ddb-89a7207a8062-cert\") pod \"odh-model-controller-76588b95-lpmcx\" (UID: \"72330e33-f830-4b6b-9ddb-89a7207a8062\") " pod="opendatahub/odh-model-controller-76588b95-lpmcx" Jun 02 19:07:59.495090 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:59.494970 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qttcl\" (UniqueName: \"kubernetes.io/projected/72330e33-f830-4b6b-9ddb-89a7207a8062-kube-api-access-qttcl\") pod \"odh-model-controller-76588b95-lpmcx\" (UID: \"72330e33-f830-4b6b-9ddb-89a7207a8062\") " pod="opendatahub/odh-model-controller-76588b95-lpmcx" Jun 02 19:07:59.529031 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:59.529003 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6f9d7d5cb6-gf4d4"] Jun 02 19:07:59.532293 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:07:59.532264 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6b669db_1193_4d2e_ae9a_3d0e7a913120.slice/crio-769812b113a9a8148179d995b4c732d533115e46ad77cfc60f987d77a4ad9939 WatchSource:0}: Error finding container 769812b113a9a8148179d995b4c732d533115e46ad77cfc60f987d77a4ad9939: Status 404 returned error can't find the container with id 769812b113a9a8148179d995b4c732d533115e46ad77cfc60f987d77a4ad9939 Jun 02 19:07:59.595780 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:59.595753 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72330e33-f830-4b6b-9ddb-89a7207a8062-cert\") pod \"odh-model-controller-76588b95-lpmcx\" (UID: \"72330e33-f830-4b6b-9ddb-89a7207a8062\") " pod="opendatahub/odh-model-controller-76588b95-lpmcx" Jun 02 19:07:59.595918 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:59.595801 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qttcl\" (UniqueName: \"kubernetes.io/projected/72330e33-f830-4b6b-9ddb-89a7207a8062-kube-api-access-qttcl\") pod \"odh-model-controller-76588b95-lpmcx\" (UID: \"72330e33-f830-4b6b-9ddb-89a7207a8062\") " pod="opendatahub/odh-model-controller-76588b95-lpmcx" Jun 02 19:07:59.595967 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:07:59.595924 2557 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 02 19:07:59.596003 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:07:59.595995 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72330e33-f830-4b6b-9ddb-89a7207a8062-cert podName:72330e33-f830-4b6b-9ddb-89a7207a8062 nodeName:}" failed. No retries permitted until 2026-06-02 19:08:00.095973877 +0000 UTC m=+284.070875407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/72330e33-f830-4b6b-9ddb-89a7207a8062-cert") pod "odh-model-controller-76588b95-lpmcx" (UID: "72330e33-f830-4b6b-9ddb-89a7207a8062") : secret "odh-model-controller-webhook-cert" not found Jun 02 19:07:59.602191 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:59.602159 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6f9d7d5cb6-gf4d4" event={"ID":"f6b669db-1193-4d2e-ae9a-3d0e7a913120","Type":"ContainerStarted","Data":"769812b113a9a8148179d995b4c732d533115e46ad77cfc60f987d77a4ad9939"} Jun 02 19:07:59.604192 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:07:59.604175 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qttcl\" (UniqueName: \"kubernetes.io/projected/72330e33-f830-4b6b-9ddb-89a7207a8062-kube-api-access-qttcl\") pod \"odh-model-controller-76588b95-lpmcx\" (UID: \"72330e33-f830-4b6b-9ddb-89a7207a8062\") " pod="opendatahub/odh-model-controller-76588b95-lpmcx" Jun 02 19:08:00.070956 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:00.070923 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-tsh6x"] Jun 02 19:08:00.073759 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:00.073741 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-tsh6x" Jun 02 19:08:00.078027 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:00.078009 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-99b5n\"" Jun 02 19:08:00.078027 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:00.078017 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 02 19:08:00.081219 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:00.081198 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-tsh6x"] Jun 02 19:08:00.098875 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:00.098853 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72330e33-f830-4b6b-9ddb-89a7207a8062-cert\") pod \"odh-model-controller-76588b95-lpmcx\" (UID: \"72330e33-f830-4b6b-9ddb-89a7207a8062\") " pod="opendatahub/odh-model-controller-76588b95-lpmcx" Jun 02 19:08:00.101187 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:00.101163 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/72330e33-f830-4b6b-9ddb-89a7207a8062-cert\") pod \"odh-model-controller-76588b95-lpmcx\" (UID: \"72330e33-f830-4b6b-9ddb-89a7207a8062\") " pod="opendatahub/odh-model-controller-76588b95-lpmcx" Jun 02 19:08:00.200269 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:00.200228 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bdxh\" (UniqueName: \"kubernetes.io/projected/f1cac500-4e3b-426a-b064-b3b87f775ab5-kube-api-access-2bdxh\") pod \"model-serving-api-6577596cd5-tsh6x\" (UID: \"f1cac500-4e3b-426a-b064-b3b87f775ab5\") " pod="opendatahub/model-serving-api-6577596cd5-tsh6x" Jun 02 19:08:00.200443 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:00.200349 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1cac500-4e3b-426a-b064-b3b87f775ab5-tls-certs\") pod \"model-serving-api-6577596cd5-tsh6x\" (UID: \"f1cac500-4e3b-426a-b064-b3b87f775ab5\") " pod="opendatahub/model-serving-api-6577596cd5-tsh6x" Jun 02 19:08:00.220373 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:00.220329 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-lpmcx" Jun 02 19:08:00.301798 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:00.301737 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2bdxh\" (UniqueName: \"kubernetes.io/projected/f1cac500-4e3b-426a-b064-b3b87f775ab5-kube-api-access-2bdxh\") pod \"model-serving-api-6577596cd5-tsh6x\" (UID: \"f1cac500-4e3b-426a-b064-b3b87f775ab5\") " pod="opendatahub/model-serving-api-6577596cd5-tsh6x" Jun 02 19:08:00.301944 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:00.301822 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1cac500-4e3b-426a-b064-b3b87f775ab5-tls-certs\") pod \"model-serving-api-6577596cd5-tsh6x\" (UID: \"f1cac500-4e3b-426a-b064-b3b87f775ab5\") " pod="opendatahub/model-serving-api-6577596cd5-tsh6x" Jun 02 19:08:00.304708 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:00.304662 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1cac500-4e3b-426a-b064-b3b87f775ab5-tls-certs\") pod \"model-serving-api-6577596cd5-tsh6x\" (UID: \"f1cac500-4e3b-426a-b064-b3b87f775ab5\") " pod="opendatahub/model-serving-api-6577596cd5-tsh6x" Jun 02 19:08:00.312052 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:00.311877 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bdxh\" (UniqueName: \"kubernetes.io/projected/f1cac500-4e3b-426a-b064-b3b87f775ab5-kube-api-access-2bdxh\") pod \"model-serving-api-6577596cd5-tsh6x\" (UID: \"f1cac500-4e3b-426a-b064-b3b87f775ab5\") " pod="opendatahub/model-serving-api-6577596cd5-tsh6x" Jun 02 19:08:00.383811 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:00.383772 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-lpmcx"] Jun 02 19:08:00.387592 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:00.387164 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-tsh6x" Jun 02 19:08:00.390630 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:08:00.390580 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72330e33_f830_4b6b_9ddb_89a7207a8062.slice/crio-49f7a8f1da551795c5496db1ef314adac03685d1506527a393b7372b0401a87b WatchSource:0}: Error finding container 49f7a8f1da551795c5496db1ef314adac03685d1506527a393b7372b0401a87b: Status 404 returned error can't find the container with id 49f7a8f1da551795c5496db1ef314adac03685d1506527a393b7372b0401a87b Jun 02 19:08:00.558012 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:00.557973 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-tsh6x"] Jun 02 19:08:00.559410 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:08:00.559379 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1cac500_4e3b_426a_b064_b3b87f775ab5.slice/crio-90b43f6fcc08bf86f516453b5ccdc157171689bdc88df8e48a267f307f9a21aa WatchSource:0}: Error finding container 90b43f6fcc08bf86f516453b5ccdc157171689bdc88df8e48a267f307f9a21aa: Status 404 returned error can't find the container with id 90b43f6fcc08bf86f516453b5ccdc157171689bdc88df8e48a267f307f9a21aa Jun 02 19:08:00.608045 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:00.608000 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-tsh6x" event={"ID":"f1cac500-4e3b-426a-b064-b3b87f775ab5","Type":"ContainerStarted","Data":"90b43f6fcc08bf86f516453b5ccdc157171689bdc88df8e48a267f307f9a21aa"} Jun 02 19:08:00.609521 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:00.609479 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-lpmcx" event={"ID":"72330e33-f830-4b6b-9ddb-89a7207a8062","Type":"ContainerStarted","Data":"49f7a8f1da551795c5496db1ef314adac03685d1506527a393b7372b0401a87b"} Jun 02 19:08:05.631906 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:05.631872 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6f9d7d5cb6-gf4d4" event={"ID":"f6b669db-1193-4d2e-ae9a-3d0e7a913120","Type":"ContainerStarted","Data":"f26571f3ce909134eb0c23f9e0279d48cf5057268ad0dc987aeb26667c2b01be"} Jun 02 19:08:05.633335 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:05.633288 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-tsh6x" event={"ID":"f1cac500-4e3b-426a-b064-b3b87f775ab5","Type":"ContainerStarted","Data":"8eed00114d50e56486a4e60385d50b88c81fe701bd0e90561c9af17b0a1664c6"} Jun 02 19:08:05.633444 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:05.633347 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-tsh6x" Jun 02 19:08:05.634524 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:05.634498 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-lpmcx" event={"ID":"72330e33-f830-4b6b-9ddb-89a7207a8062","Type":"ContainerStarted","Data":"cd2ae81047ff1d8c9cf28c49edb982518b359b8f50c487f93b3b5a3979f83169"} Jun 02 19:08:05.634634 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:05.634615 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-76588b95-lpmcx" Jun 02 19:08:05.653488 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:05.653452 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6f9d7d5cb6-gf4d4" podStartSLOduration=1.432953739 podStartE2EDuration="6.653439481s" podCreationTimestamp="2026-06-02 19:07:59 +0000 UTC" firstStartedPulling="2026-06-02 19:07:59.534282289 +0000 UTC m=+283.509183803" lastFinishedPulling="2026-06-02 19:08:04.754768025 +0000 UTC m=+288.729669545" observedRunningTime="2026-06-02 19:08:05.651160103 +0000 UTC m=+289.626061642" watchObservedRunningTime="2026-06-02 19:08:05.653439481 +0000 UTC m=+289.628341018" Jun 02 19:08:05.679051 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:05.679010 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-tsh6x" podStartSLOduration=1.481813842 podStartE2EDuration="5.678992324s" podCreationTimestamp="2026-06-02 19:08:00 +0000 UTC" firstStartedPulling="2026-06-02 19:08:00.561429701 +0000 UTC m=+284.536331221" lastFinishedPulling="2026-06-02 19:08:04.758608185 +0000 UTC m=+288.733509703" observedRunningTime="2026-06-02 19:08:05.677349542 +0000 UTC m=+289.652251083" watchObservedRunningTime="2026-06-02 19:08:05.678992324 +0000 UTC m=+289.653893861" Jun 02 19:08:05.699008 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:05.698959 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-76588b95-lpmcx" podStartSLOduration=2.325499221 podStartE2EDuration="6.698942817s" podCreationTimestamp="2026-06-02 19:07:59 +0000 UTC" firstStartedPulling="2026-06-02 19:08:00.392127106 +0000 UTC m=+284.367028621" lastFinishedPulling="2026-06-02 19:08:04.765570694 +0000 UTC m=+288.740472217" observedRunningTime="2026-06-02 19:08:05.697419632 +0000 UTC m=+289.672321168" watchObservedRunningTime="2026-06-02 19:08:05.698942817 +0000 UTC m=+289.673844356" Jun 02 19:08:10.158584 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:10.158552 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-w62v8"] Jun 02 19:08:10.161710 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:10.161693 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-w62v8" Jun 02 19:08:10.165346 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:10.165297 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 02 19:08:10.165503 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:10.165471 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-pcsjj\"" Jun 02 19:08:10.166495 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:10.166475 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-rdwft"] Jun 02 19:08:10.169550 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:10.169528 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-rdwft" Jun 02 19:08:10.172341 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:10.172302 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-zq8lq\"" Jun 02 19:08:10.172589 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:10.172572 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-w62v8"] Jun 02 19:08:10.173471 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:10.173451 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 02 19:08:10.188184 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:10.188161 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdt5m\" (UniqueName: \"kubernetes.io/projected/6072fda7-3361-400d-b6d3-60e6e241adb6-kube-api-access-zdt5m\") pod \"kserve-controller-manager-7c99ffcdcd-w62v8\" (UID: \"6072fda7-3361-400d-b6d3-60e6e241adb6\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-w62v8" Jun 02 19:08:10.188295 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:10.188220 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6072fda7-3361-400d-b6d3-60e6e241adb6-cert\") pod \"kserve-controller-manager-7c99ffcdcd-w62v8\" (UID: \"6072fda7-3361-400d-b6d3-60e6e241adb6\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-w62v8" Jun 02 19:08:10.195249 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:10.195227 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-rdwft"] Jun 02 19:08:10.289162 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:10.289130 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zdt5m\" (UniqueName: \"kubernetes.io/projected/6072fda7-3361-400d-b6d3-60e6e241adb6-kube-api-access-zdt5m\") pod \"kserve-controller-manager-7c99ffcdcd-w62v8\" (UID: \"6072fda7-3361-400d-b6d3-60e6e241adb6\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-w62v8" Jun 02 19:08:10.289354 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:10.289183 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98a46f44-1008-4d36-a4dd-0ba82d3ddb62-cert\") pod \"llmisvc-controller-manager-c6b9847d7-rdwft\" (UID: \"98a46f44-1008-4d36-a4dd-0ba82d3ddb62\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-rdwft" Jun 02 19:08:10.289354 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:10.289239 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6072fda7-3361-400d-b6d3-60e6e241adb6-cert\") pod \"kserve-controller-manager-7c99ffcdcd-w62v8\" (UID: \"6072fda7-3361-400d-b6d3-60e6e241adb6\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-w62v8" Jun 02 19:08:10.289354 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:10.289267 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx9nk\" (UniqueName: \"kubernetes.io/projected/98a46f44-1008-4d36-a4dd-0ba82d3ddb62-kube-api-access-lx9nk\") pod \"llmisvc-controller-manager-c6b9847d7-rdwft\" (UID: \"98a46f44-1008-4d36-a4dd-0ba82d3ddb62\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-rdwft" Jun 02 19:08:10.289534 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:08:10.289373 2557 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 02 19:08:10.289534 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:08:10.289440 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6072fda7-3361-400d-b6d3-60e6e241adb6-cert podName:6072fda7-3361-400d-b6d3-60e6e241adb6 nodeName:}" failed. No retries permitted until 2026-06-02 19:08:10.789419767 +0000 UTC m=+294.764321287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6072fda7-3361-400d-b6d3-60e6e241adb6-cert") pod "kserve-controller-manager-7c99ffcdcd-w62v8" (UID: "6072fda7-3361-400d-b6d3-60e6e241adb6") : secret "kserve-webhook-server-cert" not found Jun 02 19:08:10.309211 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:10.309186 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdt5m\" (UniqueName: \"kubernetes.io/projected/6072fda7-3361-400d-b6d3-60e6e241adb6-kube-api-access-zdt5m\") pod \"kserve-controller-manager-7c99ffcdcd-w62v8\" (UID: \"6072fda7-3361-400d-b6d3-60e6e241adb6\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-w62v8" Jun 02 19:08:10.389782 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:10.389753 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lx9nk\" (UniqueName: \"kubernetes.io/projected/98a46f44-1008-4d36-a4dd-0ba82d3ddb62-kube-api-access-lx9nk\") pod \"llmisvc-controller-manager-c6b9847d7-rdwft\" (UID: \"98a46f44-1008-4d36-a4dd-0ba82d3ddb62\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-rdwft" Jun 02 19:08:10.389901 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:10.389848 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98a46f44-1008-4d36-a4dd-0ba82d3ddb62-cert\") pod \"llmisvc-controller-manager-c6b9847d7-rdwft\" (UID: \"98a46f44-1008-4d36-a4dd-0ba82d3ddb62\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-rdwft" Jun 02 19:08:10.389971 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:08:10.389959 2557 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 02 19:08:10.390027 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:08:10.390017 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98a46f44-1008-4d36-a4dd-0ba82d3ddb62-cert podName:98a46f44-1008-4d36-a4dd-0ba82d3ddb62 nodeName:}" failed. No retries permitted until 2026-06-02 19:08:10.890001054 +0000 UTC m=+294.864902575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/98a46f44-1008-4d36-a4dd-0ba82d3ddb62-cert") pod "llmisvc-controller-manager-c6b9847d7-rdwft" (UID: "98a46f44-1008-4d36-a4dd-0ba82d3ddb62") : secret "llmisvc-webhook-server-cert" not found Jun 02 19:08:10.433438 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:10.433381 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx9nk\" (UniqueName: \"kubernetes.io/projected/98a46f44-1008-4d36-a4dd-0ba82d3ddb62-kube-api-access-lx9nk\") pod \"llmisvc-controller-manager-c6b9847d7-rdwft\" (UID: \"98a46f44-1008-4d36-a4dd-0ba82d3ddb62\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-rdwft" Jun 02 19:08:10.794174 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:10.794084 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6072fda7-3361-400d-b6d3-60e6e241adb6-cert\") pod \"kserve-controller-manager-7c99ffcdcd-w62v8\" (UID: \"6072fda7-3361-400d-b6d3-60e6e241adb6\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-w62v8" Jun 02 19:08:10.796475 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:10.796457 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6072fda7-3361-400d-b6d3-60e6e241adb6-cert\") pod \"kserve-controller-manager-7c99ffcdcd-w62v8\" (UID: \"6072fda7-3361-400d-b6d3-60e6e241adb6\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-w62v8" Jun 02 19:08:10.895035 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:10.895007 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98a46f44-1008-4d36-a4dd-0ba82d3ddb62-cert\") pod \"llmisvc-controller-manager-c6b9847d7-rdwft\" (UID: \"98a46f44-1008-4d36-a4dd-0ba82d3ddb62\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-rdwft" Jun 02 19:08:10.897252 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:10.897236 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98a46f44-1008-4d36-a4dd-0ba82d3ddb62-cert\") pod \"llmisvc-controller-manager-c6b9847d7-rdwft\" (UID: \"98a46f44-1008-4d36-a4dd-0ba82d3ddb62\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-rdwft" Jun 02 19:08:11.074495 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:11.074426 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-w62v8" Jun 02 19:08:11.085173 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:11.085148 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-rdwft" Jun 02 19:08:11.244556 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:11.244531 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-w62v8"] Jun 02 19:08:11.245946 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:08:11.245918 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6072fda7_3361_400d_b6d3_60e6e241adb6.slice/crio-6286c0ab46216886b02080f2d5cb54d6b4fb19efed95c628983aa6a59b8b4254 WatchSource:0}: Error finding container 6286c0ab46216886b02080f2d5cb54d6b4fb19efed95c628983aa6a59b8b4254: Status 404 returned error can't find the container with id 6286c0ab46216886b02080f2d5cb54d6b4fb19efed95c628983aa6a59b8b4254 Jun 02 19:08:11.251671 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:11.251647 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-rdwft"] Jun 02 19:08:11.254594 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:08:11.254567 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod98a46f44_1008_4d36_a4dd_0ba82d3ddb62.slice/crio-baa3c8e31e304d9c125b89496f31ba956f14b381aa89534c8083686a1e265342 WatchSource:0}: Error finding container baa3c8e31e304d9c125b89496f31ba956f14b381aa89534c8083686a1e265342: Status 404 returned error can't find the container with id baa3c8e31e304d9c125b89496f31ba956f14b381aa89534c8083686a1e265342 Jun 02 19:08:11.653018 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:11.652977 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-rdwft" event={"ID":"98a46f44-1008-4d36-a4dd-0ba82d3ddb62","Type":"ContainerStarted","Data":"baa3c8e31e304d9c125b89496f31ba956f14b381aa89534c8083686a1e265342"} Jun 02 19:08:11.653884 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:11.653859 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-w62v8" event={"ID":"6072fda7-3361-400d-b6d3-60e6e241adb6","Type":"ContainerStarted","Data":"6286c0ab46216886b02080f2d5cb54d6b4fb19efed95c628983aa6a59b8b4254"} Jun 02 19:08:15.667406 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:15.667373 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-rdwft" event={"ID":"98a46f44-1008-4d36-a4dd-0ba82d3ddb62","Type":"ContainerStarted","Data":"420a0cc7af92cd231b109ab0665371619ed29cb9e00fcb49c4c4a21bd993658f"} Jun 02 19:08:15.667849 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:15.667414 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-rdwft" Jun 02 19:08:15.668758 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:15.668711 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-w62v8" event={"ID":"6072fda7-3361-400d-b6d3-60e6e241adb6","Type":"ContainerStarted","Data":"a2b30643f1d0adb7ce02833c39ec1411bc257db4e7ce2f066912ce624a00970f"} Jun 02 19:08:15.668908 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:15.668839 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-w62v8" Jun 02 19:08:15.694229 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:15.694156 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-rdwft" podStartSLOduration=1.518300027 podStartE2EDuration="5.694144697s" podCreationTimestamp="2026-06-02 19:08:10 +0000 UTC" firstStartedPulling="2026-06-02 19:08:11.255818289 +0000 UTC m=+295.230719805" lastFinishedPulling="2026-06-02 19:08:15.431662961 +0000 UTC m=+299.406564475" observedRunningTime="2026-06-02 19:08:15.692708773 +0000 UTC m=+299.667610309" watchObservedRunningTime="2026-06-02 19:08:15.694144697 +0000 UTC m=+299.669046234" Jun 02 19:08:16.463174 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:16.463144 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-kxcxc_7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3/console-operator/2.log" Jun 02 19:08:16.463367 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:16.463302 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-kxcxc_7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3/console-operator/2.log" Jun 02 19:08:16.489059 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:16.489036 2557 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 19:08:16.639408 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:16.639377 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-76588b95-lpmcx" Jun 02 19:08:16.641764 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:16.641747 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-tsh6x" Jun 02 19:08:16.695121 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:16.695079 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-w62v8" podStartSLOduration=2.508651914 podStartE2EDuration="6.695067551s" podCreationTimestamp="2026-06-02 19:08:10 +0000 UTC" firstStartedPulling="2026-06-02 19:08:11.247322826 +0000 UTC m=+295.222224343" lastFinishedPulling="2026-06-02 19:08:15.433738465 +0000 UTC m=+299.408639980" observedRunningTime="2026-06-02 19:08:15.738215971 +0000 UTC m=+299.713117520" watchObservedRunningTime="2026-06-02 19:08:16.695067551 +0000 UTC m=+300.669969088" Jun 02 19:08:19.167736 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:19.167701 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-wt9mk"] Jun 02 19:08:19.171628 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:19.171607 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-wt9mk" Jun 02 19:08:19.174954 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:19.174935 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 02 19:08:19.175506 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:19.175484 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 02 19:08:19.175650 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:19.175523 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-rgc7j\"" Jun 02 19:08:19.192666 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:19.192640 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-wt9mk"] Jun 02 19:08:19.270930 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:19.270901 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/e1e908c6-5719-41d1-89c3-594dff1dc7ee-operator-config\") pod \"servicemesh-operator3-55f49c5f94-wt9mk\" (UID: \"e1e908c6-5719-41d1-89c3-594dff1dc7ee\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-wt9mk" Jun 02 19:08:19.271058 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:19.270948 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfrch\" (UniqueName: \"kubernetes.io/projected/e1e908c6-5719-41d1-89c3-594dff1dc7ee-kube-api-access-tfrch\") pod \"servicemesh-operator3-55f49c5f94-wt9mk\" (UID: \"e1e908c6-5719-41d1-89c3-594dff1dc7ee\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-wt9mk" Jun 02 19:08:19.372001 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:19.371968 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/e1e908c6-5719-41d1-89c3-594dff1dc7ee-operator-config\") pod \"servicemesh-operator3-55f49c5f94-wt9mk\" (UID: \"e1e908c6-5719-41d1-89c3-594dff1dc7ee\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-wt9mk" Jun 02 19:08:19.372115 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:19.372024 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tfrch\" (UniqueName: \"kubernetes.io/projected/e1e908c6-5719-41d1-89c3-594dff1dc7ee-kube-api-access-tfrch\") pod \"servicemesh-operator3-55f49c5f94-wt9mk\" (UID: \"e1e908c6-5719-41d1-89c3-594dff1dc7ee\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-wt9mk" Jun 02 19:08:19.374521 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:19.374500 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/e1e908c6-5719-41d1-89c3-594dff1dc7ee-operator-config\") pod \"servicemesh-operator3-55f49c5f94-wt9mk\" (UID: \"e1e908c6-5719-41d1-89c3-594dff1dc7ee\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-wt9mk" Jun 02 19:08:19.386969 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:19.386946 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfrch\" (UniqueName: \"kubernetes.io/projected/e1e908c6-5719-41d1-89c3-594dff1dc7ee-kube-api-access-tfrch\") pod \"servicemesh-operator3-55f49c5f94-wt9mk\" (UID: \"e1e908c6-5719-41d1-89c3-594dff1dc7ee\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-wt9mk" Jun 02 19:08:19.481350 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:19.481281 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-wt9mk" Jun 02 19:08:19.616166 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:19.616133 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-wt9mk"] Jun 02 19:08:19.620447 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:08:19.620422 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1e908c6_5719_41d1_89c3_594dff1dc7ee.slice/crio-c2ad70076a8effe1fad4b70c9b1e800891ad562534d2c2e1b14630f6b33d0751 WatchSource:0}: Error finding container c2ad70076a8effe1fad4b70c9b1e800891ad562534d2c2e1b14630f6b33d0751: Status 404 returned error can't find the container with id c2ad70076a8effe1fad4b70c9b1e800891ad562534d2c2e1b14630f6b33d0751 Jun 02 19:08:19.623695 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:19.623678 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 19:08:19.688435 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:19.688401 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-wt9mk" event={"ID":"e1e908c6-5719-41d1-89c3-594dff1dc7ee","Type":"ContainerStarted","Data":"c2ad70076a8effe1fad4b70c9b1e800891ad562534d2c2e1b14630f6b33d0751"} Jun 02 19:08:22.704117 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:22.703078 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-wt9mk" event={"ID":"e1e908c6-5719-41d1-89c3-594dff1dc7ee","Type":"ContainerStarted","Data":"9243c39d66bb34bbae273cdbe1a4b201396e8615f197f389f071c67b6de1af2c"} Jun 02 19:08:22.704117 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:22.703736 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-wt9mk" Jun 02 19:08:22.727793 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:22.727730 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-wt9mk" podStartSLOduration=0.819566946 podStartE2EDuration="3.727711605s" podCreationTimestamp="2026-06-02 19:08:19 +0000 UTC" firstStartedPulling="2026-06-02 19:08:19.623854767 +0000 UTC m=+303.598756286" lastFinishedPulling="2026-06-02 19:08:22.531999425 +0000 UTC m=+306.506900945" observedRunningTime="2026-06-02 19:08:22.725509631 +0000 UTC m=+306.700411170" watchObservedRunningTime="2026-06-02 19:08:22.727711605 +0000 UTC m=+306.702613142" Jun 02 19:08:29.313027 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:29.312987 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5d857d74c6-phn8p"] Jun 02 19:08:29.316762 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:29.316740 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5d857d74c6-phn8p" Jun 02 19:08:29.319656 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:29.319635 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vfkhm\"" Jun 02 19:08:29.319858 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:29.319843 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 02 19:08:29.327202 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:29.327053 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5d857d74c6-phn8p"] Jun 02 19:08:29.455097 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:29.455060 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e545ae33-55da-45cc-bdec-c0321e2fdb52-redirect-config\") pod \"dashboard-redirect-5d857d74c6-phn8p\" (UID: \"e545ae33-55da-45cc-bdec-c0321e2fdb52\") " pod="opendatahub/dashboard-redirect-5d857d74c6-phn8p" Jun 02 19:08:29.455244 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:29.455118 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd7jd\" (UniqueName: \"kubernetes.io/projected/e545ae33-55da-45cc-bdec-c0321e2fdb52-kube-api-access-wd7jd\") pod \"dashboard-redirect-5d857d74c6-phn8p\" (UID: \"e545ae33-55da-45cc-bdec-c0321e2fdb52\") " pod="opendatahub/dashboard-redirect-5d857d74c6-phn8p" Jun 02 19:08:29.556410 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:29.556379 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e545ae33-55da-45cc-bdec-c0321e2fdb52-redirect-config\") pod \"dashboard-redirect-5d857d74c6-phn8p\" (UID: \"e545ae33-55da-45cc-bdec-c0321e2fdb52\") " pod="opendatahub/dashboard-redirect-5d857d74c6-phn8p" Jun 02 19:08:29.556582 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:29.556461 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wd7jd\" (UniqueName: \"kubernetes.io/projected/e545ae33-55da-45cc-bdec-c0321e2fdb52-kube-api-access-wd7jd\") pod \"dashboard-redirect-5d857d74c6-phn8p\" (UID: \"e545ae33-55da-45cc-bdec-c0321e2fdb52\") " pod="opendatahub/dashboard-redirect-5d857d74c6-phn8p" Jun 02 19:08:29.557036 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:29.557016 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e545ae33-55da-45cc-bdec-c0321e2fdb52-redirect-config\") pod \"dashboard-redirect-5d857d74c6-phn8p\" (UID: \"e545ae33-55da-45cc-bdec-c0321e2fdb52\") " pod="opendatahub/dashboard-redirect-5d857d74c6-phn8p" Jun 02 19:08:29.564989 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:29.564931 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd7jd\" (UniqueName: \"kubernetes.io/projected/e545ae33-55da-45cc-bdec-c0321e2fdb52-kube-api-access-wd7jd\") pod \"dashboard-redirect-5d857d74c6-phn8p\" (UID: \"e545ae33-55da-45cc-bdec-c0321e2fdb52\") " pod="opendatahub/dashboard-redirect-5d857d74c6-phn8p" Jun 02 19:08:29.628940 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:29.628915 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5d857d74c6-phn8p" Jun 02 19:08:29.757039 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:29.756990 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5d857d74c6-phn8p"] Jun 02 19:08:29.760884 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:08:29.760858 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode545ae33_55da_45cc_bdec_c0321e2fdb52.slice/crio-461fcdf4f0975e9414b07b17f3cd04141fd13f517856797227a295d5eb44bd55 WatchSource:0}: Error finding container 461fcdf4f0975e9414b07b17f3cd04141fd13f517856797227a295d5eb44bd55: Status 404 returned error can't find the container with id 461fcdf4f0975e9414b07b17f3cd04141fd13f517856797227a295d5eb44bd55 Jun 02 19:08:30.735724 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:30.735683 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5d857d74c6-phn8p" event={"ID":"e545ae33-55da-45cc-bdec-c0321e2fdb52","Type":"ContainerStarted","Data":"461fcdf4f0975e9414b07b17f3cd04141fd13f517856797227a295d5eb44bd55"} Jun 02 19:08:32.387492 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.387426 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw"] Jun 02 19:08:32.390335 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.390301 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:32.393265 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.393239 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 02 19:08:32.393403 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.393242 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-6rzkh\"" Jun 02 19:08:32.402943 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.402920 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw"] Jun 02 19:08:32.482940 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.482909 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1567a621-41f7-4f0d-b16d-5e81f56bdbc2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bl4krw\" (UID: \"1567a621-41f7-4f0d-b16d-5e81f56bdbc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:32.482940 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.482941 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1567a621-41f7-4f0d-b16d-5e81f56bdbc2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bl4krw\" (UID: \"1567a621-41f7-4f0d-b16d-5e81f56bdbc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:32.483163 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.482963 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1567a621-41f7-4f0d-b16d-5e81f56bdbc2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bl4krw\" (UID: \"1567a621-41f7-4f0d-b16d-5e81f56bdbc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:32.483163 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.483042 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1567a621-41f7-4f0d-b16d-5e81f56bdbc2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bl4krw\" (UID: \"1567a621-41f7-4f0d-b16d-5e81f56bdbc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:32.483163 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.483088 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1567a621-41f7-4f0d-b16d-5e81f56bdbc2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bl4krw\" (UID: \"1567a621-41f7-4f0d-b16d-5e81f56bdbc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:32.483163 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.483110 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1567a621-41f7-4f0d-b16d-5e81f56bdbc2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bl4krw\" (UID: \"1567a621-41f7-4f0d-b16d-5e81f56bdbc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:32.483163 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.483142 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1567a621-41f7-4f0d-b16d-5e81f56bdbc2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bl4krw\" (UID: \"1567a621-41f7-4f0d-b16d-5e81f56bdbc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:32.483434 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.483205 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1567a621-41f7-4f0d-b16d-5e81f56bdbc2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bl4krw\" (UID: \"1567a621-41f7-4f0d-b16d-5e81f56bdbc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:32.483434 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.483224 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwc66\" (UniqueName: \"kubernetes.io/projected/1567a621-41f7-4f0d-b16d-5e81f56bdbc2-kube-api-access-rwc66\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bl4krw\" (UID: \"1567a621-41f7-4f0d-b16d-5e81f56bdbc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:32.583796 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.583759 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1567a621-41f7-4f0d-b16d-5e81f56bdbc2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bl4krw\" (UID: \"1567a621-41f7-4f0d-b16d-5e81f56bdbc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:32.583982 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.583820 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1567a621-41f7-4f0d-b16d-5e81f56bdbc2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bl4krw\" (UID: \"1567a621-41f7-4f0d-b16d-5e81f56bdbc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:32.583982 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.583875 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1567a621-41f7-4f0d-b16d-5e81f56bdbc2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bl4krw\" (UID: \"1567a621-41f7-4f0d-b16d-5e81f56bdbc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:32.583982 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.583910 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1567a621-41f7-4f0d-b16d-5e81f56bdbc2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bl4krw\" (UID: \"1567a621-41f7-4f0d-b16d-5e81f56bdbc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:32.583982 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.583942 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rwc66\" (UniqueName: \"kubernetes.io/projected/1567a621-41f7-4f0d-b16d-5e81f56bdbc2-kube-api-access-rwc66\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bl4krw\" (UID: \"1567a621-41f7-4f0d-b16d-5e81f56bdbc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:32.584208 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.584033 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1567a621-41f7-4f0d-b16d-5e81f56bdbc2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bl4krw\" (UID: \"1567a621-41f7-4f0d-b16d-5e81f56bdbc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:32.584208 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.584063 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1567a621-41f7-4f0d-b16d-5e81f56bdbc2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bl4krw\" (UID: \"1567a621-41f7-4f0d-b16d-5e81f56bdbc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:32.584208 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.584189 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1567a621-41f7-4f0d-b16d-5e81f56bdbc2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bl4krw\" (UID: \"1567a621-41f7-4f0d-b16d-5e81f56bdbc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:32.584996 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.584544 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1567a621-41f7-4f0d-b16d-5e81f56bdbc2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bl4krw\" (UID: \"1567a621-41f7-4f0d-b16d-5e81f56bdbc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:32.584996 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.584605 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1567a621-41f7-4f0d-b16d-5e81f56bdbc2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bl4krw\" (UID: \"1567a621-41f7-4f0d-b16d-5e81f56bdbc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:32.584996 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.584730 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1567a621-41f7-4f0d-b16d-5e81f56bdbc2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bl4krw\" (UID: \"1567a621-41f7-4f0d-b16d-5e81f56bdbc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:32.585270 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.585251 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1567a621-41f7-4f0d-b16d-5e81f56bdbc2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bl4krw\" (UID: \"1567a621-41f7-4f0d-b16d-5e81f56bdbc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:32.585363 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.585344 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1567a621-41f7-4f0d-b16d-5e81f56bdbc2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bl4krw\" (UID: \"1567a621-41f7-4f0d-b16d-5e81f56bdbc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:32.585446 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.585425 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1567a621-41f7-4f0d-b16d-5e81f56bdbc2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bl4krw\" (UID: \"1567a621-41f7-4f0d-b16d-5e81f56bdbc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:32.586852 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.586828 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1567a621-41f7-4f0d-b16d-5e81f56bdbc2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bl4krw\" (UID: \"1567a621-41f7-4f0d-b16d-5e81f56bdbc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:32.587234 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.587211 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1567a621-41f7-4f0d-b16d-5e81f56bdbc2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bl4krw\" (UID: \"1567a621-41f7-4f0d-b16d-5e81f56bdbc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:32.592536 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.592518 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1567a621-41f7-4f0d-b16d-5e81f56bdbc2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bl4krw\" (UID: \"1567a621-41f7-4f0d-b16d-5e81f56bdbc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:32.593551 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.593530 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwc66\" (UniqueName: \"kubernetes.io/projected/1567a621-41f7-4f0d-b16d-5e81f56bdbc2-kube-api-access-rwc66\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bl4krw\" (UID: \"1567a621-41f7-4f0d-b16d-5e81f56bdbc2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:32.703805 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.703724 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:32.745384 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.745342 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5d857d74c6-phn8p" event={"ID":"e545ae33-55da-45cc-bdec-c0321e2fdb52","Type":"ContainerStarted","Data":"b640110715762f0f21c0490af23a60c2cc7d7d42ea614ccbca62dd20987b3d3a"} Jun 02 19:08:32.762175 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.762123 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5d857d74c6-phn8p" podStartSLOduration=1.579419051 podStartE2EDuration="3.762107015s" podCreationTimestamp="2026-06-02 19:08:29 +0000 UTC" firstStartedPulling="2026-06-02 19:08:29.762472213 +0000 UTC m=+313.737373732" lastFinishedPulling="2026-06-02 19:08:31.94516018 +0000 UTC m=+315.920061696" observedRunningTime="2026-06-02 19:08:32.761218435 +0000 UTC m=+316.736119984" watchObservedRunningTime="2026-06-02 19:08:32.762107015 +0000 UTC m=+316.737008552" Jun 02 19:08:32.852787 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:32.852760 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw"] Jun 02 19:08:32.855407 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:08:32.855377 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1567a621_41f7_4f0d_b16d_5e81f56bdbc2.slice/crio-2a7e8ca68ff75f7e27fd8450f3840e351c061fabbd727ac870944a2a0cfaed35 WatchSource:0}: Error finding container 2a7e8ca68ff75f7e27fd8450f3840e351c061fabbd727ac870944a2a0cfaed35: Status 404 returned error can't find the container with id 2a7e8ca68ff75f7e27fd8450f3840e351c061fabbd727ac870944a2a0cfaed35 Jun 02 19:08:33.710521 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:33.710488 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-wt9mk" Jun 02 19:08:33.752583 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:33.752512 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" event={"ID":"1567a621-41f7-4f0d-b16d-5e81f56bdbc2","Type":"ContainerStarted","Data":"2a7e8ca68ff75f7e27fd8450f3840e351c061fabbd727ac870944a2a0cfaed35"} Jun 02 19:08:35.484063 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:35.484014 2557 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 19:08:35.484338 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:35.484096 2557 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 19:08:35.484338 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:35.484123 2557 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 19:08:35.760701 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:35.760625 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" event={"ID":"1567a621-41f7-4f0d-b16d-5e81f56bdbc2","Type":"ContainerStarted","Data":"c5e8367ced41db4e1f95aeb520d7d11d0f7d1491c1df1a3b074fbf993853d147"} Jun 02 19:08:35.786615 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:35.786552 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" podStartSLOduration=1.160157518 podStartE2EDuration="3.786533909s" podCreationTimestamp="2026-06-02 19:08:32 +0000 UTC" firstStartedPulling="2026-06-02 19:08:32.857394454 +0000 UTC m=+316.832295973" lastFinishedPulling="2026-06-02 19:08:35.483770839 +0000 UTC m=+319.458672364" observedRunningTime="2026-06-02 19:08:35.783798033 +0000 UTC m=+319.758699571" watchObservedRunningTime="2026-06-02 19:08:35.786533909 +0000 UTC m=+319.761435447" Jun 02 19:08:36.704823 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:36.704789 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:36.709473 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:36.709451 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:36.764734 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:36.764710 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:36.765382 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:36.765363 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bl4krw" Jun 02 19:08:46.673299 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:46.673270 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-rdwft" Jun 02 19:08:46.676280 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:08:46.676260 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-w62v8" Jun 02 19:09:00.125692 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:00.125660 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wtrr2"] Jun 02 19:09:00.155539 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:00.155509 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wtrr2"] Jun 02 19:09:00.155883 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:00.155855 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wtrr2" Jun 02 19:09:00.172040 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:00.172021 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-l62r6\"" Jun 02 19:09:00.173291 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:00.172416 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 19:09:00.173888 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:00.172460 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 19:09:00.296542 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:00.296518 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlmrp\" (UniqueName: \"kubernetes.io/projected/59698f75-14df-4222-a9a4-6250e7b14b4e-kube-api-access-dlmrp\") pod \"kuadrant-operator-catalog-wtrr2\" (UID: \"59698f75-14df-4222-a9a4-6250e7b14b4e\") " pod="kuadrant-system/kuadrant-operator-catalog-wtrr2" Jun 02 19:09:00.397369 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:00.397292 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dlmrp\" (UniqueName: \"kubernetes.io/projected/59698f75-14df-4222-a9a4-6250e7b14b4e-kube-api-access-dlmrp\") pod \"kuadrant-operator-catalog-wtrr2\" (UID: \"59698f75-14df-4222-a9a4-6250e7b14b4e\") " pod="kuadrant-system/kuadrant-operator-catalog-wtrr2" Jun 02 19:09:00.405742 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:00.405713 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlmrp\" (UniqueName: \"kubernetes.io/projected/59698f75-14df-4222-a9a4-6250e7b14b4e-kube-api-access-dlmrp\") pod \"kuadrant-operator-catalog-wtrr2\" (UID: \"59698f75-14df-4222-a9a4-6250e7b14b4e\") " pod="kuadrant-system/kuadrant-operator-catalog-wtrr2" Jun 02 19:09:00.466339 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:00.466301 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wtrr2"] Jun 02 19:09:00.466535 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:00.466523 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wtrr2" Jun 02 19:09:00.594516 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:00.594487 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wtrr2"] Jun 02 19:09:00.596765 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:09:00.596729 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59698f75_14df_4222_a9a4_6250e7b14b4e.slice/crio-5553d88fc0d2225e56276e368351471cdf2753a7739b737da54ccf2b3fba423a WatchSource:0}: Error finding container 5553d88fc0d2225e56276e368351471cdf2753a7739b737da54ccf2b3fba423a: Status 404 returned error can't find the container with id 5553d88fc0d2225e56276e368351471cdf2753a7739b737da54ccf2b3fba423a Jun 02 19:09:00.676539 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:00.676475 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n6bbt"] Jun 02 19:09:00.681222 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:00.681202 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n6bbt" Jun 02 19:09:00.686751 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:00.686730 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n6bbt"] Jun 02 19:09:00.799546 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:00.799519 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stchn\" (UniqueName: \"kubernetes.io/projected/44fbe30a-ba29-4398-8c22-0b8015de51e1-kube-api-access-stchn\") pod \"kuadrant-operator-catalog-n6bbt\" (UID: \"44fbe30a-ba29-4398-8c22-0b8015de51e1\") " pod="kuadrant-system/kuadrant-operator-catalog-n6bbt" Jun 02 19:09:00.849464 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:00.849440 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wtrr2" event={"ID":"59698f75-14df-4222-a9a4-6250e7b14b4e","Type":"ContainerStarted","Data":"5553d88fc0d2225e56276e368351471cdf2753a7739b737da54ccf2b3fba423a"} Jun 02 19:09:00.900568 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:00.900540 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-stchn\" (UniqueName: \"kubernetes.io/projected/44fbe30a-ba29-4398-8c22-0b8015de51e1-kube-api-access-stchn\") pod \"kuadrant-operator-catalog-n6bbt\" (UID: \"44fbe30a-ba29-4398-8c22-0b8015de51e1\") " pod="kuadrant-system/kuadrant-operator-catalog-n6bbt" Jun 02 19:09:00.909021 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:00.908994 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stchn\" (UniqueName: \"kubernetes.io/projected/44fbe30a-ba29-4398-8c22-0b8015de51e1-kube-api-access-stchn\") pod \"kuadrant-operator-catalog-n6bbt\" (UID: \"44fbe30a-ba29-4398-8c22-0b8015de51e1\") " pod="kuadrant-system/kuadrant-operator-catalog-n6bbt" Jun 02 19:09:00.992258 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:00.992205 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n6bbt" Jun 02 19:09:01.122372 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:01.122348 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n6bbt"] Jun 02 19:09:01.124341 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:09:01.124269 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44fbe30a_ba29_4398_8c22_0b8015de51e1.slice/crio-4f57a18245ecb2f578a6811e6535f340709e67aa4d3a52835f7bf6ab11ff6e5d WatchSource:0}: Error finding container 4f57a18245ecb2f578a6811e6535f340709e67aa4d3a52835f7bf6ab11ff6e5d: Status 404 returned error can't find the container with id 4f57a18245ecb2f578a6811e6535f340709e67aa4d3a52835f7bf6ab11ff6e5d Jun 02 19:09:01.855097 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:01.855056 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n6bbt" event={"ID":"44fbe30a-ba29-4398-8c22-0b8015de51e1","Type":"ContainerStarted","Data":"4f57a18245ecb2f578a6811e6535f340709e67aa4d3a52835f7bf6ab11ff6e5d"} Jun 02 19:09:03.863164 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:03.863129 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wtrr2" event={"ID":"59698f75-14df-4222-a9a4-6250e7b14b4e","Type":"ContainerStarted","Data":"d417f520916412c3e1c891d182cb487dcedcbfb3b50bacba5efa05771a7ea520"} Jun 02 19:09:03.863625 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:03.863207 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-wtrr2" podUID="59698f75-14df-4222-a9a4-6250e7b14b4e" containerName="registry-server" containerID="cri-o://d417f520916412c3e1c891d182cb487dcedcbfb3b50bacba5efa05771a7ea520" gracePeriod=2 Jun 02 19:09:03.864606 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:03.864575 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n6bbt" event={"ID":"44fbe30a-ba29-4398-8c22-0b8015de51e1","Type":"ContainerStarted","Data":"66303484f86bf2303ba5d7fd5c8bf9a22990098cfbc36d5c187ddc368ea592bd"} Jun 02 19:09:03.878946 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:03.878903 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-wtrr2" podStartSLOduration=1.551352646 podStartE2EDuration="3.87888921s" podCreationTimestamp="2026-06-02 19:09:00 +0000 UTC" firstStartedPulling="2026-06-02 19:09:00.597965087 +0000 UTC m=+344.572866605" lastFinishedPulling="2026-06-02 19:09:02.925501654 +0000 UTC m=+346.900403169" observedRunningTime="2026-06-02 19:09:03.878588891 +0000 UTC m=+347.853490429" watchObservedRunningTime="2026-06-02 19:09:03.87888921 +0000 UTC m=+347.853790747" Jun 02 19:09:03.893477 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:03.893442 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-n6bbt" podStartSLOduration=2.091467365 podStartE2EDuration="3.893431719s" podCreationTimestamp="2026-06-02 19:09:00 +0000 UTC" firstStartedPulling="2026-06-02 19:09:01.126116475 +0000 UTC m=+345.101017998" lastFinishedPulling="2026-06-02 19:09:02.928080819 +0000 UTC m=+346.902982352" observedRunningTime="2026-06-02 19:09:03.892800353 +0000 UTC m=+347.867701891" watchObservedRunningTime="2026-06-02 19:09:03.893431719 +0000 UTC m=+347.868333257" Jun 02 19:09:04.111471 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:04.111449 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wtrr2" Jun 02 19:09:04.231162 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:04.231098 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlmrp\" (UniqueName: \"kubernetes.io/projected/59698f75-14df-4222-a9a4-6250e7b14b4e-kube-api-access-dlmrp\") pod \"59698f75-14df-4222-a9a4-6250e7b14b4e\" (UID: \"59698f75-14df-4222-a9a4-6250e7b14b4e\") " Jun 02 19:09:04.233182 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:04.233160 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59698f75-14df-4222-a9a4-6250e7b14b4e-kube-api-access-dlmrp" (OuterVolumeSpecName: "kube-api-access-dlmrp") pod "59698f75-14df-4222-a9a4-6250e7b14b4e" (UID: "59698f75-14df-4222-a9a4-6250e7b14b4e"). InnerVolumeSpecName "kube-api-access-dlmrp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:09:04.332048 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:04.332026 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlmrp\" (UniqueName: \"kubernetes.io/projected/59698f75-14df-4222-a9a4-6250e7b14b4e-kube-api-access-dlmrp\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 19:09:04.868749 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:04.868712 2557 generic.go:358] "Generic (PLEG): container finished" podID="59698f75-14df-4222-a9a4-6250e7b14b4e" containerID="d417f520916412c3e1c891d182cb487dcedcbfb3b50bacba5efa05771a7ea520" exitCode=0 Jun 02 19:09:04.869173 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:04.868766 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wtrr2" Jun 02 19:09:04.869173 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:04.868796 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wtrr2" event={"ID":"59698f75-14df-4222-a9a4-6250e7b14b4e","Type":"ContainerDied","Data":"d417f520916412c3e1c891d182cb487dcedcbfb3b50bacba5efa05771a7ea520"} Jun 02 19:09:04.869173 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:04.868841 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wtrr2" event={"ID":"59698f75-14df-4222-a9a4-6250e7b14b4e","Type":"ContainerDied","Data":"5553d88fc0d2225e56276e368351471cdf2753a7739b737da54ccf2b3fba423a"} Jun 02 19:09:04.869173 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:04.868864 2557 scope.go:117] "RemoveContainer" containerID="d417f520916412c3e1c891d182cb487dcedcbfb3b50bacba5efa05771a7ea520" Jun 02 19:09:04.878183 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:04.878165 2557 scope.go:117] "RemoveContainer" containerID="d417f520916412c3e1c891d182cb487dcedcbfb3b50bacba5efa05771a7ea520" Jun 02 19:09:04.878595 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:09:04.878574 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d417f520916412c3e1c891d182cb487dcedcbfb3b50bacba5efa05771a7ea520\": container with ID starting with d417f520916412c3e1c891d182cb487dcedcbfb3b50bacba5efa05771a7ea520 not found: ID does not exist" containerID="d417f520916412c3e1c891d182cb487dcedcbfb3b50bacba5efa05771a7ea520" Jun 02 19:09:04.878737 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:04.878712 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d417f520916412c3e1c891d182cb487dcedcbfb3b50bacba5efa05771a7ea520"} err="failed to get container status \"d417f520916412c3e1c891d182cb487dcedcbfb3b50bacba5efa05771a7ea520\": rpc error: code = NotFound desc = could not find container \"d417f520916412c3e1c891d182cb487dcedcbfb3b50bacba5efa05771a7ea520\": container with ID starting with d417f520916412c3e1c891d182cb487dcedcbfb3b50bacba5efa05771a7ea520 not found: ID does not exist" Jun 02 19:09:04.888062 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:04.888040 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wtrr2"] Jun 02 19:09:04.891458 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:04.891440 2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wtrr2"] Jun 02 19:09:06.554664 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:06.554631 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59698f75-14df-4222-a9a4-6250e7b14b4e" path="/var/lib/kubelet/pods/59698f75-14df-4222-a9a4-6250e7b14b4e/volumes" Jun 02 19:09:10.992855 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:10.992823 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-n6bbt" Jun 02 19:09:10.993350 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:10.992867 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-n6bbt" Jun 02 19:09:11.014821 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:11.014793 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-n6bbt" Jun 02 19:09:11.912959 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:11.912932 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-n6bbt" Jun 02 19:09:26.338335 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:26.338276 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pztvl"] Jun 02 19:09:26.338893 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:26.338854 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59698f75-14df-4222-a9a4-6250e7b14b4e" containerName="registry-server" Jun 02 19:09:26.338893 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:26.338874 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="59698f75-14df-4222-a9a4-6250e7b14b4e" containerName="registry-server" Jun 02 19:09:26.339019 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:26.338984 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="59698f75-14df-4222-a9a4-6250e7b14b4e" containerName="registry-server" Jun 02 19:09:26.351275 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:26.351247 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pztvl" Jun 02 19:09:26.355682 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:26.355660 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-cpl9k\"" Jun 02 19:09:26.356668 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:26.356642 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pztvl"] Jun 02 19:09:26.387280 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:26.387251 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9sr4\" (UniqueName: \"kubernetes.io/projected/961be4c7-cb00-4457-b549-99460a0aaba3-kube-api-access-t9sr4\") pod \"limitador-operator-controller-manager-85c4996f8c-pztvl\" (UID: \"961be4c7-cb00-4457-b549-99460a0aaba3\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pztvl" Jun 02 19:09:26.488180 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:26.488152 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t9sr4\" (UniqueName: \"kubernetes.io/projected/961be4c7-cb00-4457-b549-99460a0aaba3-kube-api-access-t9sr4\") pod \"limitador-operator-controller-manager-85c4996f8c-pztvl\" (UID: \"961be4c7-cb00-4457-b549-99460a0aaba3\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pztvl" Jun 02 19:09:26.500279 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:26.500254 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9sr4\" (UniqueName: \"kubernetes.io/projected/961be4c7-cb00-4457-b549-99460a0aaba3-kube-api-access-t9sr4\") pod \"limitador-operator-controller-manager-85c4996f8c-pztvl\" (UID: \"961be4c7-cb00-4457-b549-99460a0aaba3\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pztvl" Jun 02 19:09:26.661873 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:26.661810 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pztvl" Jun 02 19:09:26.797339 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:26.797294 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pztvl"] Jun 02 19:09:26.799610 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:09:26.799584 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod961be4c7_cb00_4457_b549_99460a0aaba3.slice/crio-ad0f7aa81d9dc5828ca5ca57e476d9fb9257556df5552717d4e505541ff09160 WatchSource:0}: Error finding container ad0f7aa81d9dc5828ca5ca57e476d9fb9257556df5552717d4e505541ff09160: Status 404 returned error can't find the container with id ad0f7aa81d9dc5828ca5ca57e476d9fb9257556df5552717d4e505541ff09160 Jun 02 19:09:26.941207 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:26.941147 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pztvl" event={"ID":"961be4c7-cb00-4457-b549-99460a0aaba3","Type":"ContainerStarted","Data":"ad0f7aa81d9dc5828ca5ca57e476d9fb9257556df5552717d4e505541ff09160"} Jun 02 19:09:28.950290 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:28.950259 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pztvl" event={"ID":"961be4c7-cb00-4457-b549-99460a0aaba3","Type":"ContainerStarted","Data":"9f02dbdf5cd844e918951b1ffdddb8b7783d799a9aaa3459941e3db73ee202d9"} Jun 02 19:09:28.950715 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:28.950378 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pztvl" Jun 02 19:09:28.967958 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:28.967918 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pztvl" podStartSLOduration=1.3244474130000001 podStartE2EDuration="2.967904174s" podCreationTimestamp="2026-06-02 19:09:26 +0000 UTC" firstStartedPulling="2026-06-02 19:09:26.801763473 +0000 UTC m=+370.776664987" lastFinishedPulling="2026-06-02 19:09:28.445220233 +0000 UTC m=+372.420121748" observedRunningTime="2026-06-02 19:09:28.967193494 +0000 UTC m=+372.942095032" watchObservedRunningTime="2026-06-02 19:09:28.967904174 +0000 UTC m=+372.942805711" Jun 02 19:09:30.597471 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:30.597441 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-crz4v"] Jun 02 19:09:30.601076 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:30.601061 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-crz4v" Jun 02 19:09:30.603806 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:30.603788 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-v2w9s\"" Jun 02 19:09:30.609908 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:30.609887 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-crz4v"] Jun 02 19:09:30.621296 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:30.621271 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hksqd\" (UniqueName: \"kubernetes.io/projected/4681a170-af3a-413d-be38-f622e5489c5f-kube-api-access-hksqd\") pod \"authorino-operator-657f44b778-crz4v\" (UID: \"4681a170-af3a-413d-be38-f622e5489c5f\") " pod="kuadrant-system/authorino-operator-657f44b778-crz4v" Jun 02 19:09:30.722392 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:30.722367 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hksqd\" (UniqueName: \"kubernetes.io/projected/4681a170-af3a-413d-be38-f622e5489c5f-kube-api-access-hksqd\") pod \"authorino-operator-657f44b778-crz4v\" (UID: \"4681a170-af3a-413d-be38-f622e5489c5f\") " pod="kuadrant-system/authorino-operator-657f44b778-crz4v" Jun 02 19:09:30.735718 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:30.735692 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hksqd\" (UniqueName: \"kubernetes.io/projected/4681a170-af3a-413d-be38-f622e5489c5f-kube-api-access-hksqd\") pod \"authorino-operator-657f44b778-crz4v\" (UID: \"4681a170-af3a-413d-be38-f622e5489c5f\") " pod="kuadrant-system/authorino-operator-657f44b778-crz4v" Jun 02 19:09:30.912509 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:30.912441 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-crz4v" Jun 02 19:09:31.049634 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:31.049612 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-crz4v"] Jun 02 19:09:31.051686 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:09:31.051659 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4681a170_af3a_413d_be38_f622e5489c5f.slice/crio-2fe1d44640ae37944a9fa3665a335c68bfc067de28aaac3b12f17481a32633ba WatchSource:0}: Error finding container 2fe1d44640ae37944a9fa3665a335c68bfc067de28aaac3b12f17481a32633ba: Status 404 returned error can't find the container with id 2fe1d44640ae37944a9fa3665a335c68bfc067de28aaac3b12f17481a32633ba Jun 02 19:09:31.962321 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:31.962273 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-crz4v" event={"ID":"4681a170-af3a-413d-be38-f622e5489c5f","Type":"ContainerStarted","Data":"2fe1d44640ae37944a9fa3665a335c68bfc067de28aaac3b12f17481a32633ba"} Jun 02 19:09:34.976154 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:34.976119 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-crz4v" event={"ID":"4681a170-af3a-413d-be38-f622e5489c5f","Type":"ContainerStarted","Data":"c7fe9f729c60c3ee303a5e700c75a885d3771fdec804949283d3186d42a22e50"} Jun 02 19:09:34.976613 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:34.976166 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-crz4v" Jun 02 19:09:34.994207 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:34.994157 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-crz4v" podStartSLOduration=1.840658403 podStartE2EDuration="4.99414246s" podCreationTimestamp="2026-06-02 19:09:30 +0000 UTC" firstStartedPulling="2026-06-02 19:09:31.053774348 +0000 UTC m=+375.028675864" lastFinishedPulling="2026-06-02 19:09:34.20725839 +0000 UTC m=+378.182159921" observedRunningTime="2026-06-02 19:09:34.992650927 +0000 UTC m=+378.967552463" watchObservedRunningTime="2026-06-02 19:09:34.99414246 +0000 UTC m=+378.969043997" Jun 02 19:09:39.956217 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:39.956180 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pztvl" Jun 02 19:09:45.983398 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:45.983372 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-crz4v" Jun 02 19:09:54.803325 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:54.803272 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pztvl"] Jun 02 19:09:54.803791 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:54.803515 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pztvl" podUID="961be4c7-cb00-4457-b549-99460a0aaba3" containerName="manager" containerID="cri-o://9f02dbdf5cd844e918951b1ffdddb8b7783d799a9aaa3459941e3db73ee202d9" gracePeriod=2 Jun 02 19:09:54.813988 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:54.813962 2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pztvl"] Jun 02 19:09:54.833558 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:54.833530 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qgkpf"] Jun 02 19:09:54.834137 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:54.834118 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="961be4c7-cb00-4457-b549-99460a0aaba3" containerName="manager" Jun 02 19:09:54.834214 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:54.834142 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="961be4c7-cb00-4457-b549-99460a0aaba3" containerName="manager" Jun 02 19:09:54.834275 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:54.834233 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="961be4c7-cb00-4457-b549-99460a0aaba3" containerName="manager" Jun 02 19:09:54.837567 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:54.837549 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qgkpf" Jun 02 19:09:54.840680 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:54.840657 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-q6wps\"" Jun 02 19:09:54.866598 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:54.866574 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qgkpf"] Jun 02 19:09:54.910321 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:54.910273 2557 status_manager.go:895] "Failed to get status for pod" podUID="961be4c7-cb00-4457-b549-99460a0aaba3" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pztvl" err="pods \"limitador-operator-controller-manager-85c4996f8c-pztvl\" is forbidden: User \"system:node:ip-10-0-141-177.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-177.ec2.internal' and this object" Jun 02 19:09:54.911603 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:54.911578 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25ff44c9-2b84-46df-b456-7b3d241a7af0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-qgkpf\" (UID: \"25ff44c9-2b84-46df-b456-7b3d241a7af0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qgkpf" Jun 02 19:09:54.911718 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:54.911630 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prwmp\" (UniqueName: \"kubernetes.io/projected/25ff44c9-2b84-46df-b456-7b3d241a7af0-kube-api-access-prwmp\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-qgkpf\" (UID: \"25ff44c9-2b84-46df-b456-7b3d241a7af0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qgkpf" Jun 02 19:09:55.012866 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:55.012836 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25ff44c9-2b84-46df-b456-7b3d241a7af0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-qgkpf\" (UID: \"25ff44c9-2b84-46df-b456-7b3d241a7af0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qgkpf" Jun 02 19:09:55.013032 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:55.012899 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-prwmp\" (UniqueName: \"kubernetes.io/projected/25ff44c9-2b84-46df-b456-7b3d241a7af0-kube-api-access-prwmp\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-qgkpf\" (UID: \"25ff44c9-2b84-46df-b456-7b3d241a7af0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qgkpf" Jun 02 19:09:55.013206 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:55.013187 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25ff44c9-2b84-46df-b456-7b3d241a7af0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-qgkpf\" (UID: \"25ff44c9-2b84-46df-b456-7b3d241a7af0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qgkpf" Jun 02 19:09:55.026319 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:55.026278 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prwmp\" (UniqueName: \"kubernetes.io/projected/25ff44c9-2b84-46df-b456-7b3d241a7af0-kube-api-access-prwmp\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-qgkpf\" (UID: \"25ff44c9-2b84-46df-b456-7b3d241a7af0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qgkpf" Jun 02 19:09:55.042958 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:55.042939 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pztvl" Jun 02 19:09:55.045663 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:55.045634 2557 status_manager.go:895] "Failed to get status for pod" podUID="961be4c7-cb00-4457-b549-99460a0aaba3" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pztvl" err="pods \"limitador-operator-controller-manager-85c4996f8c-pztvl\" is forbidden: User \"system:node:ip-10-0-141-177.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-177.ec2.internal' and this object" Jun 02 19:09:55.046586 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:55.046566 2557 generic.go:358] "Generic (PLEG): container finished" podID="961be4c7-cb00-4457-b549-99460a0aaba3" containerID="9f02dbdf5cd844e918951b1ffdddb8b7783d799a9aaa3459941e3db73ee202d9" exitCode=0 Jun 02 19:09:55.046665 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:55.046601 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pztvl" Jun 02 19:09:55.046709 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:55.046664 2557 scope.go:117] "RemoveContainer" containerID="9f02dbdf5cd844e918951b1ffdddb8b7783d799a9aaa3459941e3db73ee202d9" Jun 02 19:09:55.048967 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:55.048942 2557 status_manager.go:895] "Failed to get status for pod" podUID="961be4c7-cb00-4457-b549-99460a0aaba3" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pztvl" err="pods \"limitador-operator-controller-manager-85c4996f8c-pztvl\" is forbidden: User \"system:node:ip-10-0-141-177.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-177.ec2.internal' and this object" Jun 02 19:09:55.054839 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:55.054822 2557 scope.go:117] "RemoveContainer" containerID="9f02dbdf5cd844e918951b1ffdddb8b7783d799a9aaa3459941e3db73ee202d9" Jun 02 19:09:55.055100 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:09:55.055083 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f02dbdf5cd844e918951b1ffdddb8b7783d799a9aaa3459941e3db73ee202d9\": container with ID starting with 9f02dbdf5cd844e918951b1ffdddb8b7783d799a9aaa3459941e3db73ee202d9 not found: ID does not exist" containerID="9f02dbdf5cd844e918951b1ffdddb8b7783d799a9aaa3459941e3db73ee202d9" Jun 02 19:09:55.055156 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:55.055110 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f02dbdf5cd844e918951b1ffdddb8b7783d799a9aaa3459941e3db73ee202d9"} err="failed to get container status \"9f02dbdf5cd844e918951b1ffdddb8b7783d799a9aaa3459941e3db73ee202d9\": rpc error: code = NotFound desc = could not find container \"9f02dbdf5cd844e918951b1ffdddb8b7783d799a9aaa3459941e3db73ee202d9\": container with ID starting with 9f02dbdf5cd844e918951b1ffdddb8b7783d799a9aaa3459941e3db73ee202d9 not found: ID does not exist" Jun 02 19:09:55.113705 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:55.113682 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9sr4\" (UniqueName: \"kubernetes.io/projected/961be4c7-cb00-4457-b549-99460a0aaba3-kube-api-access-t9sr4\") pod \"961be4c7-cb00-4457-b549-99460a0aaba3\" (UID: \"961be4c7-cb00-4457-b549-99460a0aaba3\") " Jun 02 19:09:55.115533 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:55.115506 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/961be4c7-cb00-4457-b549-99460a0aaba3-kube-api-access-t9sr4" (OuterVolumeSpecName: "kube-api-access-t9sr4") pod "961be4c7-cb00-4457-b549-99460a0aaba3" (UID: "961be4c7-cb00-4457-b549-99460a0aaba3"). InnerVolumeSpecName "kube-api-access-t9sr4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:09:55.172789 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:55.172755 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qgkpf" Jun 02 19:09:55.214683 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:55.214648 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9sr4\" (UniqueName: \"kubernetes.io/projected/961be4c7-cb00-4457-b549-99460a0aaba3-kube-api-access-t9sr4\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 19:09:55.341638 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:55.341615 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qgkpf"] Jun 02 19:09:55.343189 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:09:55.343162 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25ff44c9_2b84_46df_b456_7b3d241a7af0.slice/crio-d6a3cf563c7199e01acf397ff450814be9e8663554de238f1ce29786d77c399f WatchSource:0}: Error finding container d6a3cf563c7199e01acf397ff450814be9e8663554de238f1ce29786d77c399f: Status 404 returned error can't find the container with id d6a3cf563c7199e01acf397ff450814be9e8663554de238f1ce29786d77c399f Jun 02 19:09:55.358270 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:55.358242 2557 status_manager.go:895] "Failed to get status for pod" podUID="961be4c7-cb00-4457-b549-99460a0aaba3" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pztvl" err="pods \"limitador-operator-controller-manager-85c4996f8c-pztvl\" is forbidden: User \"system:node:ip-10-0-141-177.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-177.ec2.internal' and this object" Jun 02 19:09:56.052484 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:56.052449 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qgkpf" event={"ID":"25ff44c9-2b84-46df-b456-7b3d241a7af0","Type":"ContainerStarted","Data":"d6a3cf563c7199e01acf397ff450814be9e8663554de238f1ce29786d77c399f"} Jun 02 19:09:56.556813 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:56.555559 2557 status_manager.go:895] "Failed to get status for pod" podUID="961be4c7-cb00-4457-b549-99460a0aaba3" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pztvl" err="pods \"limitador-operator-controller-manager-85c4996f8c-pztvl\" is forbidden: User \"system:node:ip-10-0-141-177.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-177.ec2.internal' and this object" Jun 02 19:09:56.557275 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:09:56.557254 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="961be4c7-cb00-4457-b549-99460a0aaba3" path="/var/lib/kubelet/pods/961be4c7-cb00-4457-b549-99460a0aaba3/volumes" Jun 02 19:10:00.073430 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:00.073352 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qgkpf" event={"ID":"25ff44c9-2b84-46df-b456-7b3d241a7af0","Type":"ContainerStarted","Data":"893195d0231ca99c365e08425a7501ccf4d1ca35e63f98d6956a21bc7e60467e"} Jun 02 19:10:00.073855 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:00.073471 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qgkpf" Jun 02 19:10:00.093470 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:00.093428 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qgkpf" podStartSLOduration=1.7093947 podStartE2EDuration="6.093416158s" podCreationTimestamp="2026-06-02 19:09:54 +0000 UTC" firstStartedPulling="2026-06-02 19:09:55.345552164 +0000 UTC m=+399.320453678" lastFinishedPulling="2026-06-02 19:09:59.729573618 +0000 UTC m=+403.704475136" observedRunningTime="2026-06-02 19:10:00.091960482 +0000 UTC m=+404.066862044" watchObservedRunningTime="2026-06-02 19:10:00.093416158 +0000 UTC m=+404.068317694" Jun 02 19:10:07.103289 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:07.103255 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qgkpf"] Jun 02 19:10:07.103694 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:07.103486 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qgkpf" podUID="25ff44c9-2b84-46df-b456-7b3d241a7af0" containerName="manager" containerID="cri-o://893195d0231ca99c365e08425a7501ccf4d1ca35e63f98d6956a21bc7e60467e" gracePeriod=10 Jun 02 19:10:07.105032 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:07.105004 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qgkpf" Jun 02 19:10:07.360162 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:07.360109 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qgkpf" Jun 02 19:10:07.517202 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:07.517174 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25ff44c9-2b84-46df-b456-7b3d241a7af0-extensions-socket-volume\") pod \"25ff44c9-2b84-46df-b456-7b3d241a7af0\" (UID: \"25ff44c9-2b84-46df-b456-7b3d241a7af0\") " Jun 02 19:10:07.517202 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:07.517206 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prwmp\" (UniqueName: \"kubernetes.io/projected/25ff44c9-2b84-46df-b456-7b3d241a7af0-kube-api-access-prwmp\") pod \"25ff44c9-2b84-46df-b456-7b3d241a7af0\" (UID: \"25ff44c9-2b84-46df-b456-7b3d241a7af0\") " Jun 02 19:10:07.517615 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:07.517589 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25ff44c9-2b84-46df-b456-7b3d241a7af0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "25ff44c9-2b84-46df-b456-7b3d241a7af0" (UID: "25ff44c9-2b84-46df-b456-7b3d241a7af0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 19:10:07.519219 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:07.519199 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25ff44c9-2b84-46df-b456-7b3d241a7af0-kube-api-access-prwmp" (OuterVolumeSpecName: "kube-api-access-prwmp") pod "25ff44c9-2b84-46df-b456-7b3d241a7af0" (UID: "25ff44c9-2b84-46df-b456-7b3d241a7af0"). InnerVolumeSpecName "kube-api-access-prwmp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:10:07.617999 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:07.617944 2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25ff44c9-2b84-46df-b456-7b3d241a7af0-extensions-socket-volume\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 19:10:07.617999 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:07.617963 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prwmp\" (UniqueName: \"kubernetes.io/projected/25ff44c9-2b84-46df-b456-7b3d241a7af0-kube-api-access-prwmp\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 19:10:08.100938 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:08.100903 2557 generic.go:358] "Generic (PLEG): container finished" podID="25ff44c9-2b84-46df-b456-7b3d241a7af0" containerID="893195d0231ca99c365e08425a7501ccf4d1ca35e63f98d6956a21bc7e60467e" exitCode=0 Jun 02 19:10:08.101088 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:08.100945 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qgkpf" event={"ID":"25ff44c9-2b84-46df-b456-7b3d241a7af0","Type":"ContainerDied","Data":"893195d0231ca99c365e08425a7501ccf4d1ca35e63f98d6956a21bc7e60467e"} Jun 02 19:10:08.101088 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:08.100961 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qgkpf" Jun 02 19:10:08.101088 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:08.100970 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qgkpf" event={"ID":"25ff44c9-2b84-46df-b456-7b3d241a7af0","Type":"ContainerDied","Data":"d6a3cf563c7199e01acf397ff450814be9e8663554de238f1ce29786d77c399f"} Jun 02 19:10:08.101088 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:08.100989 2557 scope.go:117] "RemoveContainer" containerID="893195d0231ca99c365e08425a7501ccf4d1ca35e63f98d6956a21bc7e60467e" Jun 02 19:10:08.109709 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:08.109560 2557 scope.go:117] "RemoveContainer" containerID="893195d0231ca99c365e08425a7501ccf4d1ca35e63f98d6956a21bc7e60467e" Jun 02 19:10:08.109916 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:10:08.109760 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"893195d0231ca99c365e08425a7501ccf4d1ca35e63f98d6956a21bc7e60467e\": container with ID starting with 893195d0231ca99c365e08425a7501ccf4d1ca35e63f98d6956a21bc7e60467e not found: ID does not exist" containerID="893195d0231ca99c365e08425a7501ccf4d1ca35e63f98d6956a21bc7e60467e" Jun 02 19:10:08.109916 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:08.109803 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"893195d0231ca99c365e08425a7501ccf4d1ca35e63f98d6956a21bc7e60467e"} err="failed to get container status \"893195d0231ca99c365e08425a7501ccf4d1ca35e63f98d6956a21bc7e60467e\": rpc error: code = NotFound desc = could not find container \"893195d0231ca99c365e08425a7501ccf4d1ca35e63f98d6956a21bc7e60467e\": container with ID starting with 893195d0231ca99c365e08425a7501ccf4d1ca35e63f98d6956a21bc7e60467e not found: ID does not exist" Jun 02 19:10:08.125977 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:08.125957 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qgkpf"] Jun 02 19:10:08.132520 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:08.132500 2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qgkpf"] Jun 02 19:10:08.554278 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:08.554207 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25ff44c9-2b84-46df-b456-7b3d241a7af0" path="/var/lib/kubelet/pods/25ff44c9-2b84-46df-b456-7b3d241a7af0/volumes" Jun 02 19:10:23.354652 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.354617 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb"] Jun 02 19:10:23.355002 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.354979 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25ff44c9-2b84-46df-b456-7b3d241a7af0" containerName="manager" Jun 02 19:10:23.355002 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.354990 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="25ff44c9-2b84-46df-b456-7b3d241a7af0" containerName="manager" Jun 02 19:10:23.355077 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.355057 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="25ff44c9-2b84-46df-b456-7b3d241a7af0" containerName="manager" Jun 02 19:10:23.359697 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.359675 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:23.362614 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.362592 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-7kzlr\"" Jun 02 19:10:23.373386 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.371823 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb"] Jun 02 19:10:23.539897 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.539859 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71138766-b600-428f-91ef-b49974041fbc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gznvb\" (UID: \"71138766-b600-428f-91ef-b49974041fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:23.539897 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.539901 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71138766-b600-428f-91ef-b49974041fbc-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gznvb\" (UID: \"71138766-b600-428f-91ef-b49974041fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:23.540100 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.539930 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71138766-b600-428f-91ef-b49974041fbc-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gznvb\" (UID: \"71138766-b600-428f-91ef-b49974041fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:23.540100 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.540016 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71138766-b600-428f-91ef-b49974041fbc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gznvb\" (UID: \"71138766-b600-428f-91ef-b49974041fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:23.540100 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.540057 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94tsn\" (UniqueName: \"kubernetes.io/projected/71138766-b600-428f-91ef-b49974041fbc-kube-api-access-94tsn\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gznvb\" (UID: \"71138766-b600-428f-91ef-b49974041fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:23.540100 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.540088 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71138766-b600-428f-91ef-b49974041fbc-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gznvb\" (UID: \"71138766-b600-428f-91ef-b49974041fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:23.540225 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.540176 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71138766-b600-428f-91ef-b49974041fbc-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gznvb\" (UID: \"71138766-b600-428f-91ef-b49974041fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:23.540258 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.540221 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71138766-b600-428f-91ef-b49974041fbc-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gznvb\" (UID: \"71138766-b600-428f-91ef-b49974041fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:23.540258 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.540243 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71138766-b600-428f-91ef-b49974041fbc-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gznvb\" (UID: \"71138766-b600-428f-91ef-b49974041fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:23.641059 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.640983 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71138766-b600-428f-91ef-b49974041fbc-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gznvb\" (UID: \"71138766-b600-428f-91ef-b49974041fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:23.641059 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.641020 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71138766-b600-428f-91ef-b49974041fbc-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gznvb\" (UID: \"71138766-b600-428f-91ef-b49974041fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:23.641059 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.641043 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71138766-b600-428f-91ef-b49974041fbc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gznvb\" (UID: \"71138766-b600-428f-91ef-b49974041fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:23.641059 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.641061 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71138766-b600-428f-91ef-b49974041fbc-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gznvb\" (UID: \"71138766-b600-428f-91ef-b49974041fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:23.641400 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.641078 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71138766-b600-428f-91ef-b49974041fbc-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gznvb\" (UID: \"71138766-b600-428f-91ef-b49974041fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:23.641400 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.641119 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71138766-b600-428f-91ef-b49974041fbc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gznvb\" (UID: \"71138766-b600-428f-91ef-b49974041fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:23.641400 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.641151 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-94tsn\" (UniqueName: \"kubernetes.io/projected/71138766-b600-428f-91ef-b49974041fbc-kube-api-access-94tsn\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gznvb\" (UID: \"71138766-b600-428f-91ef-b49974041fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:23.641400 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.641196 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71138766-b600-428f-91ef-b49974041fbc-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gznvb\" (UID: \"71138766-b600-428f-91ef-b49974041fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:23.641400 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.641259 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71138766-b600-428f-91ef-b49974041fbc-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gznvb\" (UID: \"71138766-b600-428f-91ef-b49974041fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:23.641654 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.641447 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71138766-b600-428f-91ef-b49974041fbc-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gznvb\" (UID: \"71138766-b600-428f-91ef-b49974041fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:23.641654 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.641509 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71138766-b600-428f-91ef-b49974041fbc-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gznvb\" (UID: \"71138766-b600-428f-91ef-b49974041fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:23.641654 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.641598 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71138766-b600-428f-91ef-b49974041fbc-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gznvb\" (UID: \"71138766-b600-428f-91ef-b49974041fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:23.641834 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.641815 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71138766-b600-428f-91ef-b49974041fbc-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gznvb\" (UID: \"71138766-b600-428f-91ef-b49974041fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:23.641918 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.641898 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71138766-b600-428f-91ef-b49974041fbc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gznvb\" (UID: \"71138766-b600-428f-91ef-b49974041fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:23.643809 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.643787 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71138766-b600-428f-91ef-b49974041fbc-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gznvb\" (UID: \"71138766-b600-428f-91ef-b49974041fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:23.643883 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.643821 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71138766-b600-428f-91ef-b49974041fbc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gznvb\" (UID: \"71138766-b600-428f-91ef-b49974041fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:23.649956 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.649930 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71138766-b600-428f-91ef-b49974041fbc-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gznvb\" (UID: \"71138766-b600-428f-91ef-b49974041fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:23.650182 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.650166 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94tsn\" (UniqueName: \"kubernetes.io/projected/71138766-b600-428f-91ef-b49974041fbc-kube-api-access-94tsn\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-gznvb\" (UID: \"71138766-b600-428f-91ef-b49974041fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:23.678303 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.678281 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:23.834603 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.834574 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb"] Jun 02 19:10:23.837543 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:10:23.837516 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71138766_b600_428f_91ef_b49974041fbc.slice/crio-0d6606e635f6b40ce0fcd7ca168b43510079e37cb1b7cc43872896ae130525ca WatchSource:0}: Error finding container 0d6606e635f6b40ce0fcd7ca168b43510079e37cb1b7cc43872896ae130525ca: Status 404 returned error can't find the container with id 0d6606e635f6b40ce0fcd7ca168b43510079e37cb1b7cc43872896ae130525ca Jun 02 19:10:23.840225 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.840186 2557 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 19:10:23.840295 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.840280 2557 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 19:10:23.840371 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:23.840338 2557 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 19:10:24.158215 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:24.158132 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" event={"ID":"71138766-b600-428f-91ef-b49974041fbc","Type":"ContainerStarted","Data":"8b57b8c34a1e57bdd48f472ab59ca412c740976cfffcc28bec59905fa6e42f1e"} Jun 02 19:10:24.158215 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:24.158174 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" event={"ID":"71138766-b600-428f-91ef-b49974041fbc","Type":"ContainerStarted","Data":"0d6606e635f6b40ce0fcd7ca168b43510079e37cb1b7cc43872896ae130525ca"} Jun 02 19:10:24.180368 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:24.180324 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" podStartSLOduration=1.180294492 podStartE2EDuration="1.180294492s" podCreationTimestamp="2026-06-02 19:10:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:10:24.177383014 +0000 UTC m=+428.152284565" watchObservedRunningTime="2026-06-02 19:10:24.180294492 +0000 UTC m=+428.155196028" Jun 02 19:10:24.679282 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:24.679240 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:24.684261 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:24.684237 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:25.162174 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:25.162147 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:25.163201 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:25.163174 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-gznvb" Jun 02 19:10:27.122012 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:27.121978 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-sgbch"] Jun 02 19:10:27.125753 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:27.125732 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-sgbch" Jun 02 19:10:27.128330 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:27.128283 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 02 19:10:27.128424 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:27.128353 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-k9jfh\"" Jun 02 19:10:27.134117 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:27.134096 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-sgbch"] Jun 02 19:10:27.218412 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:27.218381 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-sgbch"] Jun 02 19:10:27.274021 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:27.273988 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9e41b207-0829-414f-aacf-7d7839a272b3-config-file\") pod \"limitador-limitador-7d549b5b-sgbch\" (UID: \"9e41b207-0829-414f-aacf-7d7839a272b3\") " pod="kuadrant-system/limitador-limitador-7d549b5b-sgbch" Jun 02 19:10:27.274267 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:27.274244 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvvvv\" (UniqueName: \"kubernetes.io/projected/9e41b207-0829-414f-aacf-7d7839a272b3-kube-api-access-rvvvv\") pod \"limitador-limitador-7d549b5b-sgbch\" (UID: \"9e41b207-0829-414f-aacf-7d7839a272b3\") " pod="kuadrant-system/limitador-limitador-7d549b5b-sgbch" Jun 02 19:10:27.304661 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:27.304626 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sfk9g"] Jun 02 19:10:27.308098 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:27.308077 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-sfk9g" Jun 02 19:10:27.315196 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:27.315170 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sfk9g"] Jun 02 19:10:27.342997 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:27.342968 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sfk9g"] Jun 02 19:10:27.375073 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:27.375001 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9e41b207-0829-414f-aacf-7d7839a272b3-config-file\") pod \"limitador-limitador-7d549b5b-sgbch\" (UID: \"9e41b207-0829-414f-aacf-7d7839a272b3\") " pod="kuadrant-system/limitador-limitador-7d549b5b-sgbch" Jun 02 19:10:27.375193 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:27.375119 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rvvvv\" (UniqueName: \"kubernetes.io/projected/9e41b207-0829-414f-aacf-7d7839a272b3-kube-api-access-rvvvv\") pod \"limitador-limitador-7d549b5b-sgbch\" (UID: \"9e41b207-0829-414f-aacf-7d7839a272b3\") " pod="kuadrant-system/limitador-limitador-7d549b5b-sgbch" Jun 02 19:10:27.375708 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:27.375691 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9e41b207-0829-414f-aacf-7d7839a272b3-config-file\") pod \"limitador-limitador-7d549b5b-sgbch\" (UID: \"9e41b207-0829-414f-aacf-7d7839a272b3\") " pod="kuadrant-system/limitador-limitador-7d549b5b-sgbch" Jun 02 19:10:27.382988 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:27.382969 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvvvv\" (UniqueName: \"kubernetes.io/projected/9e41b207-0829-414f-aacf-7d7839a272b3-kube-api-access-rvvvv\") pod \"limitador-limitador-7d549b5b-sgbch\" (UID: \"9e41b207-0829-414f-aacf-7d7839a272b3\") " pod="kuadrant-system/limitador-limitador-7d549b5b-sgbch" Jun 02 19:10:27.437788 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:27.437762 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-sgbch" Jun 02 19:10:27.475594 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:27.475566 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd6q9\" (UniqueName: \"kubernetes.io/projected/b46d55d6-7576-4c96-b73b-838690e0d8be-kube-api-access-xd6q9\") pod \"limitador-limitador-78c99df468-sfk9g\" (UID: \"b46d55d6-7576-4c96-b73b-838690e0d8be\") " pod="kuadrant-system/limitador-limitador-78c99df468-sfk9g" Jun 02 19:10:27.475752 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:27.475647 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b46d55d6-7576-4c96-b73b-838690e0d8be-config-file\") pod \"limitador-limitador-78c99df468-sfk9g\" (UID: \"b46d55d6-7576-4c96-b73b-838690e0d8be\") " pod="kuadrant-system/limitador-limitador-78c99df468-sfk9g" Jun 02 19:10:27.568270 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:27.568237 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-sgbch"] Jun 02 19:10:27.572080 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:10:27.572041 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e41b207_0829_414f_aacf_7d7839a272b3.slice/crio-17bf9ac7a68c82cb4104f00821ec62815336a08b02655adcaff41f1c88211420 WatchSource:0}: Error finding container 17bf9ac7a68c82cb4104f00821ec62815336a08b02655adcaff41f1c88211420: Status 404 returned error can't find the container with id 17bf9ac7a68c82cb4104f00821ec62815336a08b02655adcaff41f1c88211420 Jun 02 19:10:27.576615 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:27.576586 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xd6q9\" (UniqueName: \"kubernetes.io/projected/b46d55d6-7576-4c96-b73b-838690e0d8be-kube-api-access-xd6q9\") pod \"limitador-limitador-78c99df468-sfk9g\" (UID: \"b46d55d6-7576-4c96-b73b-838690e0d8be\") " pod="kuadrant-system/limitador-limitador-78c99df468-sfk9g" Jun 02 19:10:27.576700 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:27.576683 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b46d55d6-7576-4c96-b73b-838690e0d8be-config-file\") pod \"limitador-limitador-78c99df468-sfk9g\" (UID: \"b46d55d6-7576-4c96-b73b-838690e0d8be\") " pod="kuadrant-system/limitador-limitador-78c99df468-sfk9g" Jun 02 19:10:27.577238 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:27.577218 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b46d55d6-7576-4c96-b73b-838690e0d8be-config-file\") pod \"limitador-limitador-78c99df468-sfk9g\" (UID: \"b46d55d6-7576-4c96-b73b-838690e0d8be\") " pod="kuadrant-system/limitador-limitador-78c99df468-sfk9g" Jun 02 19:10:27.584348 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:27.584299 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd6q9\" (UniqueName: \"kubernetes.io/projected/b46d55d6-7576-4c96-b73b-838690e0d8be-kube-api-access-xd6q9\") pod \"limitador-limitador-78c99df468-sfk9g\" (UID: \"b46d55d6-7576-4c96-b73b-838690e0d8be\") " pod="kuadrant-system/limitador-limitador-78c99df468-sfk9g" Jun 02 19:10:27.620172 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:27.620149 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-sfk9g" Jun 02 19:10:27.747803 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:27.747780 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sfk9g"] Jun 02 19:10:27.749860 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:10:27.749830 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb46d55d6_7576_4c96_b73b_838690e0d8be.slice/crio-7a967b45cd3ef8f9989cdd004cabf493468c815238ccf4922c5a26fecd40e0d2 WatchSource:0}: Error finding container 7a967b45cd3ef8f9989cdd004cabf493468c815238ccf4922c5a26fecd40e0d2: Status 404 returned error can't find the container with id 7a967b45cd3ef8f9989cdd004cabf493468c815238ccf4922c5a26fecd40e0d2 Jun 02 19:10:28.175870 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:28.175812 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-sfk9g" event={"ID":"b46d55d6-7576-4c96-b73b-838690e0d8be","Type":"ContainerStarted","Data":"7a967b45cd3ef8f9989cdd004cabf493468c815238ccf4922c5a26fecd40e0d2"} Jun 02 19:10:28.177882 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:28.177834 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-sgbch" event={"ID":"9e41b207-0829-414f-aacf-7d7839a272b3","Type":"ContainerStarted","Data":"17bf9ac7a68c82cb4104f00821ec62815336a08b02655adcaff41f1c88211420"} Jun 02 19:10:31.191368 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:31.191326 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-sfk9g" event={"ID":"b46d55d6-7576-4c96-b73b-838690e0d8be","Type":"ContainerStarted","Data":"7c3d5bcface0aab81fc27ce362496779d8366ba691ac5977d73849640607f699"} Jun 02 19:10:31.191886 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:31.191466 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-sfk9g" Jun 02 19:10:31.192654 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:31.192628 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-sgbch" event={"ID":"9e41b207-0829-414f-aacf-7d7839a272b3","Type":"ContainerStarted","Data":"64a515f4d53da873b4c0b0c09966dda712527b2b2d9400e8e917e83129b9059c"} Jun 02 19:10:31.192778 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:31.192767 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-sgbch" Jun 02 19:10:31.210416 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:31.210368 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-sfk9g" podStartSLOduration=1.534108593 podStartE2EDuration="4.210352958s" podCreationTimestamp="2026-06-02 19:10:27 +0000 UTC" firstStartedPulling="2026-06-02 19:10:27.751706692 +0000 UTC m=+431.726608207" lastFinishedPulling="2026-06-02 19:10:30.427951042 +0000 UTC m=+434.402852572" observedRunningTime="2026-06-02 19:10:31.209065311 +0000 UTC m=+435.183966850" watchObservedRunningTime="2026-06-02 19:10:31.210352958 +0000 UTC m=+435.185254496" Jun 02 19:10:31.227014 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:31.226977 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-sgbch" podStartSLOduration=1.380295303 podStartE2EDuration="4.226968657s" podCreationTimestamp="2026-06-02 19:10:27 +0000 UTC" firstStartedPulling="2026-06-02 19:10:27.573857588 +0000 UTC m=+431.548759102" lastFinishedPulling="2026-06-02 19:10:30.420530941 +0000 UTC m=+434.395432456" observedRunningTime="2026-06-02 19:10:31.226913685 +0000 UTC m=+435.201815219" watchObservedRunningTime="2026-06-02 19:10:31.226968657 +0000 UTC m=+435.201870194" Jun 02 19:10:42.197511 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:42.197437 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-sfk9g" Jun 02 19:10:42.197511 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:42.197503 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-sgbch" Jun 02 19:10:42.300633 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:42.300605 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-sgbch"] Jun 02 19:10:42.300798 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:42.300783 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-sgbch" podUID="9e41b207-0829-414f-aacf-7d7839a272b3" containerName="limitador" containerID="cri-o://64a515f4d53da873b4c0b0c09966dda712527b2b2d9400e8e917e83129b9059c" gracePeriod=30 Jun 02 19:10:42.844297 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:42.844271 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-sgbch" Jun 02 19:10:42.904476 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:42.904417 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9e41b207-0829-414f-aacf-7d7839a272b3-config-file\") pod \"9e41b207-0829-414f-aacf-7d7839a272b3\" (UID: \"9e41b207-0829-414f-aacf-7d7839a272b3\") " Jun 02 19:10:42.904576 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:42.904481 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvvvv\" (UniqueName: \"kubernetes.io/projected/9e41b207-0829-414f-aacf-7d7839a272b3-kube-api-access-rvvvv\") pod \"9e41b207-0829-414f-aacf-7d7839a272b3\" (UID: \"9e41b207-0829-414f-aacf-7d7839a272b3\") " Jun 02 19:10:42.904774 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:42.904751 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e41b207-0829-414f-aacf-7d7839a272b3-config-file" (OuterVolumeSpecName: "config-file") pod "9e41b207-0829-414f-aacf-7d7839a272b3" (UID: "9e41b207-0829-414f-aacf-7d7839a272b3"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 19:10:42.906487 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:42.906467 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e41b207-0829-414f-aacf-7d7839a272b3-kube-api-access-rvvvv" (OuterVolumeSpecName: "kube-api-access-rvvvv") pod "9e41b207-0829-414f-aacf-7d7839a272b3" (UID: "9e41b207-0829-414f-aacf-7d7839a272b3"). InnerVolumeSpecName "kube-api-access-rvvvv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 19:10:43.005272 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:43.005246 2557 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9e41b207-0829-414f-aacf-7d7839a272b3-config-file\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 19:10:43.005272 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:43.005270 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvvvv\" (UniqueName: \"kubernetes.io/projected/9e41b207-0829-414f-aacf-7d7839a272b3-kube-api-access-rvvvv\") on node \"ip-10-0-141-177.ec2.internal\" DevicePath \"\"" Jun 02 19:10:43.241246 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:43.241169 2557 generic.go:358] "Generic (PLEG): container finished" podID="9e41b207-0829-414f-aacf-7d7839a272b3" containerID="64a515f4d53da873b4c0b0c09966dda712527b2b2d9400e8e917e83129b9059c" exitCode=0 Jun 02 19:10:43.241246 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:43.241240 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-sgbch" Jun 02 19:10:43.241671 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:43.241254 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-sgbch" event={"ID":"9e41b207-0829-414f-aacf-7d7839a272b3","Type":"ContainerDied","Data":"64a515f4d53da873b4c0b0c09966dda712527b2b2d9400e8e917e83129b9059c"} Jun 02 19:10:43.241671 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:43.241288 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-sgbch" event={"ID":"9e41b207-0829-414f-aacf-7d7839a272b3","Type":"ContainerDied","Data":"17bf9ac7a68c82cb4104f00821ec62815336a08b02655adcaff41f1c88211420"} Jun 02 19:10:43.241671 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:43.241304 2557 scope.go:117] "RemoveContainer" containerID="64a515f4d53da873b4c0b0c09966dda712527b2b2d9400e8e917e83129b9059c" Jun 02 19:10:43.249251 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:43.249237 2557 scope.go:117] "RemoveContainer" containerID="64a515f4d53da873b4c0b0c09966dda712527b2b2d9400e8e917e83129b9059c" Jun 02 19:10:43.249492 ip-10-0-141-177 kubenswrapper[2557]: E0602 19:10:43.249475 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64a515f4d53da873b4c0b0c09966dda712527b2b2d9400e8e917e83129b9059c\": container with ID starting with 64a515f4d53da873b4c0b0c09966dda712527b2b2d9400e8e917e83129b9059c not found: ID does not exist" containerID="64a515f4d53da873b4c0b0c09966dda712527b2b2d9400e8e917e83129b9059c" Jun 02 19:10:43.249545 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:43.249500 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64a515f4d53da873b4c0b0c09966dda712527b2b2d9400e8e917e83129b9059c"} err="failed to get container status \"64a515f4d53da873b4c0b0c09966dda712527b2b2d9400e8e917e83129b9059c\": rpc error: code = NotFound desc = could not find container \"64a515f4d53da873b4c0b0c09966dda712527b2b2d9400e8e917e83129b9059c\": container with ID starting with 64a515f4d53da873b4c0b0c09966dda712527b2b2d9400e8e917e83129b9059c not found: ID does not exist" Jun 02 19:10:43.274216 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:43.274191 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-sgbch"] Jun 02 19:10:43.280315 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:43.280288 2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-sgbch"] Jun 02 19:10:44.554448 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:10:44.554417 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e41b207-0829-414f-aacf-7d7839a272b3" path="/var/lib/kubelet/pods/9e41b207-0829-414f-aacf-7d7839a272b3/volumes" Jun 02 19:11:07.091582 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:11:07.091550 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-fvwzw"] Jun 02 19:11:07.092021 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:11:07.091919 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e41b207-0829-414f-aacf-7d7839a272b3" containerName="limitador" Jun 02 19:11:07.092021 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:11:07.091930 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e41b207-0829-414f-aacf-7d7839a272b3" containerName="limitador" Jun 02 19:11:07.092021 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:11:07.091997 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="9e41b207-0829-414f-aacf-7d7839a272b3" containerName="limitador" Jun 02 19:11:07.093771 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:11:07.093750 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-fvwzw" Jun 02 19:11:07.097510 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:11:07.097489 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 19:11:07.098689 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:11:07.098669 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-6sqsn\"" Jun 02 19:11:07.098789 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:11:07.098710 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 19:11:07.113792 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:11:07.113771 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-fvwzw"] Jun 02 19:11:07.189173 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:11:07.189145 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgx5g\" (UniqueName: \"kubernetes.io/projected/19dd9f9f-36bf-42c5-99a8-d20cf6ef8a6b-kube-api-access-jgx5g\") pod \"keycloak-operator-7864d68cbd-fvwzw\" (UID: \"19dd9f9f-36bf-42c5-99a8-d20cf6ef8a6b\") " pod="keycloak-system/keycloak-operator-7864d68cbd-fvwzw" Jun 02 19:11:07.290406 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:11:07.290381 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgx5g\" (UniqueName: \"kubernetes.io/projected/19dd9f9f-36bf-42c5-99a8-d20cf6ef8a6b-kube-api-access-jgx5g\") pod \"keycloak-operator-7864d68cbd-fvwzw\" (UID: \"19dd9f9f-36bf-42c5-99a8-d20cf6ef8a6b\") " pod="keycloak-system/keycloak-operator-7864d68cbd-fvwzw" Jun 02 19:11:07.303990 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:11:07.303967 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgx5g\" (UniqueName: \"kubernetes.io/projected/19dd9f9f-36bf-42c5-99a8-d20cf6ef8a6b-kube-api-access-jgx5g\") pod \"keycloak-operator-7864d68cbd-fvwzw\" (UID: \"19dd9f9f-36bf-42c5-99a8-d20cf6ef8a6b\") " pod="keycloak-system/keycloak-operator-7864d68cbd-fvwzw" Jun 02 19:11:07.404068 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:11:07.404016 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-fvwzw" Jun 02 19:11:07.540694 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:11:07.540668 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-fvwzw"] Jun 02 19:11:07.543343 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:11:07.543302 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19dd9f9f_36bf_42c5_99a8_d20cf6ef8a6b.slice/crio-34e0066696fa3439f168525e483df873e59c7b75318af1abdad83764b10a908b WatchSource:0}: Error finding container 34e0066696fa3439f168525e483df873e59c7b75318af1abdad83764b10a908b: Status 404 returned error can't find the container with id 34e0066696fa3439f168525e483df873e59c7b75318af1abdad83764b10a908b Jun 02 19:11:08.328462 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:11:08.328422 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-fvwzw" event={"ID":"19dd9f9f-36bf-42c5-99a8-d20cf6ef8a6b","Type":"ContainerStarted","Data":"34e0066696fa3439f168525e483df873e59c7b75318af1abdad83764b10a908b"} Jun 02 19:11:15.359324 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:11:15.359268 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-fvwzw" event={"ID":"19dd9f9f-36bf-42c5-99a8-d20cf6ef8a6b","Type":"ContainerStarted","Data":"e65f6d797d230fd6d5ad266215941676bf46b9b1085c49f75237133aff284394"} Jun 02 19:11:15.375707 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:11:15.375661 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-fvwzw" podStartSLOduration=1.416838586 podStartE2EDuration="8.375647092s" podCreationTimestamp="2026-06-02 19:11:07 +0000 UTC" firstStartedPulling="2026-06-02 19:11:07.544634033 +0000 UTC m=+471.519535548" lastFinishedPulling="2026-06-02 19:11:14.503442528 +0000 UTC m=+478.478344054" observedRunningTime="2026-06-02 19:11:15.374106083 +0000 UTC m=+479.349007612" watchObservedRunningTime="2026-06-02 19:11:15.375647092 +0000 UTC m=+479.350548628" Jun 02 19:12:33.599831 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:12:33.599754 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sfk9g"] Jun 02 19:13:16.505922 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:13:16.505896 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-kxcxc_7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3/console-operator/2.log" Jun 02 19:13:16.506480 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:13:16.505930 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-kxcxc_7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3/console-operator/2.log" Jun 02 19:13:41.292543 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:13:41.292461 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sfk9g"] Jun 02 19:13:55.611011 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:13:55.610979 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sfk9g"] Jun 02 19:14:05.288348 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:14:05.288316 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sfk9g"] Jun 02 19:14:16.485415 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:14:16.485377 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sfk9g"] Jun 02 19:14:25.894239 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:14:25.894206 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sfk9g"] Jun 02 19:14:33.084420 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:14:33.084386 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sfk9g"] Jun 02 19:18:16.531001 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:18:16.530975 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-kxcxc_7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3/console-operator/2.log" Jun 02 19:18:16.533187 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:18:16.533166 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-kxcxc_7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3/console-operator/2.log" Jun 02 19:20:39.555073 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:39.555042 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5d857d74c6-phn8p_e545ae33-55da-45cc-bdec-c0321e2fdb52/nginx/0.log" Jun 02 19:20:39.784367 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:39.784336 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-w62v8_6072fda7-3361-400d-b6d3-60e6e241adb6/manager/0.log" Jun 02 19:20:39.905642 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:39.905605 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-rdwft_98a46f44-1008-4d36-a4dd-0ba82d3ddb62/manager/0.log" Jun 02 19:20:40.251721 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:40.251637 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-tsh6x_f1cac500-4e3b-426a-b064-b3b87f775ab5/server/0.log" Jun 02 19:20:40.368452 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:40.368417 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-lpmcx_72330e33-f830-4b6b-9ddb-89a7207a8062/manager/0.log" Jun 02 19:20:40.604068 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:40.604046 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69b56f574b-gpfx2_bbf59331-3124-486b-957f-303b8637167b/copy-manifests/0.log" Jun 02 19:20:40.621903 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:40.621874 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69b56f574b-gpfx2_bbf59331-3124-486b-957f-303b8637167b/manager/0.log" Jun 02 19:20:42.219362 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:42.219335 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-crz4v_4681a170-af3a-413d-be38-f622e5489c5f/manager/0.log" Jun 02 19:20:42.554016 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:42.553931 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-n6bbt_44fbe30a-ba29-4398-8c22-0b8015de51e1/registry-server/0.log" Jun 02 19:20:42.775553 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:42.775527 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-sfk9g_b46d55d6-7576-4c96-b73b-838690e0d8be/limitador/0.log" Jun 02 19:20:43.229249 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:43.229218 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bl4krw_1567a621-41f7-4f0d-b16d-5e81f56bdbc2/istio-proxy/0.log" Jun 02 19:20:43.568252 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:43.568171 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f9d7d5cb6-gf4d4_f6b669db-1193-4d2e-ae9a-3d0e7a913120/kube-auth-proxy/0.log" Jun 02 19:20:43.681272 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:43.681245 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-gznvb_71138766-b600-428f-91ef-b49974041fbc/istio-proxy/0.log" Jun 02 19:20:43.904914 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:43.904884 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c96dcf58c-hn2d6_c590dacd-1369-4e42-b9ad-e6422b219426/router/0.log" Jun 02 19:20:49.230384 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:49.230351 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jdvqf/must-gather-rfbh9"] Jun 02 19:20:49.234528 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:49.234508 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jdvqf/must-gather-rfbh9" Jun 02 19:20:49.237383 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:49.237365 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jdvqf\"/\"openshift-service-ca.crt\"" Jun 02 19:20:49.238532 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:49.238510 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jdvqf\"/\"kube-root-ca.crt\"" Jun 02 19:20:49.238698 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:49.238530 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jdvqf\"/\"default-dockercfg-c2gzr\"" Jun 02 19:20:49.248181 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:49.248157 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jdvqf/must-gather-rfbh9"] Jun 02 19:20:49.321628 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:49.321603 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmdnr\" (UniqueName: \"kubernetes.io/projected/1af80363-2865-4b50-a8d4-7d36d991f0ba-kube-api-access-lmdnr\") pod \"must-gather-rfbh9\" (UID: \"1af80363-2865-4b50-a8d4-7d36d991f0ba\") " pod="openshift-must-gather-jdvqf/must-gather-rfbh9" Jun 02 19:20:49.321727 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:49.321653 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1af80363-2865-4b50-a8d4-7d36d991f0ba-must-gather-output\") pod \"must-gather-rfbh9\" (UID: \"1af80363-2865-4b50-a8d4-7d36d991f0ba\") " pod="openshift-must-gather-jdvqf/must-gather-rfbh9" Jun 02 19:20:49.422741 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:49.422715 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1af80363-2865-4b50-a8d4-7d36d991f0ba-must-gather-output\") pod \"must-gather-rfbh9\" (UID: \"1af80363-2865-4b50-a8d4-7d36d991f0ba\") " pod="openshift-must-gather-jdvqf/must-gather-rfbh9" Jun 02 19:20:49.422834 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:49.422777 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lmdnr\" (UniqueName: \"kubernetes.io/projected/1af80363-2865-4b50-a8d4-7d36d991f0ba-kube-api-access-lmdnr\") pod \"must-gather-rfbh9\" (UID: \"1af80363-2865-4b50-a8d4-7d36d991f0ba\") " pod="openshift-must-gather-jdvqf/must-gather-rfbh9" Jun 02 19:20:49.423091 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:49.423074 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1af80363-2865-4b50-a8d4-7d36d991f0ba-must-gather-output\") pod \"must-gather-rfbh9\" (UID: \"1af80363-2865-4b50-a8d4-7d36d991f0ba\") " pod="openshift-must-gather-jdvqf/must-gather-rfbh9" Jun 02 19:20:49.432339 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:49.432289 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmdnr\" (UniqueName: \"kubernetes.io/projected/1af80363-2865-4b50-a8d4-7d36d991f0ba-kube-api-access-lmdnr\") pod \"must-gather-rfbh9\" (UID: \"1af80363-2865-4b50-a8d4-7d36d991f0ba\") " pod="openshift-must-gather-jdvqf/must-gather-rfbh9" Jun 02 19:20:49.543779 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:49.543723 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jdvqf/must-gather-rfbh9" Jun 02 19:20:49.679984 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:49.679958 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jdvqf/must-gather-rfbh9"] Jun 02 19:20:49.682589 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:20:49.682562 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1af80363_2865_4b50_a8d4_7d36d991f0ba.slice/crio-bab4a44bfd6d8f8b86071ccca19f1f5fc04d79627a3e3c1c10d91d39eba1c75a WatchSource:0}: Error finding container bab4a44bfd6d8f8b86071ccca19f1f5fc04d79627a3e3c1c10d91d39eba1c75a: Status 404 returned error can't find the container with id bab4a44bfd6d8f8b86071ccca19f1f5fc04d79627a3e3c1c10d91d39eba1c75a Jun 02 19:20:49.684359 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:49.684343 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 19:20:50.420390 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:50.420351 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jdvqf/must-gather-rfbh9" event={"ID":"1af80363-2865-4b50-a8d4-7d36d991f0ba","Type":"ContainerStarted","Data":"bab4a44bfd6d8f8b86071ccca19f1f5fc04d79627a3e3c1c10d91d39eba1c75a"} Jun 02 19:20:51.428488 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:51.428449 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jdvqf/must-gather-rfbh9" event={"ID":"1af80363-2865-4b50-a8d4-7d36d991f0ba","Type":"ContainerStarted","Data":"c75d6ab8c466a1ab709d35e9aebeda10d362ba43b5902db2cd229606ea226415"} Jun 02 19:20:51.428944 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:51.428883 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jdvqf/must-gather-rfbh9" event={"ID":"1af80363-2865-4b50-a8d4-7d36d991f0ba","Type":"ContainerStarted","Data":"60bb4f842b030a5f4aa284d7e8e9af871498f7a40fe8873edf242f6ea64f49b4"} Jun 02 19:20:51.444994 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:51.444948 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-jdvqf/must-gather-rfbh9" podStartSLOduration=1.521331978 podStartE2EDuration="2.444934791s" podCreationTimestamp="2026-06-02 19:20:49 +0000 UTC" firstStartedPulling="2026-06-02 19:20:49.684468795 +0000 UTC m=+1053.659370310" lastFinishedPulling="2026-06-02 19:20:50.608071605 +0000 UTC m=+1054.582973123" observedRunningTime="2026-06-02 19:20:51.443985919 +0000 UTC m=+1055.418887460" watchObservedRunningTime="2026-06-02 19:20:51.444934791 +0000 UTC m=+1055.419836325" Jun 02 19:20:52.185474 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:52.185439 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8qx9x_2a72f625-c946-4a04-a6b4-6a37b15307e9/global-pull-secret-syncer/0.log" Jun 02 19:20:52.325495 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:52.325457 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pclcs_1fca4d91-f894-4c30-a0df-583ee61b5f2e/konnectivity-agent/0.log" Jun 02 19:20:52.438350 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:52.438261 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-177.ec2.internal_00ab6e9e70b3869b45a8dbd4d89dd58d/haproxy/0.log" Jun 02 19:20:56.885935 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:56.885896 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-crz4v_4681a170-af3a-413d-be38-f622e5489c5f/manager/0.log" Jun 02 19:20:56.971525 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:56.971493 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-n6bbt_44fbe30a-ba29-4398-8c22-0b8015de51e1/registry-server/0.log" Jun 02 19:20:57.043897 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:57.043862 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-sfk9g_b46d55d6-7576-4c96-b73b-838690e0d8be/limitador/0.log" Jun 02 19:20:58.617164 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:58.617131 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-l2lnk_17a50869-5f95-4436-9eaf-c2ad111ccd76/cluster-monitoring-operator/0.log" Jun 02 19:20:58.759366 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:58.759279 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bcjgh_7ea1907c-2071-41dc-9a51-73845e90c62f/node-exporter/0.log" Jun 02 19:20:58.776882 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:58.776851 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bcjgh_7ea1907c-2071-41dc-9a51-73845e90c62f/kube-rbac-proxy/0.log" Jun 02 19:20:58.794869 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:58.794844 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bcjgh_7ea1907c-2071-41dc-9a51-73845e90c62f/init-textfile/0.log" Jun 02 19:20:59.249834 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:59.249800 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-ltcd8_ede16251-4799-43f5-b2c8-796337a5cf0c/prometheus-operator/0.log" Jun 02 19:20:59.267033 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:59.267000 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-ltcd8_ede16251-4799-43f5-b2c8-796337a5cf0c/kube-rbac-proxy/0.log" Jun 02 19:20:59.289342 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:20:59.289296 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-t2kws_4bfe5df8-4f03-4727-af5e-99658cf38d98/prometheus-operator-admission-webhook/0.log" Jun 02 19:21:00.611941 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:00.611861 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-hfhgt_0c489102-a181-45b3-b63e-b54e3046b8cc/networking-console-plugin/0.log" Jun 02 19:21:01.154192 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:01.154164 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-kxcxc_7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3/console-operator/2.log" Jun 02 19:21:01.163871 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:01.163841 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-kxcxc_7a07dbf1-6a3a-497e-ae7f-8e654a88a1a3/console-operator/3.log" Jun 02 19:21:01.562780 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:01.562697 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jdvqf/perf-node-gather-daemonset-jx7xz"] Jun 02 19:21:01.567747 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:01.567723 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jdvqf/perf-node-gather-daemonset-jx7xz" Jun 02 19:21:01.575391 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:01.575366 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jdvqf/perf-node-gather-daemonset-jx7xz"] Jun 02 19:21:01.657572 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:01.657502 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c1a9d8d1-e85b-4ba5-a67b-f356a3282826-proc\") pod \"perf-node-gather-daemonset-jx7xz\" (UID: \"c1a9d8d1-e85b-4ba5-a67b-f356a3282826\") " pod="openshift-must-gather-jdvqf/perf-node-gather-daemonset-jx7xz" Jun 02 19:21:01.658051 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:01.657580 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ms42\" (UniqueName: \"kubernetes.io/projected/c1a9d8d1-e85b-4ba5-a67b-f356a3282826-kube-api-access-7ms42\") pod \"perf-node-gather-daemonset-jx7xz\" (UID: \"c1a9d8d1-e85b-4ba5-a67b-f356a3282826\") " pod="openshift-must-gather-jdvqf/perf-node-gather-daemonset-jx7xz" Jun 02 19:21:01.658051 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:01.657642 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1a9d8d1-e85b-4ba5-a67b-f356a3282826-sys\") pod \"perf-node-gather-daemonset-jx7xz\" (UID: \"c1a9d8d1-e85b-4ba5-a67b-f356a3282826\") " pod="openshift-must-gather-jdvqf/perf-node-gather-daemonset-jx7xz" Jun 02 19:21:01.658051 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:01.657671 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c1a9d8d1-e85b-4ba5-a67b-f356a3282826-podres\") pod \"perf-node-gather-daemonset-jx7xz\" (UID: \"c1a9d8d1-e85b-4ba5-a67b-f356a3282826\") " pod="openshift-must-gather-jdvqf/perf-node-gather-daemonset-jx7xz" Jun 02 19:21:01.658051 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:01.657737 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c1a9d8d1-e85b-4ba5-a67b-f356a3282826-lib-modules\") pod \"perf-node-gather-daemonset-jx7xz\" (UID: \"c1a9d8d1-e85b-4ba5-a67b-f356a3282826\") " pod="openshift-must-gather-jdvqf/perf-node-gather-daemonset-jx7xz" Jun 02 19:21:01.758743 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:01.758710 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c1a9d8d1-e85b-4ba5-a67b-f356a3282826-proc\") pod \"perf-node-gather-daemonset-jx7xz\" (UID: \"c1a9d8d1-e85b-4ba5-a67b-f356a3282826\") " pod="openshift-must-gather-jdvqf/perf-node-gather-daemonset-jx7xz" Jun 02 19:21:01.758937 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:01.758782 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7ms42\" (UniqueName: \"kubernetes.io/projected/c1a9d8d1-e85b-4ba5-a67b-f356a3282826-kube-api-access-7ms42\") pod \"perf-node-gather-daemonset-jx7xz\" (UID: \"c1a9d8d1-e85b-4ba5-a67b-f356a3282826\") " pod="openshift-must-gather-jdvqf/perf-node-gather-daemonset-jx7xz" Jun 02 19:21:01.758937 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:01.758832 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c1a9d8d1-e85b-4ba5-a67b-f356a3282826-proc\") pod \"perf-node-gather-daemonset-jx7xz\" (UID: \"c1a9d8d1-e85b-4ba5-a67b-f356a3282826\") " pod="openshift-must-gather-jdvqf/perf-node-gather-daemonset-jx7xz" Jun 02 19:21:01.758937 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:01.758845 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1a9d8d1-e85b-4ba5-a67b-f356a3282826-sys\") pod \"perf-node-gather-daemonset-jx7xz\" (UID: \"c1a9d8d1-e85b-4ba5-a67b-f356a3282826\") " pod="openshift-must-gather-jdvqf/perf-node-gather-daemonset-jx7xz" Jun 02 19:21:01.758937 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:01.758887 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c1a9d8d1-e85b-4ba5-a67b-f356a3282826-podres\") pod \"perf-node-gather-daemonset-jx7xz\" (UID: \"c1a9d8d1-e85b-4ba5-a67b-f356a3282826\") " pod="openshift-must-gather-jdvqf/perf-node-gather-daemonset-jx7xz" Jun 02 19:21:01.758937 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:01.758893 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1a9d8d1-e85b-4ba5-a67b-f356a3282826-sys\") pod \"perf-node-gather-daemonset-jx7xz\" (UID: \"c1a9d8d1-e85b-4ba5-a67b-f356a3282826\") " pod="openshift-must-gather-jdvqf/perf-node-gather-daemonset-jx7xz" Jun 02 19:21:01.759227 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:01.758945 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c1a9d8d1-e85b-4ba5-a67b-f356a3282826-lib-modules\") pod \"perf-node-gather-daemonset-jx7xz\" (UID: \"c1a9d8d1-e85b-4ba5-a67b-f356a3282826\") " pod="openshift-must-gather-jdvqf/perf-node-gather-daemonset-jx7xz" Jun 02 19:21:01.759227 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:01.759090 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c1a9d8d1-e85b-4ba5-a67b-f356a3282826-lib-modules\") pod \"perf-node-gather-daemonset-jx7xz\" (UID: \"c1a9d8d1-e85b-4ba5-a67b-f356a3282826\") " pod="openshift-must-gather-jdvqf/perf-node-gather-daemonset-jx7xz" Jun 02 19:21:01.759227 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:01.759163 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c1a9d8d1-e85b-4ba5-a67b-f356a3282826-podres\") pod \"perf-node-gather-daemonset-jx7xz\" (UID: \"c1a9d8d1-e85b-4ba5-a67b-f356a3282826\") " pod="openshift-must-gather-jdvqf/perf-node-gather-daemonset-jx7xz" Jun 02 19:21:01.767978 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:01.767934 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ms42\" (UniqueName: \"kubernetes.io/projected/c1a9d8d1-e85b-4ba5-a67b-f356a3282826-kube-api-access-7ms42\") pod \"perf-node-gather-daemonset-jx7xz\" (UID: \"c1a9d8d1-e85b-4ba5-a67b-f356a3282826\") " pod="openshift-must-gather-jdvqf/perf-node-gather-daemonset-jx7xz" Jun 02 19:21:01.882133 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:01.882095 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jdvqf/perf-node-gather-daemonset-jx7xz" Jun 02 19:21:02.041286 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:02.041256 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jdvqf/perf-node-gather-daemonset-jx7xz"] Jun 02 19:21:02.043302 ip-10-0-141-177 kubenswrapper[2557]: W0602 19:21:02.043249 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc1a9d8d1_e85b_4ba5_a67b_f356a3282826.slice/crio-e06d3cd396a49672c95c3e1c37b5e3bde50b776febadab9365e39dd4cf8f38d1 WatchSource:0}: Error finding container e06d3cd396a49672c95c3e1c37b5e3bde50b776febadab9365e39dd4cf8f38d1: Status 404 returned error can't find the container with id e06d3cd396a49672c95c3e1c37b5e3bde50b776febadab9365e39dd4cf8f38d1 Jun 02 19:21:02.287748 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:02.287716 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-tc247_d89bfa95-df32-4295-a085-8f1e0388aa74/volume-data-source-validator/0.log" Jun 02 19:21:02.517236 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:02.517148 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jdvqf/perf-node-gather-daemonset-jx7xz" event={"ID":"c1a9d8d1-e85b-4ba5-a67b-f356a3282826","Type":"ContainerStarted","Data":"00901e656d17b5ab56a50131b43333df845adc7b4c8e502c02143325fa007e05"} Jun 02 19:21:02.517236 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:02.517197 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jdvqf/perf-node-gather-daemonset-jx7xz" Jun 02 19:21:02.517236 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:02.517212 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jdvqf/perf-node-gather-daemonset-jx7xz" event={"ID":"c1a9d8d1-e85b-4ba5-a67b-f356a3282826","Type":"ContainerStarted","Data":"e06d3cd396a49672c95c3e1c37b5e3bde50b776febadab9365e39dd4cf8f38d1"} Jun 02 19:21:02.536033 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:02.535976 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-jdvqf/perf-node-gather-daemonset-jx7xz" podStartSLOduration=1.535957404 podStartE2EDuration="1.535957404s" podCreationTimestamp="2026-06-02 19:21:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 19:21:02.534128541 +0000 UTC m=+1066.509030092" watchObservedRunningTime="2026-06-02 19:21:02.535957404 +0000 UTC m=+1066.510858942" Jun 02 19:21:03.136907 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:03.136883 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l2w9x_3ba16f49-e177-4b3a-9559-f61b332d28f5/dns/0.log" Jun 02 19:21:03.159544 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:03.159519 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l2w9x_3ba16f49-e177-4b3a-9559-f61b332d28f5/kube-rbac-proxy/0.log" Jun 02 19:21:03.273419 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:03.273392 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gr66k_712dc734-631f-4fc5-bfa4-7b036c53cad0/dns-node-resolver/0.log" Jun 02 19:21:03.728283 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:03.728251 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6ddrs_b0840a32-3528-4cef-aec6-d62b0f977e98/node-ca/0.log" Jun 02 19:21:04.565912 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:04.565874 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bl4krw_1567a621-41f7-4f0d-b16d-5e81f56bdbc2/istio-proxy/0.log" Jun 02 19:21:04.668192 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:04.668167 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f9d7d5cb6-gf4d4_f6b669db-1193-4d2e-ae9a-3d0e7a913120/kube-auth-proxy/0.log" Jun 02 19:21:04.700677 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:04.700641 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-gznvb_71138766-b600-428f-91ef-b49974041fbc/istio-proxy/0.log" Jun 02 19:21:04.742067 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:04.742040 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c96dcf58c-hn2d6_c590dacd-1369-4e42-b9ad-e6422b219426/router/0.log" Jun 02 19:21:05.260373 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:05.260348 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dxkps_c0b95f6c-05eb-4df0-bd51-0c267429a4ed/serve-healthcheck-canary/0.log" Jun 02 19:21:05.690331 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:05.690286 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-5hlnl_06a683cd-e489-4964-9795-c06845389ce7/insights-operator/0.log" Jun 02 19:21:05.692798 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:05.692774 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-5hlnl_06a683cd-e489-4964-9795-c06845389ce7/insights-operator/1.log" Jun 02 19:21:05.829066 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:05.829046 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zmnsn_2442935b-316b-48d5-b8c8-bf1b49e53aae/kube-rbac-proxy/0.log" Jun 02 19:21:05.847751 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:05.847722 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zmnsn_2442935b-316b-48d5-b8c8-bf1b49e53aae/exporter/0.log" Jun 02 19:21:05.867956 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:05.867934 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zmnsn_2442935b-316b-48d5-b8c8-bf1b49e53aae/extractor/0.log" Jun 02 19:21:07.859291 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:07.859263 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5d857d74c6-phn8p_e545ae33-55da-45cc-bdec-c0321e2fdb52/nginx/0.log" Jun 02 19:21:07.904434 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:07.904409 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-w62v8_6072fda7-3361-400d-b6d3-60e6e241adb6/manager/0.log" Jun 02 19:21:07.947955 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:07.947929 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-rdwft_98a46f44-1008-4d36-a4dd-0ba82d3ddb62/manager/0.log" Jun 02 19:21:08.018158 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:08.018138 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-tsh6x_f1cac500-4e3b-426a-b064-b3b87f775ab5/server/0.log" Jun 02 19:21:08.081209 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:08.081166 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-lpmcx_72330e33-f830-4b6b-9ddb-89a7207a8062/manager/0.log" Jun 02 19:21:08.248693 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:08.248619 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69b56f574b-gpfx2_bbf59331-3124-486b-957f-303b8637167b/manager/0.log" Jun 02 19:21:08.263497 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:08.263475 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69b56f574b-gpfx2_bbf59331-3124-486b-957f-303b8637167b/copy-manifests/0.log" Jun 02 19:21:08.531379 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:08.531288 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jdvqf/perf-node-gather-daemonset-jx7xz" Jun 02 19:21:14.556475 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:14.556436 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-wt4dt_3fe9da6f-ec9b-4b52-b357-a7ba092cfc4c/migrator/0.log" Jun 02 19:21:14.604397 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:14.604366 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-wt4dt_3fe9da6f-ec9b-4b52-b357-a7ba092cfc4c/graceful-termination/0.log" Jun 02 19:21:15.007787 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:15.007758 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-2pkxz_f6d92fd4-4328-46b7-b3e4-448c1b6bce14/kube-storage-version-migrator-operator/1.log" Jun 02 19:21:15.009489 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:15.009456 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-2pkxz_f6d92fd4-4328-46b7-b3e4-448c1b6bce14/kube-storage-version-migrator-operator/0.log" Jun 02 19:21:16.218165 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:16.218138 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jr7p2_0d46be99-6b62-4c3d-8106-257edfbba1ac/kube-multus-additional-cni-plugins/0.log" Jun 02 19:21:16.237775 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:16.237751 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jr7p2_0d46be99-6b62-4c3d-8106-257edfbba1ac/egress-router-binary-copy/0.log" Jun 02 19:21:16.256684 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:16.256663 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jr7p2_0d46be99-6b62-4c3d-8106-257edfbba1ac/cni-plugins/0.log" Jun 02 19:21:16.273870 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:16.273852 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jr7p2_0d46be99-6b62-4c3d-8106-257edfbba1ac/bond-cni-plugin/0.log" Jun 02 19:21:16.291090 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:16.291069 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jr7p2_0d46be99-6b62-4c3d-8106-257edfbba1ac/routeoverride-cni/0.log" Jun 02 19:21:16.307779 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:16.307758 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jr7p2_0d46be99-6b62-4c3d-8106-257edfbba1ac/whereabouts-cni-bincopy/0.log" Jun 02 19:21:16.326263 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:16.326245 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jr7p2_0d46be99-6b62-4c3d-8106-257edfbba1ac/whereabouts-cni/0.log" Jun 02 19:21:16.518241 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:16.518173 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ncxcn_7cc494a4-baa5-42d9-b4f0-93675ddc7da6/kube-multus/0.log" Jun 02 19:21:16.686252 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:16.686224 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rtm24_c06cfb25-324b-408a-a07f-63de6128d0f3/network-metrics-daemon/0.log" Jun 02 19:21:16.701500 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:16.701472 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rtm24_c06cfb25-324b-408a-a07f-63de6128d0f3/kube-rbac-proxy/0.log" Jun 02 19:21:18.056188 ip-10-0-141-177 kubenswrapper[2557]: I0602 19:21:18.056146 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hstll_fa99b71f-8897-4e26-97f1-40619c45e006/ovn-controller/0.log"