May 21 15:10:28.692387 ip-10-0-142-73 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 21 15:10:28.692400 ip-10-0-142-73 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 21 15:10:28.692410 ip-10-0-142-73 systemd[1]: kubelet.service: Failed with result 'resources'. May 21 15:10:28.692765 ip-10-0-142-73 systemd[1]: Failed to start Kubernetes Kubelet. May 21 15:10:38.752376 ip-10-0-142-73 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 21 15:10:38.752394 ip-10-0-142-73 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 66346759601a4b0fae8f52e4451562ea -- May 21 15:13:05.023632 ip-10-0-142-73 systemd[1]: Starting Kubernetes Kubelet... May 21 15:13:05.475394 ip-10-0-142-73 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 15:13:05.475394 ip-10-0-142-73 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 15:13:05.475394 ip-10-0-142-73 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 15:13:05.475394 ip-10-0-142-73 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 15:13:05.475394 ip-10-0-142-73 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 15:13:05.478426 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.478329 2563 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 15:13:05.481004 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.480989 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 15:13:05.481004 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481004 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 15:13:05.481067 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481008 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 15:13:05.481067 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481011 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 15:13:05.481067 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481015 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 15:13:05.481067 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481018 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 15:13:05.481067 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481021 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 15:13:05.481067 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481023 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 15:13:05.481067 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481026 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 15:13:05.481067 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481029 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 15:13:05.481067 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481032 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 15:13:05.481067 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481034 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 15:13:05.481067 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481037 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 15:13:05.481067 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481040 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 15:13:05.481067 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481042 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 15:13:05.481067 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481045 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 15:13:05.481067 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481048 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 15:13:05.481067 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481051 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 15:13:05.481067 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481054 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 15:13:05.481067 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481057 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 15:13:05.481067 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481060 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 15:13:05.481067 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481063 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 15:13:05.481570 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481065 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 15:13:05.481570 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481068 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 15:13:05.481570 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481071 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 15:13:05.481570 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481074 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 15:13:05.481570 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481077 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 15:13:05.481570 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481080 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 15:13:05.481570 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481083 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 15:13:05.481570 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481086 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 15:13:05.481570 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481089 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 15:13:05.481570 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481092 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 15:13:05.481570 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481094 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 15:13:05.481570 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481097 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 15:13:05.481570 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481099 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 15:13:05.481570 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481102 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 15:13:05.481570 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481105 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 15:13:05.481570 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481108 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 15:13:05.481570 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481110 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 15:13:05.481570 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481113 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 15:13:05.481570 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481115 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 15:13:05.481570 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481118 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 15:13:05.482065 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481120 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 15:13:05.482065 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481123 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 15:13:05.482065 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481126 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 15:13:05.482065 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481129 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 15:13:05.482065 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481131 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 15:13:05.482065 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481134 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 15:13:05.482065 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481136 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 15:13:05.482065 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481140 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 15:13:05.482065 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481142 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 15:13:05.482065 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481145 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 15:13:05.482065 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481147 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 15:13:05.482065 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481150 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 15:13:05.482065 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481153 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 15:13:05.482065 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481156 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 15:13:05.482065 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481158 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 15:13:05.482065 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481161 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 15:13:05.482065 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481164 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 15:13:05.482065 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481168 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 15:13:05.482065 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481172 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 15:13:05.482532 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481176 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 15:13:05.482532 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481180 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 15:13:05.482532 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481183 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 15:13:05.482532 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481186 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 15:13:05.482532 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481189 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 15:13:05.482532 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481191 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 15:13:05.482532 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481194 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 15:13:05.482532 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481197 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 15:13:05.482532 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481199 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 15:13:05.482532 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481202 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 15:13:05.482532 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481205 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 15:13:05.482532 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481207 2563 feature_gate.go:328] unrecognized feature gate: Example May 21 15:13:05.482532 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481216 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 15:13:05.482532 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481219 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 15:13:05.482532 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481222 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 15:13:05.482532 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481225 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 15:13:05.482532 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481228 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 15:13:05.482532 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481231 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 15:13:05.482532 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481233 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 15:13:05.482994 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481236 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 15:13:05.482994 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481239 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 15:13:05.482994 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481242 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 15:13:05.482994 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481245 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 21 15:13:05.482994 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481247 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 15:13:05.482994 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481250 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 15:13:05.482994 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481623 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 15:13:05.482994 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481628 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 15:13:05.482994 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481631 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 15:13:05.482994 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481634 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 15:13:05.482994 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481637 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 15:13:05.482994 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481640 2563 feature_gate.go:328] unrecognized feature gate: Example May 21 15:13:05.482994 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481643 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 15:13:05.482994 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481645 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 15:13:05.482994 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481648 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 15:13:05.482994 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481651 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 15:13:05.482994 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481653 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 15:13:05.482994 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481656 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 15:13:05.482994 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481659 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 15:13:05.482994 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481663 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 15:13:05.483486 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481666 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 15:13:05.483486 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481669 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 15:13:05.483486 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481672 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 15:13:05.483486 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481675 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 15:13:05.483486 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481677 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 15:13:05.483486 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481680 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 15:13:05.483486 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481683 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 15:13:05.483486 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481685 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 15:13:05.483486 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481688 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 15:13:05.483486 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481691 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 15:13:05.483486 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481693 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 15:13:05.483486 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481696 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 21 15:13:05.483486 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481699 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 15:13:05.483486 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481702 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 15:13:05.483486 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481705 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 15:13:05.483486 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481707 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 15:13:05.483486 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481710 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 15:13:05.483486 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481713 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 15:13:05.483486 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481716 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 15:13:05.483968 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481719 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 15:13:05.483968 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481721 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 15:13:05.483968 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481724 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 15:13:05.483968 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481727 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 15:13:05.483968 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481730 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 15:13:05.483968 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481733 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 15:13:05.483968 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481735 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 15:13:05.483968 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481738 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 15:13:05.483968 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481740 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 15:13:05.483968 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481743 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 15:13:05.483968 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481745 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 15:13:05.483968 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481747 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 15:13:05.483968 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481750 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 15:13:05.483968 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481752 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 15:13:05.483968 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481755 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 15:13:05.483968 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481757 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 15:13:05.483968 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481760 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 15:13:05.483968 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481762 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 15:13:05.483968 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481765 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 15:13:05.483968 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481768 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 15:13:05.484484 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481770 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 15:13:05.484484 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481772 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 15:13:05.484484 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481776 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 15:13:05.484484 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481778 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 15:13:05.484484 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481781 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 15:13:05.484484 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481785 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 15:13:05.484484 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481788 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 15:13:05.484484 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481791 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 15:13:05.484484 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481793 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 15:13:05.484484 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481796 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 15:13:05.484484 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481799 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 15:13:05.484484 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481801 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 15:13:05.484484 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481805 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 15:13:05.484484 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481807 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 15:13:05.484484 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481810 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 15:13:05.484484 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481812 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 15:13:05.484484 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481815 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 15:13:05.484484 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481817 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 15:13:05.484484 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481820 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 15:13:05.484966 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481822 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 15:13:05.484966 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481825 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 15:13:05.484966 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481827 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 15:13:05.484966 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481830 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 15:13:05.484966 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481833 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 15:13:05.484966 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481835 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 15:13:05.484966 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481838 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 15:13:05.484966 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481840 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 15:13:05.484966 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481843 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 15:13:05.484966 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481845 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 15:13:05.484966 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481848 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 15:13:05.484966 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481850 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 15:13:05.484966 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481853 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 15:13:05.484966 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.481855 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 15:13:05.484966 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483077 2563 flags.go:64] FLAG: --address="0.0.0.0" May 21 15:13:05.484966 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483090 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 15:13:05.484966 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483100 2563 flags.go:64] FLAG: --anonymous-auth="true" May 21 15:13:05.484966 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483105 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 15:13:05.484966 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483108 2563 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 15:13:05.484966 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483112 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 15:13:05.484966 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483116 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 15:13:05.485516 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483121 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 15:13:05.485516 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483124 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 15:13:05.485516 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483127 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 15:13:05.485516 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483130 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 15:13:05.485516 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483134 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 15:13:05.485516 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483138 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 15:13:05.485516 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483141 2563 flags.go:64] FLAG: --cgroup-root="" May 21 15:13:05.485516 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483144 2563 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 15:13:05.485516 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483147 2563 flags.go:64] FLAG: --client-ca-file="" May 21 15:13:05.485516 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483150 2563 flags.go:64] FLAG: --cloud-config="" May 21 15:13:05.485516 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483153 2563 flags.go:64] FLAG: --cloud-provider="external" May 21 15:13:05.485516 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483156 2563 flags.go:64] FLAG: --cluster-dns="[]" May 21 15:13:05.485516 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483161 2563 flags.go:64] FLAG: --cluster-domain="" May 21 15:13:05.485516 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483164 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 15:13:05.485516 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483167 2563 flags.go:64] FLAG: --config-dir="" May 21 15:13:05.485516 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483170 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 15:13:05.485516 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483173 2563 flags.go:64] FLAG: --container-log-max-files="5" May 21 15:13:05.485516 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483177 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 15:13:05.485516 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483180 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 15:13:05.485516 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483183 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 15:13:05.485516 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483186 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 15:13:05.485516 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483190 2563 flags.go:64] FLAG: --contention-profiling="false" May 21 15:13:05.485516 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483197 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 15:13:05.485516 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483200 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 15:13:05.486132 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483203 2563 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 15:13:05.486132 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483206 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 15:13:05.486132 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483211 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 15:13:05.486132 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483214 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 15:13:05.486132 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483217 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 15:13:05.486132 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483220 2563 flags.go:64] FLAG: --enable-load-reader="false" May 21 15:13:05.486132 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483223 2563 flags.go:64] FLAG: --enable-server="true" May 21 15:13:05.486132 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483226 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 15:13:05.486132 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483230 2563 flags.go:64] FLAG: --event-burst="100" May 21 15:13:05.486132 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483233 2563 flags.go:64] FLAG: --event-qps="50" May 21 15:13:05.486132 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483236 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 15:13:05.486132 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483239 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 15:13:05.486132 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483242 2563 flags.go:64] FLAG: --eviction-hard="" May 21 15:13:05.486132 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483245 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 15:13:05.486132 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483248 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 15:13:05.486132 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483251 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 15:13:05.486132 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483254 2563 flags.go:64] FLAG: --eviction-soft="" May 21 15:13:05.486132 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483257 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 15:13:05.486132 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483260 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 15:13:05.486132 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483263 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 15:13:05.486132 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483266 2563 flags.go:64] FLAG: --experimental-mounter-path="" May 21 15:13:05.486132 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483269 2563 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 15:13:05.486132 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483272 2563 flags.go:64] FLAG: --fail-swap-on="true" May 21 15:13:05.486132 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483275 2563 flags.go:64] FLAG: --feature-gates="" May 21 15:13:05.486132 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483279 2563 flags.go:64] FLAG: --file-check-frequency="20s" May 21 15:13:05.486765 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483282 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 15:13:05.486765 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483285 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 15:13:05.486765 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483288 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 15:13:05.486765 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483291 2563 flags.go:64] FLAG: --healthz-port="10248" May 21 15:13:05.486765 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483295 2563 flags.go:64] FLAG: --help="false" May 21 15:13:05.486765 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483300 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-142-73.ec2.internal" May 21 15:13:05.486765 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483303 2563 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 15:13:05.486765 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483306 2563 flags.go:64] FLAG: --http-check-frequency="20s" May 21 15:13:05.486765 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483309 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 15:13:05.486765 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483312 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 15:13:05.486765 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483316 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 15:13:05.486765 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483318 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 15:13:05.486765 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483322 2563 flags.go:64] FLAG: --image-service-endpoint="" May 21 15:13:05.486765 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483325 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 15:13:05.486765 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483328 2563 flags.go:64] FLAG: --kube-api-burst="100" May 21 15:13:05.486765 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483331 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 15:13:05.486765 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483344 2563 flags.go:64] FLAG: --kube-api-qps="50" May 21 15:13:05.486765 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483347 2563 flags.go:64] FLAG: --kube-reserved="" May 21 15:13:05.486765 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483351 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 15:13:05.486765 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483353 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 15:13:05.486765 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483356 2563 flags.go:64] FLAG: --kubelet-cgroups="" May 21 15:13:05.486765 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483359 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 15:13:05.486765 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483363 2563 flags.go:64] FLAG: --lock-file="" May 21 15:13:05.486765 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483366 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 15:13:05.487356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483369 2563 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 15:13:05.487356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483372 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 15:13:05.487356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483377 2563 flags.go:64] FLAG: --log-json-split-stream="false" May 21 15:13:05.487356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483380 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 15:13:05.487356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483383 2563 flags.go:64] FLAG: --log-text-split-stream="false" May 21 15:13:05.487356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483386 2563 flags.go:64] FLAG: --logging-format="text" May 21 15:13:05.487356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483389 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 15:13:05.487356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483393 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 15:13:05.487356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483396 2563 flags.go:64] FLAG: --manifest-url="" May 21 15:13:05.487356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483398 2563 flags.go:64] FLAG: --manifest-url-header="" May 21 15:13:05.487356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483403 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 15:13:05.487356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483406 2563 flags.go:64] FLAG: --max-open-files="1000000" May 21 15:13:05.487356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483411 2563 flags.go:64] FLAG: --max-pods="110" May 21 15:13:05.487356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483415 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 15:13:05.487356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483418 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 15:13:05.487356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483421 2563 flags.go:64] FLAG: --memory-manager-policy="None" May 21 15:13:05.487356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483424 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 15:13:05.487356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483427 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 15:13:05.487356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483430 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 15:13:05.487356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483433 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 15:13:05.487356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483440 2563 flags.go:64] FLAG: --node-status-max-images="50" May 21 15:13:05.487356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483444 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 15:13:05.487356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483447 2563 flags.go:64] FLAG: --oom-score-adj="-999" May 21 15:13:05.487356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483449 2563 flags.go:64] FLAG: --pod-cidr="" May 21 15:13:05.487989 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483452 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 15:13:05.487989 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483458 2563 flags.go:64] FLAG: --pod-manifest-path="" May 21 15:13:05.487989 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483461 2563 flags.go:64] FLAG: --pod-max-pids="-1" May 21 15:13:05.487989 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483464 2563 flags.go:64] FLAG: --pods-per-core="0" May 21 15:13:05.487989 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483467 2563 flags.go:64] FLAG: --port="10250" May 21 15:13:05.487989 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483470 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 15:13:05.487989 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483473 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00e0dfbf2a34f4448" May 21 15:13:05.487989 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483476 2563 flags.go:64] FLAG: --qos-reserved="" May 21 15:13:05.487989 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483479 2563 flags.go:64] FLAG: --read-only-port="10255" May 21 15:13:05.487989 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483482 2563 flags.go:64] FLAG: --register-node="true" May 21 15:13:05.487989 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483485 2563 flags.go:64] FLAG: --register-schedulable="true" May 21 15:13:05.487989 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483488 2563 flags.go:64] FLAG: --register-with-taints="" May 21 15:13:05.487989 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483491 2563 flags.go:64] FLAG: --registry-burst="10" May 21 15:13:05.487989 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483494 2563 flags.go:64] FLAG: --registry-qps="5" May 21 15:13:05.487989 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483497 2563 flags.go:64] FLAG: --reserved-cpus="" May 21 15:13:05.487989 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483500 2563 flags.go:64] FLAG: --reserved-memory="" May 21 15:13:05.487989 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483504 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 15:13:05.487989 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483507 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 15:13:05.487989 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483510 2563 flags.go:64] FLAG: --rotate-certificates="false" May 21 15:13:05.487989 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483513 2563 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 15:13:05.487989 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483516 2563 flags.go:64] FLAG: --runonce="false" May 21 15:13:05.487989 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483519 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 15:13:05.487989 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483523 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 15:13:05.487989 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483526 2563 flags.go:64] FLAG: --seccomp-default="false" May 21 15:13:05.487989 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483528 2563 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 15:13:05.488606 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483531 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 15:13:05.488606 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483535 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 15:13:05.488606 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483538 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 15:13:05.488606 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483540 2563 flags.go:64] FLAG: --storage-driver-password="root" May 21 15:13:05.488606 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483543 2563 flags.go:64] FLAG: --storage-driver-secure="false" May 21 15:13:05.488606 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483546 2563 flags.go:64] FLAG: --storage-driver-table="stats" May 21 15:13:05.488606 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483549 2563 flags.go:64] FLAG: --storage-driver-user="root" May 21 15:13:05.488606 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483552 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 15:13:05.488606 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483555 2563 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 15:13:05.488606 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483558 2563 flags.go:64] FLAG: --system-cgroups="" May 21 15:13:05.488606 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483561 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 15:13:05.488606 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483566 2563 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 15:13:05.488606 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483569 2563 flags.go:64] FLAG: --tls-cert-file="" May 21 15:13:05.488606 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483572 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 15:13:05.488606 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483577 2563 flags.go:64] FLAG: --tls-min-version="" May 21 15:13:05.488606 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483580 2563 flags.go:64] FLAG: --tls-private-key-file="" May 21 15:13:05.488606 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483582 2563 flags.go:64] FLAG: --topology-manager-policy="none" May 21 15:13:05.488606 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483585 2563 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 15:13:05.488606 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483588 2563 flags.go:64] FLAG: --topology-manager-scope="container" May 21 15:13:05.488606 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483591 2563 flags.go:64] FLAG: --v="2" May 21 15:13:05.488606 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483595 2563 flags.go:64] FLAG: --version="false" May 21 15:13:05.488606 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483599 2563 flags.go:64] FLAG: --vmodule="" May 21 15:13:05.488606 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483603 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 15:13:05.488606 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.483606 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 15:13:05.488606 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483693 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 15:13:05.489212 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483696 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 15:13:05.489212 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483699 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 15:13:05.489212 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483702 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 15:13:05.489212 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483705 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 15:13:05.489212 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483708 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 15:13:05.489212 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483711 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 15:13:05.489212 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483713 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 15:13:05.489212 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483716 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 15:13:05.489212 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483719 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 15:13:05.489212 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483721 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 15:13:05.489212 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483724 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 15:13:05.489212 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483728 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 15:13:05.489212 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483730 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 15:13:05.489212 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483733 2563 feature_gate.go:328] unrecognized feature gate: Example May 21 15:13:05.489212 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483738 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 15:13:05.489212 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483742 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 15:13:05.489212 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483745 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 15:13:05.489212 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483747 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 15:13:05.489212 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483750 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 15:13:05.489212 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483753 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 15:13:05.489725 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483755 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 15:13:05.489725 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483758 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 15:13:05.489725 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483760 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 15:13:05.489725 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483763 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 15:13:05.489725 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483765 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 15:13:05.489725 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483768 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 15:13:05.489725 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483770 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 15:13:05.489725 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483773 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 15:13:05.489725 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483775 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 15:13:05.489725 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483778 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 15:13:05.489725 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483780 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 15:13:05.489725 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483783 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 15:13:05.489725 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483785 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 15:13:05.489725 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483788 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 15:13:05.489725 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483791 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 15:13:05.489725 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483794 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 15:13:05.489725 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483796 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 15:13:05.489725 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483799 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 15:13:05.489725 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483802 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 15:13:05.489725 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483804 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 15:13:05.490238 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483807 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 15:13:05.490238 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483810 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 15:13:05.490238 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483812 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 15:13:05.490238 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483815 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 15:13:05.490238 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483817 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 15:13:05.490238 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483820 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 15:13:05.490238 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483822 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 15:13:05.490238 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483835 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 15:13:05.490238 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483837 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 15:13:05.490238 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483840 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 15:13:05.490238 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483843 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 15:13:05.490238 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483845 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 15:13:05.490238 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483848 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 15:13:05.490238 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483850 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 15:13:05.490238 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483853 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 15:13:05.490238 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483855 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 15:13:05.490238 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483858 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 15:13:05.490238 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483860 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 15:13:05.490238 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483863 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 15:13:05.490238 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483865 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 15:13:05.491003 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483868 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 15:13:05.491003 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483871 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 15:13:05.491003 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483874 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 15:13:05.491003 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483876 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 21 15:13:05.491003 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483879 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 15:13:05.491003 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483881 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 15:13:05.491003 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483887 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 15:13:05.491003 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483889 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 15:13:05.491003 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483892 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 15:13:05.491003 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483894 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 15:13:05.491003 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483897 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 15:13:05.491003 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483899 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 15:13:05.491003 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483902 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 15:13:05.491003 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483905 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 15:13:05.491003 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483907 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 15:13:05.491003 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483910 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 15:13:05.491003 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483912 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 15:13:05.491003 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483915 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 15:13:05.491003 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483917 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 15:13:05.491003 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483921 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 15:13:05.491650 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483923 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 15:13:05.491650 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483926 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 15:13:05.491650 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483928 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 15:13:05.491650 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483932 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 15:13:05.491650 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.483935 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 15:13:05.491650 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.484558 2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 15:13:05.491650 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.491603 2563 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 15:13:05.491650 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.491619 2563 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 15:13:05.491878 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491666 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 15:13:05.491878 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491672 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 15:13:05.491878 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491675 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 15:13:05.491878 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491678 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 15:13:05.491878 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491681 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 15:13:05.491878 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491684 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 15:13:05.491878 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491687 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 15:13:05.491878 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491689 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 15:13:05.491878 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491693 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 15:13:05.491878 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491695 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 15:13:05.491878 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491698 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 15:13:05.491878 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491701 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 15:13:05.491878 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491704 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 15:13:05.491878 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491706 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 15:13:05.491878 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491709 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 15:13:05.491878 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491711 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 15:13:05.491878 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491714 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 15:13:05.491878 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491717 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 15:13:05.491878 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491720 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 15:13:05.491878 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491722 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 15:13:05.492472 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491725 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 21 15:13:05.492472 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491734 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 15:13:05.492472 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491737 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 15:13:05.492472 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491740 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 15:13:05.492472 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491743 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 15:13:05.492472 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491745 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 15:13:05.492472 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491748 2563 feature_gate.go:328] unrecognized feature gate: Example May 21 15:13:05.492472 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491751 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 15:13:05.492472 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491753 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 15:13:05.492472 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491756 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 15:13:05.492472 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491758 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 15:13:05.492472 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491761 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 15:13:05.492472 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491764 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 15:13:05.492472 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491767 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 15:13:05.492472 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491771 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 15:13:05.492472 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491773 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 15:13:05.492472 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491776 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 15:13:05.492472 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491779 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 15:13:05.492472 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491781 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 15:13:05.492472 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491784 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 15:13:05.492973 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491787 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 15:13:05.492973 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491789 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 15:13:05.492973 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491792 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 15:13:05.492973 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491794 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 15:13:05.492973 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491797 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 15:13:05.492973 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491799 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 15:13:05.492973 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491802 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 15:13:05.492973 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491804 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 15:13:05.492973 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491807 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 15:13:05.492973 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491810 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 15:13:05.492973 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491814 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 15:13:05.492973 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491819 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 15:13:05.492973 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491822 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 15:13:05.492973 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491835 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 15:13:05.492973 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491839 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 15:13:05.492973 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491842 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 15:13:05.492973 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491846 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 15:13:05.492973 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491849 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 15:13:05.492973 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491852 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 15:13:05.493451 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491855 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 15:13:05.493451 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491858 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 15:13:05.493451 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491860 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 15:13:05.493451 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491863 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 15:13:05.493451 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491865 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 15:13:05.493451 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491867 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 15:13:05.493451 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491871 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 15:13:05.493451 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491874 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 15:13:05.493451 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491876 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 15:13:05.493451 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491879 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 15:13:05.493451 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491882 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 15:13:05.493451 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491885 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 15:13:05.493451 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491888 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 15:13:05.493451 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491891 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 15:13:05.493451 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491893 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 15:13:05.493451 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491896 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 15:13:05.493451 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491899 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 15:13:05.493451 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491903 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 15:13:05.493451 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491905 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 15:13:05.493451 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491925 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 15:13:05.493928 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491929 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 15:13:05.493928 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491932 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 15:13:05.493928 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491935 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 15:13:05.493928 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491937 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 15:13:05.493928 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491940 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 15:13:05.493928 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491942 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 15:13:05.493928 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.491945 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 15:13:05.493928 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.491950 2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 15:13:05.493928 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492046 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 15:13:05.493928 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492052 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 15:13:05.493928 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492056 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 15:13:05.493928 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492059 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 15:13:05.493928 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492062 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 15:13:05.493928 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492064 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 15:13:05.493928 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492067 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 15:13:05.494294 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492070 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 15:13:05.494294 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492073 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 15:13:05.494294 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492075 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 15:13:05.494294 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492078 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 15:13:05.494294 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492081 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 15:13:05.494294 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492084 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 15:13:05.494294 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492086 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 15:13:05.494294 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492089 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 15:13:05.494294 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492092 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 15:13:05.494294 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492094 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 15:13:05.494294 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492097 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 15:13:05.494294 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492099 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 15:13:05.494294 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492102 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 15:13:05.494294 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492105 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 15:13:05.494294 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492107 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 15:13:05.494294 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492110 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 15:13:05.494294 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492113 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 15:13:05.494294 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492115 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 15:13:05.494294 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492118 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 15:13:05.494294 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492121 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 15:13:05.494791 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492124 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 15:13:05.494791 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492127 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 15:13:05.494791 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492131 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 15:13:05.494791 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492134 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 15:13:05.494791 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492136 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 15:13:05.494791 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492139 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 15:13:05.494791 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492141 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 15:13:05.494791 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492144 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 15:13:05.494791 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492146 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 15:13:05.494791 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492149 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 15:13:05.494791 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492151 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 15:13:05.494791 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492154 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 15:13:05.494791 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492157 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 15:13:05.494791 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492159 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 15:13:05.494791 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492161 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 15:13:05.494791 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492164 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 15:13:05.494791 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492167 2563 feature_gate.go:328] unrecognized feature gate: Example May 21 15:13:05.494791 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492170 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 15:13:05.494791 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492172 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 15:13:05.495295 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492175 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 15:13:05.495295 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492177 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 15:13:05.495295 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492180 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 15:13:05.495295 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492182 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 15:13:05.495295 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492185 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 15:13:05.495295 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492187 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 15:13:05.495295 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492189 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 15:13:05.495295 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492192 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 15:13:05.495295 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492194 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 15:13:05.495295 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492198 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 15:13:05.495295 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492201 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 15:13:05.495295 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492204 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 15:13:05.495295 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492206 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 15:13:05.495295 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492209 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 15:13:05.495295 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492211 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 21 15:13:05.495295 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492214 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 15:13:05.495295 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492216 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 15:13:05.495295 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492219 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 15:13:05.495295 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492221 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 15:13:05.495765 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492224 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 15:13:05.495765 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492227 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 15:13:05.495765 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492229 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 15:13:05.495765 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492231 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 15:13:05.495765 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492234 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 15:13:05.495765 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492236 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 15:13:05.495765 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492239 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 15:13:05.495765 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492241 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 15:13:05.495765 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492244 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 15:13:05.495765 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492247 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 15:13:05.495765 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492249 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 15:13:05.495765 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492252 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 15:13:05.495765 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492255 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 15:13:05.495765 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492258 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 15:13:05.495765 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492260 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 15:13:05.495765 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492263 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 15:13:05.495765 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492265 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 15:13:05.495765 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492268 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 15:13:05.495765 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492270 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 15:13:05.495765 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492273 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 15:13:05.496253 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:05.492275 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 15:13:05.496253 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.492280 2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 15:13:05.496253 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.493080 2563 server.go:962] "Client rotation is on, will bootstrap in background" May 21 15:13:05.497265 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.497252 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 15:13:05.498204 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.498192 2563 server.go:1019] "Starting client certificate rotation" May 21 15:13:05.498314 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.498297 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 15:13:05.498379 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.498357 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 15:13:05.524345 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.524314 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 15:13:05.529685 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.529669 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 15:13:05.541924 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.541910 2563 log.go:25] "Validated CRI v1 runtime API" May 21 15:13:05.546500 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.546485 2563 log.go:25] "Validated CRI v1 image API" May 21 15:13:05.551114 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.551096 2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 15:13:05.552196 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.552177 2563 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 15:13:05.555218 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.555198 2563 fs.go:135] Filesystem UUIDs: map[5d9058a5-625c-47f3-9489-6691d11c1006:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d512c66b-cee8-446f-a2bd-cc17a59cc95f:/dev/nvme0n1p3] May 21 15:13:05.555273 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.555218 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 15:13:05.560006 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.559905 2563 manager.go:217] Machine: {Timestamp:2026-05-21 15:13:05.559405006 +0000 UTC m=+0.410847252 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100785 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21b6f8e42cdd024dbe02e0a51e1f86 SystemUUID:ec21b6f8-e42c-dd02-4dbe-02e0a51e1f86 BootID:66346759-601a-4b0f-ae8f-52e4451562ea Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:92:83:7b:4e:89 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:92:83:7b:4e:89 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:0c:ff:14:2c:2e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 15:13:05.560841 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.560831 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 15:13:05.560913 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.560900 2563 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 15:13:05.563839 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.563802 2563 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 15:13:05.563961 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.563841 2563 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-73.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 15:13:05.564005 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.563970 2563 topology_manager.go:138] "Creating topology manager with none policy" May 21 15:13:05.564005 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.563979 2563 container_manager_linux.go:306] "Creating device plugin manager" May 21 15:13:05.564005 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.563986 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 15:13:05.565646 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.565636 2563 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 15:13:05.567225 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.567215 2563 state_mem.go:36] "Initialized new in-memory state store" May 21 15:13:05.567328 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.567319 2563 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 15:13:05.569610 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.569601 2563 kubelet.go:491] "Attempting to sync node with API server" May 21 15:13:05.569645 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.569619 2563 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 15:13:05.569645 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.569630 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 15:13:05.569645 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.569638 2563 kubelet.go:397] "Adding apiserver pod source" May 21 15:13:05.569760 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.569647 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 15:13:05.571313 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.571302 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 15:13:05.571377 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.571321 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 15:13:05.574287 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.574269 2563 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 15:13:05.576081 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.576065 2563 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 15:13:05.576957 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.576944 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 15:13:05.577008 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.576961 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 15:13:05.577008 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.576967 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 15:13:05.577008 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.576972 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 15:13:05.577008 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.576981 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 15:13:05.577008 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.576986 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 15:13:05.577008 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.576992 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 15:13:05.577008 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.576997 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 15:13:05.577008 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.577005 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 15:13:05.577008 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.577011 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 15:13:05.577225 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.577019 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 15:13:05.577323 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.577312 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 15:13:05.579671 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.579659 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 15:13:05.579712 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.579673 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 15:13:05.582861 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.582846 2563 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 15:13:05.582937 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.582889 2563 server.go:1295] "Started kubelet" May 21 15:13:05.583048 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.583025 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 15:13:05.583199 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.583000 2563 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 15:13:05.583254 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.583218 2563 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 15:13:05.583558 ip-10-0-142-73 systemd[1]: Started Kubernetes Kubelet. May 21 15:13:05.584103 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:05.583672 2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-73.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 15:13:05.584103 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:05.583701 2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 15:13:05.584103 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.583766 2563 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-73.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 15:13:05.584384 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.584360 2563 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 15:13:05.585562 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.585550 2563 server.go:317] "Adding debug handlers to kubelet server" May 21 15:13:05.589597 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.589576 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 15:13:05.590076 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.590059 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 15:13:05.590203 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.590185 2563 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 15:13:05.590274 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.590207 2563 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 15:13:05.590274 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.590247 2563 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 15:13:05.590390 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.590302 2563 reconstruct.go:97] "Volume reconstruction finished" May 21 15:13:05.590390 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.590310 2563 reconciler.go:26] "Reconciler: start to sync state" May 21 15:13:05.590703 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.590682 2563 factory.go:55] Registering systemd factory May 21 15:13:05.590703 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.590701 2563 factory.go:223] Registration of the systemd container factory successfully May 21 15:13:05.590993 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:05.590972 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-73.ec2.internal\" not found" May 21 15:13:05.591055 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.591033 2563 factory.go:153] Registering CRI-O factory May 21 15:13:05.591055 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.591046 2563 factory.go:223] Registration of the crio container factory successfully May 21 15:13:05.591117 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.591096 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 15:13:05.591117 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.591112 2563 factory.go:103] Registering Raw factory May 21 15:13:05.591173 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.591131 2563 manager.go:1196] Started watching for new ooms in manager May 21 15:13:05.592095 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.592079 2563 manager.go:319] Starting recovery of all containers May 21 15:13:05.592183 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:05.592114 2563 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 15:13:05.594574 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.594510 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7wk7h" May 21 15:13:05.595112 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:05.595077 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-73.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 21 15:13:05.598088 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:05.594620 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-73.ec2.internal.18b19d65286284c9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-73.ec2.internal,UID:ip-10-0-142-73.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-73.ec2.internal,},FirstTimestamp:2026-05-21 15:13:05.582859465 +0000 UTC m=+0.434301711,LastTimestamp:2026-05-21 15:13:05.582859465 +0000 UTC m=+0.434301711,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-73.ec2.internal,}" May 21 15:13:05.601440 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.601423 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7wk7h" May 21 15:13:05.601563 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.601520 2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 15:13:05.603738 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:05.603716 2563 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 21 15:13:05.606947 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.606789 2563 manager.go:324] Recovery completed May 21 15:13:05.608619 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:05.608531 2563 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": readdirent /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory May 21 15:13:05.611664 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.611653 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 15:13:05.613448 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.613433 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-73.ec2.internal" event="NodeHasSufficientMemory" May 21 15:13:05.613515 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.613460 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-73.ec2.internal" event="NodeHasNoDiskPressure" May 21 15:13:05.613515 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.613470 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-73.ec2.internal" event="NodeHasSufficientPID" May 21 15:13:05.613957 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.613944 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 15:13:05.614006 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.613958 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 15:13:05.614006 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.613973 2563 state_mem.go:36] "Initialized new in-memory state store" May 21 15:13:05.616325 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.616314 2563 policy_none.go:49] "None policy: Start" May 21 15:13:05.616373 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.616330 2563 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 15:13:05.616373 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.616356 2563 state_mem.go:35] "Initializing new in-memory state store" May 21 15:13:05.657914 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.657900 2563 manager.go:341] "Starting Device Plugin manager" May 21 15:13:05.677778 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:05.657936 2563 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 15:13:05.677778 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.657945 2563 server.go:85] "Starting device plugin registration server" May 21 15:13:05.677778 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.658202 2563 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 15:13:05.677778 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.658212 2563 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 15:13:05.677778 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.658293 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 15:13:05.677778 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.658393 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 15:13:05.677778 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.658403 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 15:13:05.677778 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:05.658913 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 15:13:05.677778 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:05.658955 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-73.ec2.internal\" not found" May 21 15:13:05.711548 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.711520 2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 15:13:05.711548 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.711549 2563 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 15:13:05.711705 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.711577 2563 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 15:13:05.711705 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.711587 2563 kubelet.go:2451] "Starting kubelet main sync loop" May 21 15:13:05.711705 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:05.711632 2563 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 15:13:05.713803 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.713779 2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 15:13:05.758584 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.758527 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 15:13:05.759365 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.759349 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-73.ec2.internal" event="NodeHasSufficientMemory" May 21 15:13:05.759444 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.759379 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-73.ec2.internal" event="NodeHasNoDiskPressure" May 21 15:13:05.759444 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.759389 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-73.ec2.internal" event="NodeHasSufficientPID" May 21 15:13:05.759444 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.759411 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-73.ec2.internal" May 21 15:13:05.768405 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.768391 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-73.ec2.internal" May 21 15:13:05.768461 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:05.768412 2563 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-73.ec2.internal\": node \"ip-10-0-142-73.ec2.internal\" not found" May 21 15:13:05.786633 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:05.786612 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-73.ec2.internal\" not found" May 21 15:13:05.811852 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.811817 2563 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-73.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-73.ec2.internal"] May 21 15:13:05.811935 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.811897 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 15:13:05.813535 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.813519 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-73.ec2.internal" event="NodeHasSufficientMemory" May 21 15:13:05.813623 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.813551 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-73.ec2.internal" event="NodeHasNoDiskPressure" May 21 15:13:05.813623 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.813564 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-73.ec2.internal" event="NodeHasSufficientPID" May 21 15:13:05.814951 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.814936 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 15:13:05.815091 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.815076 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-73.ec2.internal" May 21 15:13:05.815141 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.815106 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 15:13:05.815695 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.815677 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-73.ec2.internal" event="NodeHasSufficientMemory" May 21 15:13:05.815798 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.815703 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-73.ec2.internal" event="NodeHasNoDiskPressure" May 21 15:13:05.815798 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.815718 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-73.ec2.internal" event="NodeHasSufficientPID" May 21 15:13:05.815798 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.815684 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-73.ec2.internal" event="NodeHasSufficientMemory" May 21 15:13:05.815798 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.815746 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-73.ec2.internal" event="NodeHasNoDiskPressure" May 21 15:13:05.815798 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.815758 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-73.ec2.internal" event="NodeHasSufficientPID" May 21 15:13:05.816978 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.816962 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-73.ec2.internal" May 21 15:13:05.817058 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.816993 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 15:13:05.817669 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.817655 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-73.ec2.internal" event="NodeHasSufficientMemory" May 21 15:13:05.817760 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.817681 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-73.ec2.internal" event="NodeHasNoDiskPressure" May 21 15:13:05.817760 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.817695 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-73.ec2.internal" event="NodeHasSufficientPID" May 21 15:13:05.849988 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:05.849968 2563 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-73.ec2.internal\" not found" node="ip-10-0-142-73.ec2.internal" May 21 15:13:05.854247 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:05.854229 2563 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-73.ec2.internal\" not found" node="ip-10-0-142-73.ec2.internal" May 21 15:13:05.886837 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:05.886815 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-73.ec2.internal\" not found" May 21 15:13:05.892040 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.892014 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/245c67db9059ef1be566ab2dc7a616d5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-73.ec2.internal\" (UID: \"245c67db9059ef1be566ab2dc7a616d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-73.ec2.internal" May 21 15:13:05.892118 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.892044 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/245c67db9059ef1be566ab2dc7a616d5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-73.ec2.internal\" (UID: \"245c67db9059ef1be566ab2dc7a616d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-73.ec2.internal" May 21 15:13:05.892118 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.892062 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8ed101524a28eb48a53f5654af1a1159-config\") pod \"kube-apiserver-proxy-ip-10-0-142-73.ec2.internal\" (UID: \"8ed101524a28eb48a53f5654af1a1159\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-73.ec2.internal" May 21 15:13:05.987708 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:05.987685 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-73.ec2.internal\" not found" May 21 15:13:05.993045 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.993028 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/245c67db9059ef1be566ab2dc7a616d5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-73.ec2.internal\" (UID: \"245c67db9059ef1be566ab2dc7a616d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-73.ec2.internal" May 21 15:13:05.993096 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.993080 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/245c67db9059ef1be566ab2dc7a616d5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-73.ec2.internal\" (UID: \"245c67db9059ef1be566ab2dc7a616d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-73.ec2.internal" May 21 15:13:05.993130 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.993119 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/245c67db9059ef1be566ab2dc7a616d5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-73.ec2.internal\" (UID: \"245c67db9059ef1be566ab2dc7a616d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-73.ec2.internal" May 21 15:13:05.993166 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.993141 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8ed101524a28eb48a53f5654af1a1159-config\") pod \"kube-apiserver-proxy-ip-10-0-142-73.ec2.internal\" (UID: \"8ed101524a28eb48a53f5654af1a1159\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-73.ec2.internal" May 21 15:13:05.993197 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.993169 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8ed101524a28eb48a53f5654af1a1159-config\") pod \"kube-apiserver-proxy-ip-10-0-142-73.ec2.internal\" (UID: \"8ed101524a28eb48a53f5654af1a1159\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-73.ec2.internal" May 21 15:13:05.993228 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:05.993209 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/245c67db9059ef1be566ab2dc7a616d5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-73.ec2.internal\" (UID: \"245c67db9059ef1be566ab2dc7a616d5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-73.ec2.internal" May 21 15:13:06.088461 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:06.088400 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-73.ec2.internal\" not found" May 21 15:13:06.152868 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:06.152841 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-73.ec2.internal" May 21 15:13:06.156494 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:06.156476 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-73.ec2.internal" May 21 15:13:06.188626 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:06.188605 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-73.ec2.internal\" not found" May 21 15:13:06.289090 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:06.289066 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-73.ec2.internal\" not found" May 21 15:13:06.389552 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:06.389500 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-73.ec2.internal\" not found" May 21 15:13:06.489929 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:06.489905 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-73.ec2.internal\" not found" May 21 15:13:06.498270 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:06.498253 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 15:13:06.498410 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:06.498395 2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 15:13:06.589994 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:06.589968 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 15:13:06.590117 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:06.589973 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-73.ec2.internal\" not found" May 21 15:13:06.596390 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:06.596373 2563 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 15:13:06.602088 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:06.602069 2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 15:13:06.603107 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:06.603076 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 15:08:05 +0000 UTC" deadline="2027-11-29 10:14:55.737961896 +0000 UTC" May 21 15:13:06.603183 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:06.603108 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13363h1m49.134858062s" May 21 15:13:06.632404 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:06.632381 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7s7tt" May 21 15:13:06.640490 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:06.640440 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7s7tt" May 21 15:13:06.686458 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:06.686424 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod245c67db9059ef1be566ab2dc7a616d5.slice/crio-d540e297df6c0abbc09d8b3cea61e6a36740ac4cb2f40eee0d72a383e5f6a510 WatchSource:0}: Error finding container d540e297df6c0abbc09d8b3cea61e6a36740ac4cb2f40eee0d72a383e5f6a510: Status 404 returned error can't find the container with id d540e297df6c0abbc09d8b3cea61e6a36740ac4cb2f40eee0d72a383e5f6a510 May 21 15:13:06.688546 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:06.688528 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ed101524a28eb48a53f5654af1a1159.slice/crio-caafaea0c84e4a7f9a74634880ffb6f549f46ea73f00254c98609179c0bd02b8 WatchSource:0}: Error finding container caafaea0c84e4a7f9a74634880ffb6f549f46ea73f00254c98609179c0bd02b8: Status 404 returned error can't find the container with id caafaea0c84e4a7f9a74634880ffb6f549f46ea73f00254c98609179c0bd02b8 May 21 15:13:06.690487 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:06.690464 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-73.ec2.internal\" not found" May 21 15:13:06.690581 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:06.690566 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 15:13:06.695204 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:06.695185 2563 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 15:13:06.714567 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:06.714524 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-73.ec2.internal" event={"ID":"8ed101524a28eb48a53f5654af1a1159","Type":"ContainerStarted","Data":"caafaea0c84e4a7f9a74634880ffb6f549f46ea73f00254c98609179c0bd02b8"} May 21 15:13:06.715506 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:06.715483 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-73.ec2.internal" event={"ID":"245c67db9059ef1be566ab2dc7a616d5","Type":"ContainerStarted","Data":"d540e297df6c0abbc09d8b3cea61e6a36740ac4cb2f40eee0d72a383e5f6a510"} May 21 15:13:06.790710 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:06.790676 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-142-73.ec2.internal\" not found" May 21 15:13:06.830312 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:06.830291 2563 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 15:13:06.890374 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:06.890329 2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-73.ec2.internal" May 21 15:13:06.908862 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:06.908809 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 15:13:06.909716 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:06.909702 2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-73.ec2.internal" May 21 15:13:06.918041 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:06.918025 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 15:13:07.570797 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.570766 2563 apiserver.go:52] "Watching apiserver" May 21 15:13:07.575906 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.575885 2563 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 15:13:07.577066 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.577011 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-75xw9","kube-system/kube-apiserver-proxy-ip-10-0-142-73.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbhjj","openshift-dns/node-resolver-qk6gn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-73.ec2.internal","openshift-multus/multus-additional-cni-plugins-57tbw","openshift-multus/network-metrics-daemon-rm6dz","openshift-network-operator/iptables-alerter-fdx2f","openshift-cluster-node-tuning-operator/tuned-55t5c","openshift-image-registry/node-ca-kvk52","openshift-multus/multus-bd4zt","openshift-network-diagnostics/network-check-target-6d2bf","openshift-ovn-kubernetes/ovnkube-node-kvwxg"] May 21 15:13:07.578447 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.578426 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kvk52" May 21 15:13:07.579646 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.579614 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbhjj" May 21 15:13:07.580151 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.580128 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 15:13:07.580259 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.580170 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 15:13:07.580259 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.580201 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 15:13:07.580380 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.580318 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8gchs\"" May 21 15:13:07.581017 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.581001 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-57tbw" May 21 15:13:07.581642 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.581623 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 15:13:07.581785 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.581762 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 15:13:07.581878 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.581866 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jzt5z\"" May 21 15:13:07.582582 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.581853 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 15:13:07.582582 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.582281 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:13:07.582582 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:07.582370 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm6dz" podUID="a3f19b43-b2b6-47dc-a66e-e447f95fa680" May 21 15:13:07.582742 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.582702 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 15:13:07.583219 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.582852 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 15:13:07.583219 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.582931 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bgst5\"" May 21 15:13:07.583219 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.582932 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 15:13:07.583219 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.583112 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 15:13:07.583219 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.583193 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 15:13:07.584173 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.584150 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.586351 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.586113 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 15:13:07.586351 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.586123 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b7wjb\"" May 21 15:13:07.586626 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.586607 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 15:13:07.587226 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.587207 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bd4zt" May 21 15:13:07.588690 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.588533 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qk6gn" May 21 15:13:07.588941 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.588887 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qh82g\"" May 21 15:13:07.589005 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.588963 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 15:13:07.589969 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.589949 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fdx2f" May 21 15:13:07.590328 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.590238 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8fwtv\"" May 21 15:13:07.590498 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.590480 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 15:13:07.590603 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.590571 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 15:13:07.591545 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.591511 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 15:13:07.591636 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.591574 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 15:13:07.591743 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.591726 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 15:13:07.591946 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.591920 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2j948\"" May 21 15:13:07.592617 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.592599 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-75xw9" May 21 15:13:07.592822 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.592776 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:13:07.592912 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:07.592844 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6d2bf" podUID="6d7e4b15-f2f5-422c-b325-52c38980aa18" May 21 15:13:07.594354 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.594311 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6gd4d\"" May 21 15:13:07.594462 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.594370 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 15:13:07.594972 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.594623 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 15:13:07.594972 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.594697 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.596462 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.596445 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 15:13:07.596658 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.596639 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 15:13:07.596893 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.596859 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-k6l28\"" May 21 15:13:07.596893 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.596888 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 15:13:07.597177 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.597159 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 15:13:07.597265 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.597227 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 15:13:07.597323 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.597227 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 15:13:07.599653 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.599632 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-lib-modules\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.599747 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.599666 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npnpl\" (UniqueName: \"kubernetes.io/projected/fee7957c-3284-486f-ab40-ba1ce992878a-kube-api-access-npnpl\") pod \"node-resolver-qk6gn\" (UID: \"fee7957c-3284-486f-ab40-ba1ce992878a\") " pod="openshift-dns/node-resolver-qk6gn" May 21 15:13:07.599747 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.599706 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/33521081-e967-4d23-8420-512dc3b0ca01-multus-daemon-config\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.599747 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.599729 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-etc-kubernetes\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.599923 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.599755 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fee7957c-3284-486f-ab40-ba1ce992878a-tmp-dir\") pod \"node-resolver-qk6gn\" (UID: \"fee7957c-3284-486f-ab40-ba1ce992878a\") " pod="openshift-dns/node-resolver-qk6gn" May 21 15:13:07.599923 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.599770 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtdln\" (UniqueName: \"kubernetes.io/projected/33521081-e967-4d23-8420-512dc3b0ca01-kube-api-access-wtdln\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.599923 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.599809 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwls8\" (UniqueName: \"kubernetes.io/projected/4647300a-6e2b-470b-a126-6040a4f6a213-kube-api-access-bwls8\") pod \"iptables-alerter-fdx2f\" (UID: \"4647300a-6e2b-470b-a126-6040a4f6a213\") " pod="openshift-network-operator/iptables-alerter-fdx2f" May 21 15:13:07.599923 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.599876 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3f19b43-b2b6-47dc-a66e-e447f95fa680-metrics-certs\") pod \"network-metrics-daemon-rm6dz\" (UID: \"a3f19b43-b2b6-47dc-a66e-e447f95fa680\") " pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:13:07.599923 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.599912 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-hostroot\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.600166 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.599935 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/80471774-c0c2-400d-8594-af1c6f66c55c-socket-dir\") pod \"aws-ebs-csi-driver-node-wbhjj\" (UID: \"80471774-c0c2-400d-8594-af1c6f66c55c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbhjj" May 21 15:13:07.600166 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.599962 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f245a8f-9cf0-4b38-a9cf-73bd4cb432da-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-57tbw\" (UID: \"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da\") " pod="openshift-multus/multus-additional-cni-plugins-57tbw" May 21 15:13:07.600166 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.599991 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-var-lib-kubelet\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.600166 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600016 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-host-var-lib-cni-multus\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.600166 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600046 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-multus-conf-dir\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.600166 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600077 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4647300a-6e2b-470b-a126-6040a4f6a213-iptables-alerter-script\") pod \"iptables-alerter-fdx2f\" (UID: \"4647300a-6e2b-470b-a126-6040a4f6a213\") " pod="openshift-network-operator/iptables-alerter-fdx2f" May 21 15:13:07.600166 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600108 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f245a8f-9cf0-4b38-a9cf-73bd4cb432da-cni-binary-copy\") pod \"multus-additional-cni-plugins-57tbw\" (UID: \"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da\") " pod="openshift-multus/multus-additional-cni-plugins-57tbw" May 21 15:13:07.600166 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600135 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gmbq\" (UniqueName: \"kubernetes.io/projected/1f245a8f-9cf0-4b38-a9cf-73bd4cb432da-kube-api-access-8gmbq\") pod \"multus-additional-cni-plugins-57tbw\" (UID: \"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da\") " pod="openshift-multus/multus-additional-cni-plugins-57tbw" May 21 15:13:07.600166 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600153 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/80471774-c0c2-400d-8594-af1c6f66c55c-sys-fs\") pod \"aws-ebs-csi-driver-node-wbhjj\" (UID: \"80471774-c0c2-400d-8594-af1c6f66c55c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbhjj" May 21 15:13:07.600602 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600184 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-host-run-k8s-cni-cncf-io\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.600602 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600214 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/80471774-c0c2-400d-8594-af1c6f66c55c-etc-selinux\") pod \"aws-ebs-csi-driver-node-wbhjj\" (UID: \"80471774-c0c2-400d-8594-af1c6f66c55c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbhjj" May 21 15:13:07.600602 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600232 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-host-var-lib-cni-bin\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.600602 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600254 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjj8s\" (UniqueName: \"kubernetes.io/projected/80471774-c0c2-400d-8594-af1c6f66c55c-kube-api-access-rjj8s\") pod \"aws-ebs-csi-driver-node-wbhjj\" (UID: \"80471774-c0c2-400d-8594-af1c6f66c55c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbhjj" May 21 15:13:07.600602 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600276 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-etc-modprobe-d\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.600602 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600297 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-etc-kubernetes\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.600602 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600313 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-host\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.600602 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600349 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-multus-cni-dir\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.600602 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600373 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f245a8f-9cf0-4b38-a9cf-73bd4cb432da-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-57tbw\" (UID: \"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da\") " pod="openshift-multus/multus-additional-cni-plugins-57tbw" May 21 15:13:07.600602 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600392 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dgrh\" (UniqueName: \"kubernetes.io/projected/4a37171f-d7b3-4c9b-98a1-5d74d829217d-kube-api-access-2dgrh\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.600602 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600417 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-cnibin\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.600602 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600439 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-host-run-netns\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.600602 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600483 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffnmm\" (UniqueName: \"kubernetes.io/projected/867c5016-c412-463c-b76f-abddcdbfae50-kube-api-access-ffnmm\") pod \"node-ca-kvk52\" (UID: \"867c5016-c412-463c-b76f-abddcdbfae50\") " pod="openshift-image-registry/node-ca-kvk52" May 21 15:13:07.600602 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600515 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4647300a-6e2b-470b-a126-6040a4f6a213-host-slash\") pod \"iptables-alerter-fdx2f\" (UID: \"4647300a-6e2b-470b-a126-6040a4f6a213\") " pod="openshift-network-operator/iptables-alerter-fdx2f" May 21 15:13:07.600602 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600534 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-etc-sysctl-d\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.600602 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600568 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-system-cni-dir\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.601316 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600589 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-os-release\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.601316 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600611 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/33521081-e967-4d23-8420-512dc3b0ca01-cni-binary-copy\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.601316 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600633 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/867c5016-c412-463c-b76f-abddcdbfae50-host\") pod \"node-ca-kvk52\" (UID: \"867c5016-c412-463c-b76f-abddcdbfae50\") " pod="openshift-image-registry/node-ca-kvk52" May 21 15:13:07.601316 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600666 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/80471774-c0c2-400d-8594-af1c6f66c55c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wbhjj\" (UID: \"80471774-c0c2-400d-8594-af1c6f66c55c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbhjj" May 21 15:13:07.601316 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600689 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/80471774-c0c2-400d-8594-af1c6f66c55c-device-dir\") pod \"aws-ebs-csi-driver-node-wbhjj\" (UID: \"80471774-c0c2-400d-8594-af1c6f66c55c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbhjj" May 21 15:13:07.601316 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600711 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f245a8f-9cf0-4b38-a9cf-73bd4cb432da-system-cni-dir\") pod \"multus-additional-cni-plugins-57tbw\" (UID: \"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da\") " pod="openshift-multus/multus-additional-cni-plugins-57tbw" May 21 15:13:07.601316 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600736 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fee7957c-3284-486f-ab40-ba1ce992878a-hosts-file\") pod \"node-resolver-qk6gn\" (UID: \"fee7957c-3284-486f-ab40-ba1ce992878a\") " pod="openshift-dns/node-resolver-qk6gn" May 21 15:13:07.601316 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600755 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fbb8ef5a-6ec7-4038-9753-819b2a74b5d2-konnectivity-ca\") pod \"konnectivity-agent-75xw9\" (UID: \"fbb8ef5a-6ec7-4038-9753-819b2a74b5d2\") " pod="kube-system/konnectivity-agent-75xw9" May 21 15:13:07.601316 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600776 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-host-run-multus-certs\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.601316 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600818 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/867c5016-c412-463c-b76f-abddcdbfae50-serviceca\") pod \"node-ca-kvk52\" (UID: \"867c5016-c412-463c-b76f-abddcdbfae50\") " pod="openshift-image-registry/node-ca-kvk52" May 21 15:13:07.601316 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600840 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/80471774-c0c2-400d-8594-af1c6f66c55c-registration-dir\") pod \"aws-ebs-csi-driver-node-wbhjj\" (UID: \"80471774-c0c2-400d-8594-af1c6f66c55c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbhjj" May 21 15:13:07.601316 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600864 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-etc-sysctl-conf\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.601316 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600889 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-multus-socket-dir-parent\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.601316 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600915 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f245a8f-9cf0-4b38-a9cf-73bd4cb432da-cnibin\") pod \"multus-additional-cni-plugins-57tbw\" (UID: \"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da\") " pod="openshift-multus/multus-additional-cni-plugins-57tbw" May 21 15:13:07.601316 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600929 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f245a8f-9cf0-4b38-a9cf-73bd4cb432da-os-release\") pod \"multus-additional-cni-plugins-57tbw\" (UID: \"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da\") " pod="openshift-multus/multus-additional-cni-plugins-57tbw" May 21 15:13:07.601316 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600949 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svc9r\" (UniqueName: \"kubernetes.io/projected/a3f19b43-b2b6-47dc-a66e-e447f95fa680-kube-api-access-svc9r\") pod \"network-metrics-daemon-rm6dz\" (UID: \"a3f19b43-b2b6-47dc-a66e-e447f95fa680\") " pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:13:07.602116 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600971 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-run\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.602116 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.600994 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fbb8ef5a-6ec7-4038-9753-819b2a74b5d2-agent-certs\") pod \"konnectivity-agent-75xw9\" (UID: \"fbb8ef5a-6ec7-4038-9753-819b2a74b5d2\") " pod="kube-system/konnectivity-agent-75xw9" May 21 15:13:07.602116 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.601013 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-host-var-lib-kubelet\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.602116 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.601041 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f245a8f-9cf0-4b38-a9cf-73bd4cb432da-tuning-conf-dir\") pod \"multus-additional-cni-plugins-57tbw\" (UID: \"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da\") " pod="openshift-multus/multus-additional-cni-plugins-57tbw" May 21 15:13:07.602116 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.601076 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-etc-sysconfig\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.602116 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.601106 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-etc-systemd\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.602116 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.601133 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-sys\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.602116 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.601156 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4a37171f-d7b3-4c9b-98a1-5d74d829217d-etc-tuned\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.602116 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.601177 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a37171f-d7b3-4c9b-98a1-5d74d829217d-tmp\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.641283 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.641250 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 15:08:06 +0000 UTC" deadline="2027-11-03 12:31:34.392157914 +0000 UTC" May 21 15:13:07.641283 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.641284 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12741h18m26.750877913s" May 21 15:13:07.691129 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.691104 2563 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 15:13:07.701886 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.701857 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txxgt\" (UniqueName: \"kubernetes.io/projected/6d7e4b15-f2f5-422c-b325-52c38980aa18-kube-api-access-txxgt\") pod \"network-check-target-6d2bf\" (UID: \"6d7e4b15-f2f5-422c-b325-52c38980aa18\") " pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:13:07.702006 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.701892 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-host-slash\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.702006 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.701924 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fee7957c-3284-486f-ab40-ba1ce992878a-tmp-dir\") pod \"node-resolver-qk6gn\" (UID: \"fee7957c-3284-486f-ab40-ba1ce992878a\") " pod="openshift-dns/node-resolver-qk6gn" May 21 15:13:07.702006 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.701978 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wtdln\" (UniqueName: \"kubernetes.io/projected/33521081-e967-4d23-8420-512dc3b0ca01-kube-api-access-wtdln\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.702172 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702019 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bwls8\" (UniqueName: \"kubernetes.io/projected/4647300a-6e2b-470b-a126-6040a4f6a213-kube-api-access-bwls8\") pod \"iptables-alerter-fdx2f\" (UID: \"4647300a-6e2b-470b-a126-6040a4f6a213\") " pod="openshift-network-operator/iptables-alerter-fdx2f" May 21 15:13:07.702172 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702053 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-host-kubelet\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.702172 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702080 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3f19b43-b2b6-47dc-a66e-e447f95fa680-metrics-certs\") pod \"network-metrics-daemon-rm6dz\" (UID: \"a3f19b43-b2b6-47dc-a66e-e447f95fa680\") " pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:13:07.702172 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702107 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-hostroot\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.702172 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702132 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-systemd-units\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.702172 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702158 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-host-run-netns\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.702475 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702186 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/80471774-c0c2-400d-8594-af1c6f66c55c-socket-dir\") pod \"aws-ebs-csi-driver-node-wbhjj\" (UID: \"80471774-c0c2-400d-8594-af1c6f66c55c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbhjj" May 21 15:13:07.702475 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702214 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f245a8f-9cf0-4b38-a9cf-73bd4cb432da-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-57tbw\" (UID: \"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da\") " pod="openshift-multus/multus-additional-cni-plugins-57tbw" May 21 15:13:07.702475 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702237 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fee7957c-3284-486f-ab40-ba1ce992878a-tmp-dir\") pod \"node-resolver-qk6gn\" (UID: \"fee7957c-3284-486f-ab40-ba1ce992878a\") " pod="openshift-dns/node-resolver-qk6gn" May 21 15:13:07.702475 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702249 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-hostroot\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.702475 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702239 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-var-lib-kubelet\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.702475 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702298 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-var-lib-kubelet\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.702475 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702302 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-host-var-lib-cni-multus\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.702475 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702328 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-multus-conf-dir\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.702475 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702369 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-host-var-lib-cni-multus\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.702475 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:07.702376 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 15:13:07.702475 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702411 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-multus-conf-dir\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.702475 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702377 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4647300a-6e2b-470b-a126-6040a4f6a213-iptables-alerter-script\") pod \"iptables-alerter-fdx2f\" (UID: \"4647300a-6e2b-470b-a126-6040a4f6a213\") " pod="openshift-network-operator/iptables-alerter-fdx2f" May 21 15:13:07.702475 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702430 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/80471774-c0c2-400d-8594-af1c6f66c55c-socket-dir\") pod \"aws-ebs-csi-driver-node-wbhjj\" (UID: \"80471774-c0c2-400d-8594-af1c6f66c55c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbhjj" May 21 15:13:07.702475 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:07.702450 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3f19b43-b2b6-47dc-a66e-e447f95fa680-metrics-certs podName:a3f19b43-b2b6-47dc-a66e-e447f95fa680 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:08.202429888 +0000 UTC m=+3.053872150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3f19b43-b2b6-47dc-a66e-e447f95fa680-metrics-certs") pod "network-metrics-daemon-rm6dz" (UID: "a3f19b43-b2b6-47dc-a66e-e447f95fa680") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 15:13:07.703061 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702484 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-host-run-ovn-kubernetes\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.703061 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702512 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-host-cni-netd\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.703061 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702539 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f245a8f-9cf0-4b38-a9cf-73bd4cb432da-cni-binary-copy\") pod \"multus-additional-cni-plugins-57tbw\" (UID: \"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da\") " pod="openshift-multus/multus-additional-cni-plugins-57tbw" May 21 15:13:07.703061 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702572 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8gmbq\" (UniqueName: \"kubernetes.io/projected/1f245a8f-9cf0-4b38-a9cf-73bd4cb432da-kube-api-access-8gmbq\") pod \"multus-additional-cni-plugins-57tbw\" (UID: \"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da\") " pod="openshift-multus/multus-additional-cni-plugins-57tbw" May 21 15:13:07.703061 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702608 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-etc-openvswitch\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.703061 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702687 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.703061 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702744 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/80471774-c0c2-400d-8594-af1c6f66c55c-sys-fs\") pod \"aws-ebs-csi-driver-node-wbhjj\" (UID: \"80471774-c0c2-400d-8594-af1c6f66c55c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbhjj" May 21 15:13:07.703061 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702770 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-host-run-k8s-cni-cncf-io\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.703061 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702812 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/80471774-c0c2-400d-8594-af1c6f66c55c-sys-fs\") pod \"aws-ebs-csi-driver-node-wbhjj\" (UID: \"80471774-c0c2-400d-8594-af1c6f66c55c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbhjj" May 21 15:13:07.703061 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702818 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/80471774-c0c2-400d-8594-af1c6f66c55c-etc-selinux\") pod \"aws-ebs-csi-driver-node-wbhjj\" (UID: \"80471774-c0c2-400d-8594-af1c6f66c55c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbhjj" May 21 15:13:07.703061 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702841 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f245a8f-9cf0-4b38-a9cf-73bd4cb432da-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-57tbw\" (UID: \"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da\") " pod="openshift-multus/multus-additional-cni-plugins-57tbw" May 21 15:13:07.703061 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702857 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-host-var-lib-cni-bin\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.703061 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702825 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-host-run-k8s-cni-cncf-io\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.703061 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702885 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-var-lib-openvswitch\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.703061 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702882 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4647300a-6e2b-470b-a126-6040a4f6a213-iptables-alerter-script\") pod \"iptables-alerter-fdx2f\" (UID: \"4647300a-6e2b-470b-a126-6040a4f6a213\") " pod="openshift-network-operator/iptables-alerter-fdx2f" May 21 15:13:07.703061 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702913 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-run-openvswitch\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.703783 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702921 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-host-var-lib-cni-bin\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.703783 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702942 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/80471774-c0c2-400d-8594-af1c6f66c55c-etc-selinux\") pod \"aws-ebs-csi-driver-node-wbhjj\" (UID: \"80471774-c0c2-400d-8594-af1c6f66c55c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbhjj" May 21 15:13:07.703783 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702941 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-run-ovn\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.703783 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.702986 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-log-socket\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.703783 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703011 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rjj8s\" (UniqueName: \"kubernetes.io/projected/80471774-c0c2-400d-8594-af1c6f66c55c-kube-api-access-rjj8s\") pod \"aws-ebs-csi-driver-node-wbhjj\" (UID: \"80471774-c0c2-400d-8594-af1c6f66c55c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbhjj" May 21 15:13:07.703783 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703043 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-etc-modprobe-d\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.703783 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703058 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f245a8f-9cf0-4b38-a9cf-73bd4cb432da-cni-binary-copy\") pod \"multus-additional-cni-plugins-57tbw\" (UID: \"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da\") " pod="openshift-multus/multus-additional-cni-plugins-57tbw" May 21 15:13:07.703783 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703074 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-etc-kubernetes\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.703783 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703103 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-host\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.703783 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703173 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-host\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.703783 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703175 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-etc-modprobe-d\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.703783 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703189 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-etc-kubernetes\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.703783 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703204 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-multus-cni-dir\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.703783 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703262 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-ovn-node-metrics-cert\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.703783 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703288 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-ovnkube-script-lib\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.703783 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703306 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-multus-cni-dir\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.703783 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703317 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f245a8f-9cf0-4b38-a9cf-73bd4cb432da-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-57tbw\" (UID: \"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da\") " pod="openshift-multus/multus-additional-cni-plugins-57tbw" May 21 15:13:07.704579 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703375 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2dgrh\" (UniqueName: \"kubernetes.io/projected/4a37171f-d7b3-4c9b-98a1-5d74d829217d-kube-api-access-2dgrh\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.704579 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703403 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-cnibin\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.704579 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703427 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-host-run-netns\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.704579 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703452 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ffnmm\" (UniqueName: \"kubernetes.io/projected/867c5016-c412-463c-b76f-abddcdbfae50-kube-api-access-ffnmm\") pod \"node-ca-kvk52\" (UID: \"867c5016-c412-463c-b76f-abddcdbfae50\") " pod="openshift-image-registry/node-ca-kvk52" May 21 15:13:07.704579 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703479 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-node-log\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.704579 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703489 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-cnibin\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.704579 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703505 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4647300a-6e2b-470b-a126-6040a4f6a213-host-slash\") pod \"iptables-alerter-fdx2f\" (UID: \"4647300a-6e2b-470b-a126-6040a4f6a213\") " pod="openshift-network-operator/iptables-alerter-fdx2f" May 21 15:13:07.704579 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703531 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-etc-sysctl-d\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.704579 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703548 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-host-run-netns\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.704579 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703556 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-system-cni-dir\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.704579 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703585 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-os-release\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.704579 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703616 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/33521081-e967-4d23-8420-512dc3b0ca01-cni-binary-copy\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.704579 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703629 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-system-cni-dir\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.704579 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703638 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/867c5016-c412-463c-b76f-abddcdbfae50-host\") pod \"node-ca-kvk52\" (UID: \"867c5016-c412-463c-b76f-abddcdbfae50\") " pod="openshift-image-registry/node-ca-kvk52" May 21 15:13:07.704579 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703672 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7w75\" (UniqueName: \"kubernetes.io/projected/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-kube-api-access-f7w75\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.704579 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703692 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-os-release\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.704579 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703705 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-etc-sysctl-d\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.704579 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703702 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/80471774-c0c2-400d-8594-af1c6f66c55c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wbhjj\" (UID: \"80471774-c0c2-400d-8594-af1c6f66c55c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbhjj" May 21 15:13:07.705356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703586 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4647300a-6e2b-470b-a126-6040a4f6a213-host-slash\") pod \"iptables-alerter-fdx2f\" (UID: \"4647300a-6e2b-470b-a126-6040a4f6a213\") " pod="openshift-network-operator/iptables-alerter-fdx2f" May 21 15:13:07.705356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703748 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/80471774-c0c2-400d-8594-af1c6f66c55c-device-dir\") pod \"aws-ebs-csi-driver-node-wbhjj\" (UID: \"80471774-c0c2-400d-8594-af1c6f66c55c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbhjj" May 21 15:13:07.705356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703773 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f245a8f-9cf0-4b38-a9cf-73bd4cb432da-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-57tbw\" (UID: \"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da\") " pod="openshift-multus/multus-additional-cni-plugins-57tbw" May 21 15:13:07.705356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703782 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/867c5016-c412-463c-b76f-abddcdbfae50-host\") pod \"node-ca-kvk52\" (UID: \"867c5016-c412-463c-b76f-abddcdbfae50\") " pod="openshift-image-registry/node-ca-kvk52" May 21 15:13:07.705356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703815 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f245a8f-9cf0-4b38-a9cf-73bd4cb432da-system-cni-dir\") pod \"multus-additional-cni-plugins-57tbw\" (UID: \"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da\") " pod="openshift-multus/multus-additional-cni-plugins-57tbw" May 21 15:13:07.705356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703820 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/80471774-c0c2-400d-8594-af1c6f66c55c-device-dir\") pod \"aws-ebs-csi-driver-node-wbhjj\" (UID: \"80471774-c0c2-400d-8594-af1c6f66c55c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbhjj" May 21 15:13:07.705356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703861 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fee7957c-3284-486f-ab40-ba1ce992878a-hosts-file\") pod \"node-resolver-qk6gn\" (UID: \"fee7957c-3284-486f-ab40-ba1ce992878a\") " pod="openshift-dns/node-resolver-qk6gn" May 21 15:13:07.705356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703889 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/80471774-c0c2-400d-8594-af1c6f66c55c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wbhjj\" (UID: \"80471774-c0c2-400d-8594-af1c6f66c55c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbhjj" May 21 15:13:07.705356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703892 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fbb8ef5a-6ec7-4038-9753-819b2a74b5d2-konnectivity-ca\") pod \"konnectivity-agent-75xw9\" (UID: \"fbb8ef5a-6ec7-4038-9753-819b2a74b5d2\") " pod="kube-system/konnectivity-agent-75xw9" May 21 15:13:07.705356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703889 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f245a8f-9cf0-4b38-a9cf-73bd4cb432da-system-cni-dir\") pod \"multus-additional-cni-plugins-57tbw\" (UID: \"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da\") " pod="openshift-multus/multus-additional-cni-plugins-57tbw" May 21 15:13:07.705356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703958 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-host-run-multus-certs\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.705356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703985 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-host-run-multus-certs\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.705356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703987 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/867c5016-c412-463c-b76f-abddcdbfae50-serviceca\") pod \"node-ca-kvk52\" (UID: \"867c5016-c412-463c-b76f-abddcdbfae50\") " pod="openshift-image-registry/node-ca-kvk52" May 21 15:13:07.705356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.703994 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fee7957c-3284-486f-ab40-ba1ce992878a-hosts-file\") pod \"node-resolver-qk6gn\" (UID: \"fee7957c-3284-486f-ab40-ba1ce992878a\") " pod="openshift-dns/node-resolver-qk6gn" May 21 15:13:07.705356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704018 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-host-cni-bin\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.705356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704044 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/80471774-c0c2-400d-8594-af1c6f66c55c-registration-dir\") pod \"aws-ebs-csi-driver-node-wbhjj\" (UID: \"80471774-c0c2-400d-8594-af1c6f66c55c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbhjj" May 21 15:13:07.705356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704058 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-etc-sysctl-conf\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.706034 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704105 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/80471774-c0c2-400d-8594-af1c6f66c55c-registration-dir\") pod \"aws-ebs-csi-driver-node-wbhjj\" (UID: \"80471774-c0c2-400d-8594-af1c6f66c55c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbhjj" May 21 15:13:07.706034 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704145 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-multus-socket-dir-parent\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.706034 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704172 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/33521081-e967-4d23-8420-512dc3b0ca01-cni-binary-copy\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.706034 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704186 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-run-systemd\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.706034 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704187 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-etc-sysctl-conf\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.706034 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704224 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-multus-socket-dir-parent\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.706034 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704228 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-ovnkube-config\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.706034 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704258 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-env-overrides\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.706034 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704285 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f245a8f-9cf0-4b38-a9cf-73bd4cb432da-cnibin\") pod \"multus-additional-cni-plugins-57tbw\" (UID: \"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da\") " pod="openshift-multus/multus-additional-cni-plugins-57tbw" May 21 15:13:07.706034 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704310 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f245a8f-9cf0-4b38-a9cf-73bd4cb432da-os-release\") pod \"multus-additional-cni-plugins-57tbw\" (UID: \"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da\") " pod="openshift-multus/multus-additional-cni-plugins-57tbw" May 21 15:13:07.706034 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704348 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-svc9r\" (UniqueName: \"kubernetes.io/projected/a3f19b43-b2b6-47dc-a66e-e447f95fa680-kube-api-access-svc9r\") pod \"network-metrics-daemon-rm6dz\" (UID: \"a3f19b43-b2b6-47dc-a66e-e447f95fa680\") " pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:13:07.706034 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704368 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/867c5016-c412-463c-b76f-abddcdbfae50-serviceca\") pod \"node-ca-kvk52\" (UID: \"867c5016-c412-463c-b76f-abddcdbfae50\") " pod="openshift-image-registry/node-ca-kvk52" May 21 15:13:07.706034 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704378 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f245a8f-9cf0-4b38-a9cf-73bd4cb432da-cnibin\") pod \"multus-additional-cni-plugins-57tbw\" (UID: \"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da\") " pod="openshift-multus/multus-additional-cni-plugins-57tbw" May 21 15:13:07.706034 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704388 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f245a8f-9cf0-4b38-a9cf-73bd4cb432da-os-release\") pod \"multus-additional-cni-plugins-57tbw\" (UID: \"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da\") " pod="openshift-multus/multus-additional-cni-plugins-57tbw" May 21 15:13:07.706034 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704413 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-run\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.706034 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704419 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fbb8ef5a-6ec7-4038-9753-819b2a74b5d2-konnectivity-ca\") pod \"konnectivity-agent-75xw9\" (UID: \"fbb8ef5a-6ec7-4038-9753-819b2a74b5d2\") " pod="kube-system/konnectivity-agent-75xw9" May 21 15:13:07.706034 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704441 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fbb8ef5a-6ec7-4038-9753-819b2a74b5d2-agent-certs\") pod \"konnectivity-agent-75xw9\" (UID: \"fbb8ef5a-6ec7-4038-9753-819b2a74b5d2\") " pod="kube-system/konnectivity-agent-75xw9" May 21 15:13:07.706845 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704462 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-run\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.706845 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704548 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-host-var-lib-kubelet\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.706845 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704629 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f245a8f-9cf0-4b38-a9cf-73bd4cb432da-tuning-conf-dir\") pod \"multus-additional-cni-plugins-57tbw\" (UID: \"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da\") " pod="openshift-multus/multus-additional-cni-plugins-57tbw" May 21 15:13:07.706845 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704649 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-host-var-lib-kubelet\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.706845 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704691 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-etc-sysconfig\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.706845 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704722 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-etc-sysconfig\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.706845 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704751 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-etc-systemd\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.706845 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704776 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-sys\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.706845 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704813 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4a37171f-d7b3-4c9b-98a1-5d74d829217d-etc-tuned\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.706845 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704818 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 15:13:07.706845 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704867 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a37171f-d7b3-4c9b-98a1-5d74d829217d-tmp\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.706845 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704885 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f245a8f-9cf0-4b38-a9cf-73bd4cb432da-tuning-conf-dir\") pod \"multus-additional-cni-plugins-57tbw\" (UID: \"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da\") " pod="openshift-multus/multus-additional-cni-plugins-57tbw" May 21 15:13:07.706845 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704837 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-etc-systemd\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.706845 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704903 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-sys\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.706845 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704940 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-lib-modules\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.706845 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704969 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-npnpl\" (UniqueName: \"kubernetes.io/projected/fee7957c-3284-486f-ab40-ba1ce992878a-kube-api-access-npnpl\") pod \"node-resolver-qk6gn\" (UID: \"fee7957c-3284-486f-ab40-ba1ce992878a\") " pod="openshift-dns/node-resolver-qk6gn" May 21 15:13:07.706845 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.704994 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/33521081-e967-4d23-8420-512dc3b0ca01-multus-daemon-config\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.706845 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.705020 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-etc-kubernetes\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.707653 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.705059 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4a37171f-d7b3-4c9b-98a1-5d74d829217d-lib-modules\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.707653 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.705087 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33521081-e967-4d23-8420-512dc3b0ca01-etc-kubernetes\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.707653 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.705499 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/33521081-e967-4d23-8420-512dc3b0ca01-multus-daemon-config\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.708315 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.708276 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a37171f-d7b3-4c9b-98a1-5d74d829217d-tmp\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.708475 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.708355 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4a37171f-d7b3-4c9b-98a1-5d74d829217d-etc-tuned\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.708674 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.708649 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fbb8ef5a-6ec7-4038-9753-819b2a74b5d2-agent-certs\") pod \"konnectivity-agent-75xw9\" (UID: \"fbb8ef5a-6ec7-4038-9753-819b2a74b5d2\") " pod="kube-system/konnectivity-agent-75xw9" May 21 15:13:07.714018 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.713866 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gmbq\" (UniqueName: \"kubernetes.io/projected/1f245a8f-9cf0-4b38-a9cf-73bd4cb432da-kube-api-access-8gmbq\") pod \"multus-additional-cni-plugins-57tbw\" (UID: \"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da\") " pod="openshift-multus/multus-additional-cni-plugins-57tbw" May 21 15:13:07.714018 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.713951 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtdln\" (UniqueName: \"kubernetes.io/projected/33521081-e967-4d23-8420-512dc3b0ca01-kube-api-access-wtdln\") pod \"multus-bd4zt\" (UID: \"33521081-e967-4d23-8420-512dc3b0ca01\") " pod="openshift-multus/multus-bd4zt" May 21 15:13:07.714708 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.714648 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwls8\" (UniqueName: \"kubernetes.io/projected/4647300a-6e2b-470b-a126-6040a4f6a213-kube-api-access-bwls8\") pod \"iptables-alerter-fdx2f\" (UID: \"4647300a-6e2b-470b-a126-6040a4f6a213\") " pod="openshift-network-operator/iptables-alerter-fdx2f" May 21 15:13:07.716358 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.716319 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffnmm\" (UniqueName: \"kubernetes.io/projected/867c5016-c412-463c-b76f-abddcdbfae50-kube-api-access-ffnmm\") pod \"node-ca-kvk52\" (UID: \"867c5016-c412-463c-b76f-abddcdbfae50\") " pod="openshift-image-registry/node-ca-kvk52" May 21 15:13:07.716516 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.716490 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dgrh\" (UniqueName: \"kubernetes.io/projected/4a37171f-d7b3-4c9b-98a1-5d74d829217d-kube-api-access-2dgrh\") pod \"tuned-55t5c\" (UID: \"4a37171f-d7b3-4c9b-98a1-5d74d829217d\") " pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.716722 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.716703 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svc9r\" (UniqueName: \"kubernetes.io/projected/a3f19b43-b2b6-47dc-a66e-e447f95fa680-kube-api-access-svc9r\") pod \"network-metrics-daemon-rm6dz\" (UID: \"a3f19b43-b2b6-47dc-a66e-e447f95fa680\") " pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:13:07.716898 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.716878 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjj8s\" (UniqueName: \"kubernetes.io/projected/80471774-c0c2-400d-8594-af1c6f66c55c-kube-api-access-rjj8s\") pod \"aws-ebs-csi-driver-node-wbhjj\" (UID: \"80471774-c0c2-400d-8594-af1c6f66c55c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbhjj" May 21 15:13:07.717327 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.717307 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npnpl\" (UniqueName: \"kubernetes.io/projected/fee7957c-3284-486f-ab40-ba1ce992878a-kube-api-access-npnpl\") pod \"node-resolver-qk6gn\" (UID: \"fee7957c-3284-486f-ab40-ba1ce992878a\") " pod="openshift-dns/node-resolver-qk6gn" May 21 15:13:07.805332 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.805301 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-ovn-node-metrics-cert\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.805523 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.805358 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-ovnkube-script-lib\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.805523 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.805381 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-node-log\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.805523 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.805401 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f7w75\" (UniqueName: \"kubernetes.io/projected/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-kube-api-access-f7w75\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.805523 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.805419 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-host-cni-bin\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.805523 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.805439 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-run-systemd\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.805523 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.805456 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-ovnkube-config\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.805523 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.805471 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-env-overrides\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.805523 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.805497 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-txxgt\" (UniqueName: \"kubernetes.io/projected/6d7e4b15-f2f5-422c-b325-52c38980aa18-kube-api-access-txxgt\") pod \"network-check-target-6d2bf\" (UID: \"6d7e4b15-f2f5-422c-b325-52c38980aa18\") " pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:13:07.805523 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.805518 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-host-slash\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.805924 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.805537 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-host-kubelet\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.805924 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.805584 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-run-systemd\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.805924 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.805591 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-systemd-units\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.805924 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.805630 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-systemd-units\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.805924 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.805647 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-host-run-netns\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.805924 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.805680 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-host-run-ovn-kubernetes\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.805924 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.805707 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-host-cni-netd\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.805924 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.805728 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-etc-openvswitch\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.805924 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.805748 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.805924 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.805771 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-var-lib-openvswitch\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.805924 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.805833 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-run-openvswitch\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.805924 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.805840 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-host-slash\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.805924 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.805858 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-run-ovn\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.805924 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.805885 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-log-socket\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.805924 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.805890 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-host-run-ovn-kubernetes\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.806558 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.805954 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-host-cni-netd\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.806558 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.805987 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-etc-openvswitch\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.806558 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.805978 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-node-log\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.806558 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.806025 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.806558 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.806053 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-run-openvswitch\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.806558 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.806175 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-host-kubelet\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.806558 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.806181 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-ovnkube-config\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.806558 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.806187 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-host-cni-bin\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.806558 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.806222 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-var-lib-openvswitch\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.806558 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.806228 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-log-socket\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.806558 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.806229 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-host-run-netns\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.806558 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.806242 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-run-ovn\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.806558 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.806435 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-env-overrides\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.806978 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.806647 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-ovnkube-script-lib\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.808217 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.808195 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-ovn-node-metrics-cert\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.811001 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:07.810983 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 15:13:07.811073 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:07.811005 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 15:13:07.811073 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:07.811015 2563 projected.go:194] Error preparing data for projected volume kube-api-access-txxgt for pod openshift-network-diagnostics/network-check-target-6d2bf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 15:13:07.811073 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:07.811066 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d7e4b15-f2f5-422c-b325-52c38980aa18-kube-api-access-txxgt podName:6d7e4b15-f2f5-422c-b325-52c38980aa18 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:08.311050582 +0000 UTC m=+3.162492828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-txxgt" (UniqueName: "kubernetes.io/projected/6d7e4b15-f2f5-422c-b325-52c38980aa18-kube-api-access-txxgt") pod "network-check-target-6d2bf" (UID: "6d7e4b15-f2f5-422c-b325-52c38980aa18") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 15:13:07.812973 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.812955 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7w75\" (UniqueName: \"kubernetes.io/projected/a4c28d96-338d-4eb5-a40d-0febf25e8d7c-kube-api-access-f7w75\") pod \"ovnkube-node-kvwxg\" (UID: \"a4c28d96-338d-4eb5-a40d-0febf25e8d7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:07.892188 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.892116 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kvk52" May 21 15:13:07.893176 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.892750 2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 15:13:07.897360 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.897222 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbhjj" May 21 15:13:07.907021 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.907001 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-57tbw" May 21 15:13:07.910897 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.910872 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-55t5c" May 21 15:13:07.917461 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.917435 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bd4zt" May 21 15:13:07.923985 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.923969 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qk6gn" May 21 15:13:07.930498 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.930480 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fdx2f" May 21 15:13:07.937008 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.936988 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-75xw9" May 21 15:13:07.942553 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:07.942530 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:08.208366 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:08.208265 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3f19b43-b2b6-47dc-a66e-e447f95fa680-metrics-certs\") pod \"network-metrics-daemon-rm6dz\" (UID: \"a3f19b43-b2b6-47dc-a66e-e447f95fa680\") " pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:13:08.208536 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:08.208436 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 15:13:08.208536 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:08.208516 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3f19b43-b2b6-47dc-a66e-e447f95fa680-metrics-certs podName:a3f19b43-b2b6-47dc-a66e-e447f95fa680 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:09.208498211 +0000 UTC m=+4.059940461 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3f19b43-b2b6-47dc-a66e-e447f95fa680-metrics-certs") pod "network-metrics-daemon-rm6dz" (UID: "a3f19b43-b2b6-47dc-a66e-e447f95fa680") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 15:13:08.313258 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:08.313226 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a37171f_d7b3_4c9b_98a1_5d74d829217d.slice/crio-dbb2067e00b086ecc5607025f19378dfc8596076729b7b363c6f41a89e9527d3 WatchSource:0}: Error finding container dbb2067e00b086ecc5607025f19378dfc8596076729b7b363c6f41a89e9527d3: Status 404 returned error can't find the container with id dbb2067e00b086ecc5607025f19378dfc8596076729b7b363c6f41a89e9527d3 May 21 15:13:08.314510 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:08.314490 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4c28d96_338d_4eb5_a40d_0febf25e8d7c.slice/crio-8b397d6a892f59eacabea81708a2e30044d2b13c85a552742aeee9f3068bbdb0 WatchSource:0}: Error finding container 8b397d6a892f59eacabea81708a2e30044d2b13c85a552742aeee9f3068bbdb0: Status 404 returned error can't find the container with id 8b397d6a892f59eacabea81708a2e30044d2b13c85a552742aeee9f3068bbdb0 May 21 15:13:08.318450 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:08.318430 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod867c5016_c412_463c_b76f_abddcdbfae50.slice/crio-08078ebb659448a3921ab76630b7c98e9922ea42e0d3b6ab79ddead7256c4000 WatchSource:0}: Error finding container 08078ebb659448a3921ab76630b7c98e9922ea42e0d3b6ab79ddead7256c4000: Status 404 returned error can't find the container with id 08078ebb659448a3921ab76630b7c98e9922ea42e0d3b6ab79ddead7256c4000 May 21 15:13:08.319207 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:08.319177 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbb8ef5a_6ec7_4038_9753_819b2a74b5d2.slice/crio-5684c23104157584b1d65963bb24118b4ea5d5e32cf4b60672affeabc9be30f5 WatchSource:0}: Error finding container 5684c23104157584b1d65963bb24118b4ea5d5e32cf4b60672affeabc9be30f5: Status 404 returned error can't find the container with id 5684c23104157584b1d65963bb24118b4ea5d5e32cf4b60672affeabc9be30f5 May 21 15:13:08.320041 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:08.320017 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33521081_e967_4d23_8420_512dc3b0ca01.slice/crio-bba8e986e4b1ef57e8dbbfec1b5573f497a76c9eae20f88faa50874214c8929f WatchSource:0}: Error finding container bba8e986e4b1ef57e8dbbfec1b5573f497a76c9eae20f88faa50874214c8929f: Status 404 returned error can't find the container with id bba8e986e4b1ef57e8dbbfec1b5573f497a76c9eae20f88faa50874214c8929f May 21 15:13:08.409546 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:08.409406 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-txxgt\" (UniqueName: \"kubernetes.io/projected/6d7e4b15-f2f5-422c-b325-52c38980aa18-kube-api-access-txxgt\") pod \"network-check-target-6d2bf\" (UID: \"6d7e4b15-f2f5-422c-b325-52c38980aa18\") " pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:13:08.409634 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:08.409569 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 15:13:08.409634 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:08.409587 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 15:13:08.409634 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:08.409598 2563 projected.go:194] Error preparing data for projected volume kube-api-access-txxgt for pod openshift-network-diagnostics/network-check-target-6d2bf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 15:13:08.409728 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:08.409647 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d7e4b15-f2f5-422c-b325-52c38980aa18-kube-api-access-txxgt podName:6d7e4b15-f2f5-422c-b325-52c38980aa18 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:09.409629005 +0000 UTC m=+4.261071242 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-txxgt" (UniqueName: "kubernetes.io/projected/6d7e4b15-f2f5-422c-b325-52c38980aa18-kube-api-access-txxgt") pod "network-check-target-6d2bf" (UID: "6d7e4b15-f2f5-422c-b325-52c38980aa18") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 15:13:08.642186 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:08.642147 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 15:08:06 +0000 UTC" deadline="2027-12-29 20:26:25.761916583 +0000 UTC" May 21 15:13:08.642186 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:08.642174 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14093h13m17.119744923s" May 21 15:13:08.711936 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:08.711905 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:13:08.712062 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:08.712037 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6d2bf" podUID="6d7e4b15-f2f5-422c-b325-52c38980aa18" May 21 15:13:08.721610 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:08.721558 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-57tbw" event={"ID":"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da","Type":"ContainerStarted","Data":"4475fdfbc987d19f5275cd919ef944ecd0657dd59dcf65cbc9f8ca5dd34679db"} May 21 15:13:08.722682 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:08.722658 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fdx2f" event={"ID":"4647300a-6e2b-470b-a126-6040a4f6a213","Type":"ContainerStarted","Data":"aeba51d2d62af9707a7da512b622ccb5efd1dff7821c2a3620e5bdf8c26ad3bb"} May 21 15:13:08.723771 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:08.723733 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-75xw9" event={"ID":"fbb8ef5a-6ec7-4038-9753-819b2a74b5d2","Type":"ContainerStarted","Data":"5684c23104157584b1d65963bb24118b4ea5d5e32cf4b60672affeabc9be30f5"} May 21 15:13:08.725860 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:08.725815 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kvk52" event={"ID":"867c5016-c412-463c-b76f-abddcdbfae50","Type":"ContainerStarted","Data":"08078ebb659448a3921ab76630b7c98e9922ea42e0d3b6ab79ddead7256c4000"} May 21 15:13:08.728964 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:08.728940 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" event={"ID":"a4c28d96-338d-4eb5-a40d-0febf25e8d7c","Type":"ContainerStarted","Data":"8b397d6a892f59eacabea81708a2e30044d2b13c85a552742aeee9f3068bbdb0"} May 21 15:13:08.734080 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:08.734050 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-73.ec2.internal" event={"ID":"8ed101524a28eb48a53f5654af1a1159","Type":"ContainerStarted","Data":"ceedc5aa312db870294b0742cb01fbdf736c6392172980c63fbedd183a82db0f"} May 21 15:13:08.738472 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:08.738450 2563 generic.go:358] "Generic (PLEG): container finished" podID="245c67db9059ef1be566ab2dc7a616d5" containerID="b84d5627f190be4dbeb54c48fc8904e34699241a357b74def2da3229575f0f5a" exitCode=0 May 21 15:13:08.738699 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:08.738674 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-73.ec2.internal" event={"ID":"245c67db9059ef1be566ab2dc7a616d5","Type":"ContainerDied","Data":"b84d5627f190be4dbeb54c48fc8904e34699241a357b74def2da3229575f0f5a"} May 21 15:13:08.745379 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:08.745356 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qk6gn" event={"ID":"fee7957c-3284-486f-ab40-ba1ce992878a","Type":"ContainerStarted","Data":"5d1dc5a46cceced26d7d38422cc2c379b8231f1e22682eef36ffd3d21159e29b"} May 21 15:13:08.750947 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:08.750868 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbhjj" event={"ID":"80471774-c0c2-400d-8594-af1c6f66c55c","Type":"ContainerStarted","Data":"83a25b81b0c2cc998d714b6a2134e2a0aba7300e8b14876579c03ef12ffbab76"} May 21 15:13:08.760305 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:08.760259 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bd4zt" event={"ID":"33521081-e967-4d23-8420-512dc3b0ca01","Type":"ContainerStarted","Data":"bba8e986e4b1ef57e8dbbfec1b5573f497a76c9eae20f88faa50874214c8929f"} May 21 15:13:08.762129 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:08.762089 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-55t5c" event={"ID":"4a37171f-d7b3-4c9b-98a1-5d74d829217d","Type":"ContainerStarted","Data":"dbb2067e00b086ecc5607025f19378dfc8596076729b7b363c6f41a89e9527d3"} May 21 15:13:08.765970 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:08.765848 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-73.ec2.internal" podStartSLOduration=2.765833926 podStartE2EDuration="2.765833926s" podCreationTimestamp="2026-05-21 15:13:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:13:08.749906318 +0000 UTC m=+3.601348575" watchObservedRunningTime="2026-05-21 15:13:08.765833926 +0000 UTC m=+3.617276183" May 21 15:13:09.215095 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:09.215004 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3f19b43-b2b6-47dc-a66e-e447f95fa680-metrics-certs\") pod \"network-metrics-daemon-rm6dz\" (UID: \"a3f19b43-b2b6-47dc-a66e-e447f95fa680\") " pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:13:09.215327 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:09.215187 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 15:13:09.215327 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:09.215252 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3f19b43-b2b6-47dc-a66e-e447f95fa680-metrics-certs podName:a3f19b43-b2b6-47dc-a66e-e447f95fa680 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:11.215233266 +0000 UTC m=+6.066675499 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3f19b43-b2b6-47dc-a66e-e447f95fa680-metrics-certs") pod "network-metrics-daemon-rm6dz" (UID: "a3f19b43-b2b6-47dc-a66e-e447f95fa680") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 15:13:09.416633 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:09.416594 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-txxgt\" (UniqueName: \"kubernetes.io/projected/6d7e4b15-f2f5-422c-b325-52c38980aa18-kube-api-access-txxgt\") pod \"network-check-target-6d2bf\" (UID: \"6d7e4b15-f2f5-422c-b325-52c38980aa18\") " pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:13:09.416796 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:09.416770 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 15:13:09.416796 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:09.416790 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 15:13:09.416929 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:09.416803 2563 projected.go:194] Error preparing data for projected volume kube-api-access-txxgt for pod openshift-network-diagnostics/network-check-target-6d2bf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 15:13:09.416929 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:09.416864 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d7e4b15-f2f5-422c-b325-52c38980aa18-kube-api-access-txxgt podName:6d7e4b15-f2f5-422c-b325-52c38980aa18 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:11.416845006 +0000 UTC m=+6.268287253 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-txxgt" (UniqueName: "kubernetes.io/projected/6d7e4b15-f2f5-422c-b325-52c38980aa18-kube-api-access-txxgt") pod "network-check-target-6d2bf" (UID: "6d7e4b15-f2f5-422c-b325-52c38980aa18") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 15:13:09.715046 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:09.715012 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:13:09.715514 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:09.715144 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm6dz" podUID="a3f19b43-b2b6-47dc-a66e-e447f95fa680" May 21 15:13:09.792449 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:09.792392 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-73.ec2.internal" event={"ID":"245c67db9059ef1be566ab2dc7a616d5","Type":"ContainerStarted","Data":"eb0fbacde628dbd6149b0b49512fb95d0c85a817f1c1343088f826552ce0cd41"} May 21 15:13:10.712722 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:10.712206 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:13:10.712722 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:10.712347 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6d2bf" podUID="6d7e4b15-f2f5-422c-b325-52c38980aa18" May 21 15:13:11.230296 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:11.229703 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3f19b43-b2b6-47dc-a66e-e447f95fa680-metrics-certs\") pod \"network-metrics-daemon-rm6dz\" (UID: \"a3f19b43-b2b6-47dc-a66e-e447f95fa680\") " pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:13:11.230296 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:11.229855 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 15:13:11.230296 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:11.229921 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3f19b43-b2b6-47dc-a66e-e447f95fa680-metrics-certs podName:a3f19b43-b2b6-47dc-a66e-e447f95fa680 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:15.229901259 +0000 UTC m=+10.081343503 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3f19b43-b2b6-47dc-a66e-e447f95fa680-metrics-certs") pod "network-metrics-daemon-rm6dz" (UID: "a3f19b43-b2b6-47dc-a66e-e447f95fa680") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 15:13:11.431640 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:11.431488 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-txxgt\" (UniqueName: \"kubernetes.io/projected/6d7e4b15-f2f5-422c-b325-52c38980aa18-kube-api-access-txxgt\") pod \"network-check-target-6d2bf\" (UID: \"6d7e4b15-f2f5-422c-b325-52c38980aa18\") " pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:13:11.431791 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:11.431676 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 15:13:11.431791 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:11.431700 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 15:13:11.431791 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:11.431714 2563 projected.go:194] Error preparing data for projected volume kube-api-access-txxgt for pod openshift-network-diagnostics/network-check-target-6d2bf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 15:13:11.431791 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:11.431783 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d7e4b15-f2f5-422c-b325-52c38980aa18-kube-api-access-txxgt podName:6d7e4b15-f2f5-422c-b325-52c38980aa18 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:15.431760706 +0000 UTC m=+10.283202945 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-txxgt" (UniqueName: "kubernetes.io/projected/6d7e4b15-f2f5-422c-b325-52c38980aa18-kube-api-access-txxgt") pod "network-check-target-6d2bf" (UID: "6d7e4b15-f2f5-422c-b325-52c38980aa18") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 15:13:11.716057 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:11.715551 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:13:11.716057 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:11.715681 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm6dz" podUID="a3f19b43-b2b6-47dc-a66e-e447f95fa680" May 21 15:13:12.712096 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:12.712059 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:13:12.712569 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:12.712190 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6d2bf" podUID="6d7e4b15-f2f5-422c-b325-52c38980aa18" May 21 15:13:13.712955 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:13.712675 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:13:13.712955 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:13.712809 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm6dz" podUID="a3f19b43-b2b6-47dc-a66e-e447f95fa680" May 21 15:13:14.712601 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:14.712562 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:13:14.712789 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:14.712681 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6d2bf" podUID="6d7e4b15-f2f5-422c-b325-52c38980aa18" May 21 15:13:15.263312 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:15.263278 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3f19b43-b2b6-47dc-a66e-e447f95fa680-metrics-certs\") pod \"network-metrics-daemon-rm6dz\" (UID: \"a3f19b43-b2b6-47dc-a66e-e447f95fa680\") " pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:13:15.263783 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:15.263487 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 15:13:15.263783 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:15.263553 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3f19b43-b2b6-47dc-a66e-e447f95fa680-metrics-certs podName:a3f19b43-b2b6-47dc-a66e-e447f95fa680 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:23.263533793 +0000 UTC m=+18.114976041 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3f19b43-b2b6-47dc-a66e-e447f95fa680-metrics-certs") pod "network-metrics-daemon-rm6dz" (UID: "a3f19b43-b2b6-47dc-a66e-e447f95fa680") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 15:13:15.465527 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:15.465478 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-txxgt\" (UniqueName: \"kubernetes.io/projected/6d7e4b15-f2f5-422c-b325-52c38980aa18-kube-api-access-txxgt\") pod \"network-check-target-6d2bf\" (UID: \"6d7e4b15-f2f5-422c-b325-52c38980aa18\") " pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:13:15.465719 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:15.465637 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 15:13:15.465719 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:15.465656 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 15:13:15.465719 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:15.465668 2563 projected.go:194] Error preparing data for projected volume kube-api-access-txxgt for pod openshift-network-diagnostics/network-check-target-6d2bf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 15:13:15.465873 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:15.465726 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d7e4b15-f2f5-422c-b325-52c38980aa18-kube-api-access-txxgt podName:6d7e4b15-f2f5-422c-b325-52c38980aa18 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:23.465709733 +0000 UTC m=+18.317151988 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-txxgt" (UniqueName: "kubernetes.io/projected/6d7e4b15-f2f5-422c-b325-52c38980aa18-kube-api-access-txxgt") pod "network-check-target-6d2bf" (UID: "6d7e4b15-f2f5-422c-b325-52c38980aa18") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 15:13:15.713890 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:15.713715 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:13:15.713890 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:15.713849 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm6dz" podUID="a3f19b43-b2b6-47dc-a66e-e447f95fa680" May 21 15:13:16.445154 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:16.445065 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-73.ec2.internal" podStartSLOduration=10.445048038 podStartE2EDuration="10.445048038s" podCreationTimestamp="2026-05-21 15:13:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:13:09.804725546 +0000 UTC m=+4.656167802" watchObservedRunningTime="2026-05-21 15:13:16.445048038 +0000 UTC m=+11.296490291" May 21 15:13:16.446050 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:16.445957 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-q54fh"] May 21 15:13:16.452374 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:16.452144 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q54fh" May 21 15:13:16.452374 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:16.452229 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q54fh" podUID="8da4a19d-0e83-46b4-9d33-9192394ad102" May 21 15:13:16.474134 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:16.474097 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8da4a19d-0e83-46b4-9d33-9192394ad102-dbus\") pod \"global-pull-secret-syncer-q54fh\" (UID: \"8da4a19d-0e83-46b4-9d33-9192394ad102\") " pod="kube-system/global-pull-secret-syncer-q54fh" May 21 15:13:16.474267 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:16.474163 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8da4a19d-0e83-46b4-9d33-9192394ad102-kubelet-config\") pod \"global-pull-secret-syncer-q54fh\" (UID: \"8da4a19d-0e83-46b4-9d33-9192394ad102\") " pod="kube-system/global-pull-secret-syncer-q54fh" May 21 15:13:16.474267 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:16.474215 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8da4a19d-0e83-46b4-9d33-9192394ad102-original-pull-secret\") pod \"global-pull-secret-syncer-q54fh\" (UID: \"8da4a19d-0e83-46b4-9d33-9192394ad102\") " pod="kube-system/global-pull-secret-syncer-q54fh" May 21 15:13:16.575315 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:16.575279 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8da4a19d-0e83-46b4-9d33-9192394ad102-dbus\") pod \"global-pull-secret-syncer-q54fh\" (UID: \"8da4a19d-0e83-46b4-9d33-9192394ad102\") " pod="kube-system/global-pull-secret-syncer-q54fh" May 21 15:13:16.575489 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:16.575360 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8da4a19d-0e83-46b4-9d33-9192394ad102-kubelet-config\") pod \"global-pull-secret-syncer-q54fh\" (UID: \"8da4a19d-0e83-46b4-9d33-9192394ad102\") " pod="kube-system/global-pull-secret-syncer-q54fh" May 21 15:13:16.575489 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:16.575411 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8da4a19d-0e83-46b4-9d33-9192394ad102-original-pull-secret\") pod \"global-pull-secret-syncer-q54fh\" (UID: \"8da4a19d-0e83-46b4-9d33-9192394ad102\") " pod="kube-system/global-pull-secret-syncer-q54fh" May 21 15:13:16.575605 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:16.575522 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8da4a19d-0e83-46b4-9d33-9192394ad102-kubelet-config\") pod \"global-pull-secret-syncer-q54fh\" (UID: \"8da4a19d-0e83-46b4-9d33-9192394ad102\") " pod="kube-system/global-pull-secret-syncer-q54fh" May 21 15:13:16.575605 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:16.575537 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 15:13:16.575605 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:16.575598 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da4a19d-0e83-46b4-9d33-9192394ad102-original-pull-secret podName:8da4a19d-0e83-46b4-9d33-9192394ad102 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:17.075579038 +0000 UTC m=+11.927021283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8da4a19d-0e83-46b4-9d33-9192394ad102-original-pull-secret") pod "global-pull-secret-syncer-q54fh" (UID: "8da4a19d-0e83-46b4-9d33-9192394ad102") : object "kube-system"/"original-pull-secret" not registered May 21 15:13:16.575762 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:16.575612 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8da4a19d-0e83-46b4-9d33-9192394ad102-dbus\") pod \"global-pull-secret-syncer-q54fh\" (UID: \"8da4a19d-0e83-46b4-9d33-9192394ad102\") " pod="kube-system/global-pull-secret-syncer-q54fh" May 21 15:13:16.711975 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:16.711787 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:13:16.711975 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:16.711924 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6d2bf" podUID="6d7e4b15-f2f5-422c-b325-52c38980aa18" May 21 15:13:17.081128 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:17.081084 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8da4a19d-0e83-46b4-9d33-9192394ad102-original-pull-secret\") pod \"global-pull-secret-syncer-q54fh\" (UID: \"8da4a19d-0e83-46b4-9d33-9192394ad102\") " pod="kube-system/global-pull-secret-syncer-q54fh" May 21 15:13:17.081299 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:17.081257 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 15:13:17.081401 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:17.081368 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da4a19d-0e83-46b4-9d33-9192394ad102-original-pull-secret podName:8da4a19d-0e83-46b4-9d33-9192394ad102 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:18.081347929 +0000 UTC m=+12.932790176 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8da4a19d-0e83-46b4-9d33-9192394ad102-original-pull-secret") pod "global-pull-secret-syncer-q54fh" (UID: "8da4a19d-0e83-46b4-9d33-9192394ad102") : object "kube-system"/"original-pull-secret" not registered May 21 15:13:17.712532 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:17.712497 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q54fh" May 21 15:13:17.712925 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:17.712631 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q54fh" podUID="8da4a19d-0e83-46b4-9d33-9192394ad102" May 21 15:13:17.712925 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:17.712718 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:13:17.712925 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:17.712840 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm6dz" podUID="a3f19b43-b2b6-47dc-a66e-e447f95fa680" May 21 15:13:18.088599 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:18.088555 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8da4a19d-0e83-46b4-9d33-9192394ad102-original-pull-secret\") pod \"global-pull-secret-syncer-q54fh\" (UID: \"8da4a19d-0e83-46b4-9d33-9192394ad102\") " pod="kube-system/global-pull-secret-syncer-q54fh" May 21 15:13:18.088768 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:18.088703 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 15:13:18.088768 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:18.088765 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da4a19d-0e83-46b4-9d33-9192394ad102-original-pull-secret podName:8da4a19d-0e83-46b4-9d33-9192394ad102 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:20.08875099 +0000 UTC m=+14.940193227 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8da4a19d-0e83-46b4-9d33-9192394ad102-original-pull-secret") pod "global-pull-secret-syncer-q54fh" (UID: "8da4a19d-0e83-46b4-9d33-9192394ad102") : object "kube-system"/"original-pull-secret" not registered May 21 15:13:18.712500 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:18.712429 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:13:18.712643 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:18.712560 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6d2bf" podUID="6d7e4b15-f2f5-422c-b325-52c38980aa18" May 21 15:13:19.711852 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:19.711801 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:13:19.712039 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:19.711814 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q54fh" May 21 15:13:19.712347 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:19.712289 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm6dz" podUID="a3f19b43-b2b6-47dc-a66e-e447f95fa680" May 21 15:13:19.712466 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:19.712393 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q54fh" podUID="8da4a19d-0e83-46b4-9d33-9192394ad102" May 21 15:13:20.101726 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:20.101675 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8da4a19d-0e83-46b4-9d33-9192394ad102-original-pull-secret\") pod \"global-pull-secret-syncer-q54fh\" (UID: \"8da4a19d-0e83-46b4-9d33-9192394ad102\") " pod="kube-system/global-pull-secret-syncer-q54fh" May 21 15:13:20.102190 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:20.101831 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 15:13:20.102190 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:20.101908 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da4a19d-0e83-46b4-9d33-9192394ad102-original-pull-secret podName:8da4a19d-0e83-46b4-9d33-9192394ad102 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:24.101890962 +0000 UTC m=+18.953333200 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8da4a19d-0e83-46b4-9d33-9192394ad102-original-pull-secret") pod "global-pull-secret-syncer-q54fh" (UID: "8da4a19d-0e83-46b4-9d33-9192394ad102") : object "kube-system"/"original-pull-secret" not registered May 21 15:13:20.712518 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:20.712487 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:13:20.712666 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:20.712613 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6d2bf" podUID="6d7e4b15-f2f5-422c-b325-52c38980aa18" May 21 15:13:21.712826 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:21.712791 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q54fh" May 21 15:13:21.713261 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:21.712802 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:13:21.713261 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:21.712933 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q54fh" podUID="8da4a19d-0e83-46b4-9d33-9192394ad102" May 21 15:13:21.713261 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:21.713012 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm6dz" podUID="a3f19b43-b2b6-47dc-a66e-e447f95fa680" May 21 15:13:22.711923 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:22.711883 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:13:22.712158 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:22.712015 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6d2bf" podUID="6d7e4b15-f2f5-422c-b325-52c38980aa18" May 21 15:13:23.329054 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:23.329013 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3f19b43-b2b6-47dc-a66e-e447f95fa680-metrics-certs\") pod \"network-metrics-daemon-rm6dz\" (UID: \"a3f19b43-b2b6-47dc-a66e-e447f95fa680\") " pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:13:23.329506 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:23.329153 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 15:13:23.329506 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:23.329231 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3f19b43-b2b6-47dc-a66e-e447f95fa680-metrics-certs podName:a3f19b43-b2b6-47dc-a66e-e447f95fa680 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:39.329213607 +0000 UTC m=+34.180655844 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3f19b43-b2b6-47dc-a66e-e447f95fa680-metrics-certs") pod "network-metrics-daemon-rm6dz" (UID: "a3f19b43-b2b6-47dc-a66e-e447f95fa680") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 15:13:23.531485 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:23.531445 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-txxgt\" (UniqueName: \"kubernetes.io/projected/6d7e4b15-f2f5-422c-b325-52c38980aa18-kube-api-access-txxgt\") pod \"network-check-target-6d2bf\" (UID: \"6d7e4b15-f2f5-422c-b325-52c38980aa18\") " pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:13:23.531661 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:23.531596 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 15:13:23.531661 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:23.531615 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 15:13:23.531661 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:23.531628 2563 projected.go:194] Error preparing data for projected volume kube-api-access-txxgt for pod openshift-network-diagnostics/network-check-target-6d2bf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 15:13:23.531801 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:23.531691 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d7e4b15-f2f5-422c-b325-52c38980aa18-kube-api-access-txxgt podName:6d7e4b15-f2f5-422c-b325-52c38980aa18 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:39.531670654 +0000 UTC m=+34.383112891 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-txxgt" (UniqueName: "kubernetes.io/projected/6d7e4b15-f2f5-422c-b325-52c38980aa18-kube-api-access-txxgt") pod "network-check-target-6d2bf" (UID: "6d7e4b15-f2f5-422c-b325-52c38980aa18") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 15:13:23.715117 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:23.715035 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q54fh" May 21 15:13:23.715283 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:23.715035 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:13:23.715283 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:23.715155 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q54fh" podUID="8da4a19d-0e83-46b4-9d33-9192394ad102" May 21 15:13:23.715406 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:23.715289 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm6dz" podUID="a3f19b43-b2b6-47dc-a66e-e447f95fa680" May 21 15:13:24.135908 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:24.135870 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8da4a19d-0e83-46b4-9d33-9192394ad102-original-pull-secret\") pod \"global-pull-secret-syncer-q54fh\" (UID: \"8da4a19d-0e83-46b4-9d33-9192394ad102\") " pod="kube-system/global-pull-secret-syncer-q54fh" May 21 15:13:24.136058 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:24.136034 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 15:13:24.136103 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:24.136099 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da4a19d-0e83-46b4-9d33-9192394ad102-original-pull-secret podName:8da4a19d-0e83-46b4-9d33-9192394ad102 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:32.136084009 +0000 UTC m=+26.987526247 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8da4a19d-0e83-46b4-9d33-9192394ad102-original-pull-secret") pod "global-pull-secret-syncer-q54fh" (UID: "8da4a19d-0e83-46b4-9d33-9192394ad102") : object "kube-system"/"original-pull-secret" not registered May 21 15:13:24.712496 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:24.712462 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:13:24.712951 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:24.712572 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6d2bf" podUID="6d7e4b15-f2f5-422c-b325-52c38980aa18" May 21 15:13:25.715115 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:25.715084 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q54fh" May 21 15:13:25.715542 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:25.715093 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:13:25.715542 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:25.715201 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q54fh" podUID="8da4a19d-0e83-46b4-9d33-9192394ad102" May 21 15:13:25.715542 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:25.715293 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm6dz" podUID="a3f19b43-b2b6-47dc-a66e-e447f95fa680" May 21 15:13:26.712573 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:26.712401 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:13:26.712695 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:26.712669 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6d2bf" podUID="6d7e4b15-f2f5-422c-b325-52c38980aa18" May 21 15:13:26.822228 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:26.822188 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qk6gn" event={"ID":"fee7957c-3284-486f-ab40-ba1ce992878a","Type":"ContainerStarted","Data":"e21d6356cb11a430d9e471511e7469d4b7b5b451fc8c2de4b0fae455649b2788"} May 21 15:13:26.823420 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:26.823399 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbhjj" event={"ID":"80471774-c0c2-400d-8594-af1c6f66c55c","Type":"ContainerStarted","Data":"5b1d8702b54223dae4bea70c83c9d7bbb3d4155238cd0e8c7b81ec590783c65d"} May 21 15:13:26.824487 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:26.824463 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bd4zt" event={"ID":"33521081-e967-4d23-8420-512dc3b0ca01","Type":"ContainerStarted","Data":"8f6455258b534879c63ab46079b9c3ba8e53214561b148334fe94d35e1b3a8f3"} May 21 15:13:26.825702 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:26.825682 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-55t5c" event={"ID":"4a37171f-d7b3-4c9b-98a1-5d74d829217d","Type":"ContainerStarted","Data":"c9a7c4f2fec9a1d24bd51929dcb38faf5a769a79c6aaebc326cd73cd3659d308"} May 21 15:13:26.826832 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:26.826811 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-57tbw" event={"ID":"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da","Type":"ContainerStarted","Data":"cca3e9b727e5c183ae1b4cf4cc261855950d84db175b3625e0096b4635f2f8d2"} May 21 15:13:26.827992 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:26.827970 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-75xw9" event={"ID":"fbb8ef5a-6ec7-4038-9753-819b2a74b5d2","Type":"ContainerStarted","Data":"9839af6295afc57b6b655ccd247ec359a0f0a4e7bce7a7726a6548354f1eb67a"} May 21 15:13:26.829261 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:26.829244 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kvk52" event={"ID":"867c5016-c412-463c-b76f-abddcdbfae50","Type":"ContainerStarted","Data":"344ddefb1048439be4ac23d55ddc5e332f0a48453bf44258fb2b0b731d088810"} May 21 15:13:26.833042 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:26.833010 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-qk6gn" podStartSLOduration=2.6017495569999998 podStartE2EDuration="20.833001674s" podCreationTimestamp="2026-05-21 15:13:06 +0000 UTC" firstStartedPulling="2026-05-21 15:13:08.328374685 +0000 UTC m=+3.179816919" lastFinishedPulling="2026-05-21 15:13:26.559626788 +0000 UTC m=+21.411069036" observedRunningTime="2026-05-21 15:13:26.832590494 +0000 UTC m=+21.684032752" watchObservedRunningTime="2026-05-21 15:13:26.833001674 +0000 UTC m=+21.684443929" May 21 15:13:26.853022 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:26.852985 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-75xw9" podStartSLOduration=2.641805421 podStartE2EDuration="20.852974467s" podCreationTimestamp="2026-05-21 15:13:06 +0000 UTC" firstStartedPulling="2026-05-21 15:13:08.327594095 +0000 UTC m=+3.179036328" lastFinishedPulling="2026-05-21 15:13:26.538763138 +0000 UTC m=+21.390205374" observedRunningTime="2026-05-21 15:13:26.8431961 +0000 UTC m=+21.694638355" watchObservedRunningTime="2026-05-21 15:13:26.852974467 +0000 UTC m=+21.704416722" May 21 15:13:26.853329 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:26.853309 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kvk52" podStartSLOduration=11.699690456999999 podStartE2EDuration="21.8533042s" podCreationTimestamp="2026-05-21 15:13:05 +0000 UTC" firstStartedPulling="2026-05-21 15:13:08.320055264 +0000 UTC m=+3.171497501" lastFinishedPulling="2026-05-21 15:13:18.473668996 +0000 UTC m=+13.325111244" observedRunningTime="2026-05-21 15:13:26.85275958 +0000 UTC m=+21.704201835" watchObservedRunningTime="2026-05-21 15:13:26.8533042 +0000 UTC m=+21.704746454" May 21 15:13:26.865035 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:26.865001 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-bd4zt" podStartSLOduration=3.620938436 podStartE2EDuration="21.864990793s" podCreationTimestamp="2026-05-21 15:13:05 +0000 UTC" firstStartedPulling="2026-05-21 15:13:08.327380368 +0000 UTC m=+3.178822602" lastFinishedPulling="2026-05-21 15:13:26.571432726 +0000 UTC m=+21.422874959" observedRunningTime="2026-05-21 15:13:26.864564019 +0000 UTC m=+21.716006274" watchObservedRunningTime="2026-05-21 15:13:26.864990793 +0000 UTC m=+21.716433047" May 21 15:13:27.715092 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:27.714939 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:13:27.715174 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:27.714939 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q54fh" May 21 15:13:27.715225 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:27.715174 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm6dz" podUID="a3f19b43-b2b6-47dc-a66e-e447f95fa680" May 21 15:13:27.715276 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:27.715232 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q54fh" podUID="8da4a19d-0e83-46b4-9d33-9192394ad102" May 21 15:13:27.762296 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:27.762270 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 15:13:27.833456 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:27.833429 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" event={"ID":"a4c28d96-338d-4eb5-a40d-0febf25e8d7c","Type":"ContainerStarted","Data":"0843c4d0f1e6ae1293e843ab741c49669fd83bc3e74e4e1751c0213e5db947ac"} May 21 15:13:27.833987 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:27.833462 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" event={"ID":"a4c28d96-338d-4eb5-a40d-0febf25e8d7c","Type":"ContainerStarted","Data":"4fc388ccc56ce1be8d2303c6397ed258ada18560171fc8a3773fd331757e3b1f"} May 21 15:13:27.833987 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:27.833477 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" event={"ID":"a4c28d96-338d-4eb5-a40d-0febf25e8d7c","Type":"ContainerStarted","Data":"49d7ccd847c90ec319546361405e0fbee6bba1976e7f3013bc41e77369d6a489"} May 21 15:13:27.833987 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:27.833490 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" event={"ID":"a4c28d96-338d-4eb5-a40d-0febf25e8d7c","Type":"ContainerStarted","Data":"69d213d1da3e598dba800b7dd96c3e97cf9bc6571bcc5c0ec1787286e62539d6"} May 21 15:13:27.833987 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:27.833503 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" event={"ID":"a4c28d96-338d-4eb5-a40d-0febf25e8d7c","Type":"ContainerStarted","Data":"9c8a105069b8a79933d00792df513697f478337682d83d215bc642c015639ca5"} May 21 15:13:27.833987 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:27.833513 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" event={"ID":"a4c28d96-338d-4eb5-a40d-0febf25e8d7c","Type":"ContainerStarted","Data":"704e2c8341f24c63e649868d3edd7a240c2bce21455ffc02c933cf8812688e9c"} May 21 15:13:27.834905 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:27.834885 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbhjj" event={"ID":"80471774-c0c2-400d-8594-af1c6f66c55c","Type":"ContainerStarted","Data":"48e71609e613338e841e3b9133986dd93f2e9d55b3ad3252b4157a8f1a53f8f5"} May 21 15:13:27.836150 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:27.836129 2563 generic.go:358] "Generic (PLEG): container finished" podID="1f245a8f-9cf0-4b38-a9cf-73bd4cb432da" containerID="cca3e9b727e5c183ae1b4cf4cc261855950d84db175b3625e0096b4635f2f8d2" exitCode=0 May 21 15:13:27.836254 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:27.836231 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-57tbw" event={"ID":"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da","Type":"ContainerDied","Data":"cca3e9b727e5c183ae1b4cf4cc261855950d84db175b3625e0096b4635f2f8d2"} May 21 15:13:27.851289 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:27.851253 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-55t5c" podStartSLOduration=4.605410635 podStartE2EDuration="22.851242289s" podCreationTimestamp="2026-05-21 15:13:05 +0000 UTC" firstStartedPulling="2026-05-21 15:13:08.315732327 +0000 UTC m=+3.167174566" lastFinishedPulling="2026-05-21 15:13:26.561563977 +0000 UTC m=+21.413006220" observedRunningTime="2026-05-21 15:13:26.876387326 +0000 UTC m=+21.727829580" watchObservedRunningTime="2026-05-21 15:13:27.851242289 +0000 UTC m=+22.702684544" May 21 15:13:28.673054 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:28.672941 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T15:13:27.762291821Z","UUID":"dd5ce957-66e5-4ccb-861a-9dde2c8f21a4","Handler":null,"Name":"","Endpoint":""} May 21 15:13:28.674911 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:28.674893 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 15:13:28.675046 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:28.674934 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 15:13:28.712626 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:28.712602 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:13:28.712750 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:28.712707 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6d2bf" podUID="6d7e4b15-f2f5-422c-b325-52c38980aa18" May 21 15:13:28.838910 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:28.838876 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fdx2f" event={"ID":"4647300a-6e2b-470b-a126-6040a4f6a213","Type":"ContainerStarted","Data":"ad1f85695beeb611aad2dcb163cdc5bd50beda8affdbec9444adfc0a56a7e404"} May 21 15:13:28.869793 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:28.869749 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fdx2f" podStartSLOduration=4.63949089 podStartE2EDuration="22.869736077s" podCreationTimestamp="2026-05-21 15:13:06 +0000 UTC" firstStartedPulling="2026-05-21 15:13:08.329398035 +0000 UTC m=+3.180840267" lastFinishedPulling="2026-05-21 15:13:26.55964322 +0000 UTC m=+21.411085454" observedRunningTime="2026-05-21 15:13:28.869555497 +0000 UTC m=+23.720997752" watchObservedRunningTime="2026-05-21 15:13:28.869736077 +0000 UTC m=+23.721178331" May 21 15:13:29.711837 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:29.711752 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q54fh" May 21 15:13:29.711998 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:29.711761 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:13:29.711998 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:29.711860 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q54fh" podUID="8da4a19d-0e83-46b4-9d33-9192394ad102" May 21 15:13:29.711998 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:29.711930 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm6dz" podUID="a3f19b43-b2b6-47dc-a66e-e447f95fa680" May 21 15:13:29.843697 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:29.843659 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbhjj" event={"ID":"80471774-c0c2-400d-8594-af1c6f66c55c","Type":"ContainerStarted","Data":"b1a4d044fd73893dfcbdd34b73493ea5fe6520c16992e7dfd3e792578204224e"} May 21 15:13:29.846953 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:29.846923 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" event={"ID":"a4c28d96-338d-4eb5-a40d-0febf25e8d7c","Type":"ContainerStarted","Data":"34c3bf8f8de72a150840af0b573a667c1101f859430d7adb398699c24dddab09"} May 21 15:13:29.861089 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:29.861036 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wbhjj" podStartSLOduration=4.262242863 podStartE2EDuration="24.861020323s" podCreationTimestamp="2026-05-21 15:13:05 +0000 UTC" firstStartedPulling="2026-05-21 15:13:08.32868422 +0000 UTC m=+3.180126465" lastFinishedPulling="2026-05-21 15:13:28.927461677 +0000 UTC m=+23.778903925" observedRunningTime="2026-05-21 15:13:29.860928988 +0000 UTC m=+24.712371279" watchObservedRunningTime="2026-05-21 15:13:29.861020323 +0000 UTC m=+24.712462581" May 21 15:13:30.658353 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:30.658060 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-75xw9" May 21 15:13:30.658753 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:30.658727 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-75xw9" May 21 15:13:30.712748 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:30.712722 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:13:30.712875 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:30.712800 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6d2bf" podUID="6d7e4b15-f2f5-422c-b325-52c38980aa18" May 21 15:13:30.848381 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:30.848350 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-75xw9" May 21 15:13:30.848761 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:30.848617 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-75xw9" May 21 15:13:31.712404 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:31.712184 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:13:31.712567 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:31.712242 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q54fh" May 21 15:13:31.712567 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:31.712517 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm6dz" podUID="a3f19b43-b2b6-47dc-a66e-e447f95fa680" May 21 15:13:31.712745 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:31.712707 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q54fh" podUID="8da4a19d-0e83-46b4-9d33-9192394ad102" May 21 15:13:31.853999 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:31.853872 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" event={"ID":"a4c28d96-338d-4eb5-a40d-0febf25e8d7c","Type":"ContainerStarted","Data":"cc718dd72521d5c6366ac6e13b846c6cdaf249526e4ba2d7910efeae65555852"} May 21 15:13:31.854920 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:31.854200 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:31.872619 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:31.872594 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:31.904900 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:31.904856 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" podStartSLOduration=7.201057634 podStartE2EDuration="25.90484333s" podCreationTimestamp="2026-05-21 15:13:06 +0000 UTC" firstStartedPulling="2026-05-21 15:13:08.316668002 +0000 UTC m=+3.168110235" lastFinishedPulling="2026-05-21 15:13:27.020453698 +0000 UTC m=+21.871895931" observedRunningTime="2026-05-21 15:13:31.881438626 +0000 UTC m=+26.732880881" watchObservedRunningTime="2026-05-21 15:13:31.90484333 +0000 UTC m=+26.756285585" May 21 15:13:32.199917 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:32.199840 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8da4a19d-0e83-46b4-9d33-9192394ad102-original-pull-secret\") pod \"global-pull-secret-syncer-q54fh\" (UID: \"8da4a19d-0e83-46b4-9d33-9192394ad102\") " pod="kube-system/global-pull-secret-syncer-q54fh" May 21 15:13:32.200056 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:32.199955 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 15:13:32.200056 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:32.200005 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8da4a19d-0e83-46b4-9d33-9192394ad102-original-pull-secret podName:8da4a19d-0e83-46b4-9d33-9192394ad102 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:48.199991983 +0000 UTC m=+43.051434215 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8da4a19d-0e83-46b4-9d33-9192394ad102-original-pull-secret") pod "global-pull-secret-syncer-q54fh" (UID: "8da4a19d-0e83-46b4-9d33-9192394ad102") : object "kube-system"/"original-pull-secret" not registered May 21 15:13:32.712434 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:32.712401 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:13:32.712644 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:32.712526 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6d2bf" podUID="6d7e4b15-f2f5-422c-b325-52c38980aa18" May 21 15:13:32.855633 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:32.855601 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:32.855633 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:32.855642 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:32.870306 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:32.870282 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:13:33.497085 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:33.497052 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rm6dz"] May 21 15:13:33.497271 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:33.497203 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:13:33.497330 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:33.497313 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm6dz" podUID="a3f19b43-b2b6-47dc-a66e-e447f95fa680" May 21 15:13:33.499589 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:33.499468 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6d2bf"] May 21 15:13:33.499589 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:33.499562 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:13:33.499787 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:33.499649 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6d2bf" podUID="6d7e4b15-f2f5-422c-b325-52c38980aa18" May 21 15:13:33.500123 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:33.500100 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q54fh"] May 21 15:13:33.500226 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:33.500207 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q54fh" May 21 15:13:33.500296 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:33.500280 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q54fh" podUID="8da4a19d-0e83-46b4-9d33-9192394ad102" May 21 15:13:34.712218 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:34.712159 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:13:34.712537 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:34.712264 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6d2bf" podUID="6d7e4b15-f2f5-422c-b325-52c38980aa18" May 21 15:13:34.861140 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:34.861110 2563 generic.go:358] "Generic (PLEG): container finished" podID="1f245a8f-9cf0-4b38-a9cf-73bd4cb432da" containerID="be8cca6024637c3e77e5c5b52730f4005c2796beafa0031340c6e9c769f6224a" exitCode=0 May 21 15:13:34.861324 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:34.861201 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-57tbw" event={"ID":"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da","Type":"ContainerDied","Data":"be8cca6024637c3e77e5c5b52730f4005c2796beafa0031340c6e9c769f6224a"} May 21 15:13:35.712675 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:35.712643 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q54fh" May 21 15:13:35.713067 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:35.712748 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q54fh" podUID="8da4a19d-0e83-46b4-9d33-9192394ad102" May 21 15:13:35.713067 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:35.712816 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:13:35.713067 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:35.712900 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm6dz" podUID="a3f19b43-b2b6-47dc-a66e-e447f95fa680" May 21 15:13:36.711957 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:36.711898 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:13:36.712073 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:36.712000 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6d2bf" podUID="6d7e4b15-f2f5-422c-b325-52c38980aa18" May 21 15:13:36.866633 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:36.866601 2563 generic.go:358] "Generic (PLEG): container finished" podID="1f245a8f-9cf0-4b38-a9cf-73bd4cb432da" containerID="ef7c9a91a61e1b8d03df4df738bc7abf02958e37b3d6dbf6d247aa2963cc4695" exitCode=0 May 21 15:13:36.866971 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:36.866643 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-57tbw" event={"ID":"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da","Type":"ContainerDied","Data":"ef7c9a91a61e1b8d03df4df738bc7abf02958e37b3d6dbf6d247aa2963cc4695"} May 21 15:13:37.711953 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:37.711918 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:13:37.711953 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:37.711939 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q54fh" May 21 15:13:37.712194 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:37.712066 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm6dz" podUID="a3f19b43-b2b6-47dc-a66e-e447f95fa680" May 21 15:13:37.712245 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:37.712200 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q54fh" podUID="8da4a19d-0e83-46b4-9d33-9192394ad102" May 21 15:13:38.712283 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:38.712250 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:13:38.712746 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:38.712369 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6d2bf" podUID="6d7e4b15-f2f5-422c-b325-52c38980aa18" May 21 15:13:38.871896 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:38.871861 2563 generic.go:358] "Generic (PLEG): container finished" podID="1f245a8f-9cf0-4b38-a9cf-73bd4cb432da" containerID="63ea9b2fec3f5f9433fcc7cad7aa412960c0d459893011bb40e09bd6a188b693" exitCode=0 May 21 15:13:38.871896 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:38.871900 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-57tbw" event={"ID":"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da","Type":"ContainerDied","Data":"63ea9b2fec3f5f9433fcc7cad7aa412960c0d459893011bb40e09bd6a188b693"} May 21 15:13:39.358984 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:39.358955 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3f19b43-b2b6-47dc-a66e-e447f95fa680-metrics-certs\") pod \"network-metrics-daemon-rm6dz\" (UID: \"a3f19b43-b2b6-47dc-a66e-e447f95fa680\") " pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:13:39.359135 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:39.359076 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 15:13:39.359135 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:39.359129 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3f19b43-b2b6-47dc-a66e-e447f95fa680-metrics-certs podName:a3f19b43-b2b6-47dc-a66e-e447f95fa680 nodeName:}" failed. No retries permitted until 2026-05-21 15:14:11.359111725 +0000 UTC m=+66.210553959 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3f19b43-b2b6-47dc-a66e-e447f95fa680-metrics-certs") pod "network-metrics-daemon-rm6dz" (UID: "a3f19b43-b2b6-47dc-a66e-e447f95fa680") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 15:13:39.560413 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:39.560380 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-txxgt\" (UniqueName: \"kubernetes.io/projected/6d7e4b15-f2f5-422c-b325-52c38980aa18-kube-api-access-txxgt\") pod \"network-check-target-6d2bf\" (UID: \"6d7e4b15-f2f5-422c-b325-52c38980aa18\") " pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:13:39.560567 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:39.560533 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 15:13:39.560567 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:39.560551 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 15:13:39.560567 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:39.560562 2563 projected.go:194] Error preparing data for projected volume kube-api-access-txxgt for pod openshift-network-diagnostics/network-check-target-6d2bf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 15:13:39.560679 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:39.560607 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6d7e4b15-f2f5-422c-b325-52c38980aa18-kube-api-access-txxgt podName:6d7e4b15-f2f5-422c-b325-52c38980aa18 nodeName:}" failed. No retries permitted until 2026-05-21 15:14:11.560594146 +0000 UTC m=+66.412036379 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-txxgt" (UniqueName: "kubernetes.io/projected/6d7e4b15-f2f5-422c-b325-52c38980aa18-kube-api-access-txxgt") pod "network-check-target-6d2bf" (UID: "6d7e4b15-f2f5-422c-b325-52c38980aa18") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 15:13:39.711974 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:39.711901 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q54fh" May 21 15:13:39.712123 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:39.712036 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q54fh" podUID="8da4a19d-0e83-46b4-9d33-9192394ad102" May 21 15:13:39.712123 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:39.712104 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:13:39.712259 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:39.712232 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm6dz" podUID="a3f19b43-b2b6-47dc-a66e-e447f95fa680" May 21 15:13:40.501136 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.501091 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-142-73.ec2.internal" event="NodeReady" May 21 15:13:40.501598 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.501233 2563 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 15:13:40.534691 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.534664 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-86b8889454-d87bd"] May 21 15:13:40.556544 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.556514 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-flsp4"] May 21 15:13:40.556700 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.556679 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:13:40.558672 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.558652 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 15:13:40.558776 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.558670 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 15:13:40.558826 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.558800 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 15:13:40.558927 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.558910 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jhr97\"" May 21 15:13:40.570789 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.570769 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-flsp4"] May 21 15:13:40.570877 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.570796 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86b8889454-d87bd"] May 21 15:13:40.570877 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.570811 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5xx2h"] May 21 15:13:40.570949 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.570906 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-flsp4" May 21 15:13:40.572804 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.572785 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" May 21 15:13:40.572804 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.572793 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" May 21 15:13:40.572943 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.572813 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pqm9t\"" May 21 15:13:40.574093 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.574076 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 15:13:40.588045 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.588028 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5xx2h"] May 21 15:13:40.588149 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.588139 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5xx2h" May 21 15:13:40.590240 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.590220 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-d4dlc\"" May 21 15:13:40.590528 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.590240 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 15:13:40.590528 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.590249 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 15:13:40.590839 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.590820 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 15:13:40.651459 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.651432 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-l4hfq"] May 21 15:13:40.673961 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.673606 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d628e927-bb20-4718-9f22-5bf1466e69e4-trusted-ca\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:13:40.673961 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.673672 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d628e927-bb20-4718-9f22-5bf1466e69e4-ca-trust-extracted\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:13:40.673961 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.673699 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d628e927-bb20-4718-9f22-5bf1466e69e4-installation-pull-secrets\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:13:40.673961 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.673722 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b99k6\" (UniqueName: \"kubernetes.io/projected/cddef031-be16-4fae-94e0-3e4bb6fcf669-kube-api-access-b99k6\") pod \"ingress-canary-5xx2h\" (UID: \"cddef031-be16-4fae-94e0-3e4bb6fcf669\") " pod="openshift-ingress-canary/ingress-canary-5xx2h" May 21 15:13:40.673961 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.673750 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-tls\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:13:40.673961 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.673779 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cddef031-be16-4fae-94e0-3e4bb6fcf669-cert\") pod \"ingress-canary-5xx2h\" (UID: \"cddef031-be16-4fae-94e0-3e4bb6fcf669\") " pod="openshift-ingress-canary/ingress-canary-5xx2h" May 21 15:13:40.673961 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.673826 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d628e927-bb20-4718-9f22-5bf1466e69e4-image-registry-private-configuration\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:13:40.673961 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.673850 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-certificates\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:13:40.673961 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.673880 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-bound-sa-token\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:13:40.673961 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.673903 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9e166c77-8d3b-43e3-ae04-132de04f2d6b-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-flsp4\" (UID: \"9e166c77-8d3b-43e3-ae04-132de04f2d6b\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-flsp4" May 21 15:13:40.673961 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.673938 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e166c77-8d3b-43e3-ae04-132de04f2d6b-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-flsp4\" (UID: \"9e166c77-8d3b-43e3-ae04-132de04f2d6b\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-flsp4" May 21 15:13:40.673961 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.673973 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49gwj\" (UniqueName: \"kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-kube-api-access-49gwj\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:13:40.681558 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.681534 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l4hfq"] May 21 15:13:40.681686 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.681674 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l4hfq" May 21 15:13:40.685457 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.684255 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 15:13:40.685457 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.684626 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d98kf\"" May 21 15:13:40.685457 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.684849 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 15:13:40.712203 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.712160 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:13:40.714390 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.714358 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 15:13:40.714485 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.714407 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 15:13:40.714485 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.714467 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x4qds\"" May 21 15:13:40.774667 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.774576 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d628e927-bb20-4718-9f22-5bf1466e69e4-image-registry-private-configuration\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:13:40.774667 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.774618 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-certificates\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:13:40.774667 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.774652 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-bound-sa-token\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:13:40.774927 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.774675 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9e166c77-8d3b-43e3-ae04-132de04f2d6b-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-flsp4\" (UID: \"9e166c77-8d3b-43e3-ae04-132de04f2d6b\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-flsp4" May 21 15:13:40.774927 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.774707 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/92953616-a22e-45da-bab9-689855f9f01d-config-volume\") pod \"dns-default-l4hfq\" (UID: \"92953616-a22e-45da-bab9-689855f9f01d\") " pod="openshift-dns/dns-default-l4hfq" May 21 15:13:40.774927 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.774826 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e166c77-8d3b-43e3-ae04-132de04f2d6b-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-flsp4\" (UID: \"9e166c77-8d3b-43e3-ae04-132de04f2d6b\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-flsp4" May 21 15:13:40.774927 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.774870 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-49gwj\" (UniqueName: \"kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-kube-api-access-49gwj\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:13:40.774927 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.774897 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92953616-a22e-45da-bab9-689855f9f01d-metrics-tls\") pod \"dns-default-l4hfq\" (UID: \"92953616-a22e-45da-bab9-689855f9f01d\") " pod="openshift-dns/dns-default-l4hfq" May 21 15:13:40.774927 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.774921 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92953616-a22e-45da-bab9-689855f9f01d-tmp-dir\") pod \"dns-default-l4hfq\" (UID: \"92953616-a22e-45da-bab9-689855f9f01d\") " pod="openshift-dns/dns-default-l4hfq" May 21 15:13:40.775195 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.774966 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d628e927-bb20-4718-9f22-5bf1466e69e4-trusted-ca\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:13:40.775195 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:40.775010 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 15:13:40.775195 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:40.775092 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e166c77-8d3b-43e3-ae04-132de04f2d6b-networking-console-plugin-cert podName:9e166c77-8d3b-43e3-ae04-132de04f2d6b nodeName:}" failed. No retries permitted until 2026-05-21 15:13:41.275070784 +0000 UTC m=+36.126513027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9e166c77-8d3b-43e3-ae04-132de04f2d6b-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-flsp4" (UID: "9e166c77-8d3b-43e3-ae04-132de04f2d6b") : secret "networking-console-plugin-cert" not found May 21 15:13:40.775195 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.775018 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqrcc\" (UniqueName: \"kubernetes.io/projected/92953616-a22e-45da-bab9-689855f9f01d-kube-api-access-kqrcc\") pod \"dns-default-l4hfq\" (UID: \"92953616-a22e-45da-bab9-689855f9f01d\") " pod="openshift-dns/dns-default-l4hfq" May 21 15:13:40.775195 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.775138 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d628e927-bb20-4718-9f22-5bf1466e69e4-ca-trust-extracted\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:13:40.775195 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.775167 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d628e927-bb20-4718-9f22-5bf1466e69e4-installation-pull-secrets\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:13:40.775195 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.775193 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b99k6\" (UniqueName: \"kubernetes.io/projected/cddef031-be16-4fae-94e0-3e4bb6fcf669-kube-api-access-b99k6\") pod \"ingress-canary-5xx2h\" (UID: \"cddef031-be16-4fae-94e0-3e4bb6fcf669\") " pod="openshift-ingress-canary/ingress-canary-5xx2h" May 21 15:13:40.775566 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.775224 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-tls\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:13:40.775566 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.775258 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cddef031-be16-4fae-94e0-3e4bb6fcf669-cert\") pod \"ingress-canary-5xx2h\" (UID: \"cddef031-be16-4fae-94e0-3e4bb6fcf669\") " pod="openshift-ingress-canary/ingress-canary-5xx2h" May 21 15:13:40.775566 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.775380 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-certificates\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:13:40.775566 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:40.775406 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 15:13:40.775566 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:40.775466 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cddef031-be16-4fae-94e0-3e4bb6fcf669-cert podName:cddef031-be16-4fae-94e0-3e4bb6fcf669 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:41.275450377 +0000 UTC m=+36.126892626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cddef031-be16-4fae-94e0-3e4bb6fcf669-cert") pod "ingress-canary-5xx2h" (UID: "cddef031-be16-4fae-94e0-3e4bb6fcf669") : secret "canary-serving-cert" not found May 21 15:13:40.775566 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.775489 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d628e927-bb20-4718-9f22-5bf1466e69e4-ca-trust-extracted\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:13:40.775566 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.775497 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9e166c77-8d3b-43e3-ae04-132de04f2d6b-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-flsp4\" (UID: \"9e166c77-8d3b-43e3-ae04-132de04f2d6b\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-flsp4" May 21 15:13:40.775566 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:40.775536 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 15:13:40.775566 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:40.775565 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b8889454-d87bd: secret "image-registry-tls" not found May 21 15:13:40.775873 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:40.775607 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-tls podName:d628e927-bb20-4718-9f22-5bf1466e69e4 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:41.275592403 +0000 UTC m=+36.127034650 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-tls") pod "image-registry-86b8889454-d87bd" (UID: "d628e927-bb20-4718-9f22-5bf1466e69e4") : secret "image-registry-tls" not found May 21 15:13:40.775929 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.775908 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d628e927-bb20-4718-9f22-5bf1466e69e4-trusted-ca\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:13:40.779063 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.779038 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d628e927-bb20-4718-9f22-5bf1466e69e4-installation-pull-secrets\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:13:40.779163 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.779044 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d628e927-bb20-4718-9f22-5bf1466e69e4-image-registry-private-configuration\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:13:40.785863 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.785837 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b99k6\" (UniqueName: \"kubernetes.io/projected/cddef031-be16-4fae-94e0-3e4bb6fcf669-kube-api-access-b99k6\") pod \"ingress-canary-5xx2h\" (UID: \"cddef031-be16-4fae-94e0-3e4bb6fcf669\") " pod="openshift-ingress-canary/ingress-canary-5xx2h" May 21 15:13:40.785863 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.785855 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-bound-sa-token\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:13:40.786200 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.786180 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49gwj\" (UniqueName: \"kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-kube-api-access-49gwj\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:13:40.875650 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.875614 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/92953616-a22e-45da-bab9-689855f9f01d-config-volume\") pod \"dns-default-l4hfq\" (UID: \"92953616-a22e-45da-bab9-689855f9f01d\") " pod="openshift-dns/dns-default-l4hfq" May 21 15:13:40.875826 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.875685 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92953616-a22e-45da-bab9-689855f9f01d-metrics-tls\") pod \"dns-default-l4hfq\" (UID: \"92953616-a22e-45da-bab9-689855f9f01d\") " pod="openshift-dns/dns-default-l4hfq" May 21 15:13:40.875826 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.875712 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92953616-a22e-45da-bab9-689855f9f01d-tmp-dir\") pod \"dns-default-l4hfq\" (UID: \"92953616-a22e-45da-bab9-689855f9f01d\") " pod="openshift-dns/dns-default-l4hfq" May 21 15:13:40.875826 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.875770 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kqrcc\" (UniqueName: \"kubernetes.io/projected/92953616-a22e-45da-bab9-689855f9f01d-kube-api-access-kqrcc\") pod \"dns-default-l4hfq\" (UID: \"92953616-a22e-45da-bab9-689855f9f01d\") " pod="openshift-dns/dns-default-l4hfq" May 21 15:13:40.875997 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:40.875846 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 15:13:40.875997 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:40.875926 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92953616-a22e-45da-bab9-689855f9f01d-metrics-tls podName:92953616-a22e-45da-bab9-689855f9f01d nodeName:}" failed. No retries permitted until 2026-05-21 15:13:41.375905766 +0000 UTC m=+36.227348019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/92953616-a22e-45da-bab9-689855f9f01d-metrics-tls") pod "dns-default-l4hfq" (UID: "92953616-a22e-45da-bab9-689855f9f01d") : secret "dns-default-metrics-tls" not found May 21 15:13:40.876092 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.876052 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92953616-a22e-45da-bab9-689855f9f01d-tmp-dir\") pod \"dns-default-l4hfq\" (UID: \"92953616-a22e-45da-bab9-689855f9f01d\") " pod="openshift-dns/dns-default-l4hfq" May 21 15:13:40.876255 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.876236 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/92953616-a22e-45da-bab9-689855f9f01d-config-volume\") pod \"dns-default-l4hfq\" (UID: \"92953616-a22e-45da-bab9-689855f9f01d\") " pod="openshift-dns/dns-default-l4hfq" May 21 15:13:40.884712 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:40.884682 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqrcc\" (UniqueName: \"kubernetes.io/projected/92953616-a22e-45da-bab9-689855f9f01d-kube-api-access-kqrcc\") pod \"dns-default-l4hfq\" (UID: \"92953616-a22e-45da-bab9-689855f9f01d\") " pod="openshift-dns/dns-default-l4hfq" May 21 15:13:41.279648 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:41.279614 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e166c77-8d3b-43e3-ae04-132de04f2d6b-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-flsp4\" (UID: \"9e166c77-8d3b-43e3-ae04-132de04f2d6b\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-flsp4" May 21 15:13:41.279837 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:41.279699 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-tls\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:13:41.279837 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:41.279727 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cddef031-be16-4fae-94e0-3e4bb6fcf669-cert\") pod \"ingress-canary-5xx2h\" (UID: \"cddef031-be16-4fae-94e0-3e4bb6fcf669\") " pod="openshift-ingress-canary/ingress-canary-5xx2h" May 21 15:13:41.279837 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:41.279776 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 15:13:41.280005 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:41.279848 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 15:13:41.280005 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:41.279854 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 15:13:41.280005 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:41.279874 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b8889454-d87bd: secret "image-registry-tls" not found May 21 15:13:41.280005 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:41.279863 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e166c77-8d3b-43e3-ae04-132de04f2d6b-networking-console-plugin-cert podName:9e166c77-8d3b-43e3-ae04-132de04f2d6b nodeName:}" failed. No retries permitted until 2026-05-21 15:13:42.279841339 +0000 UTC m=+37.131283581 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9e166c77-8d3b-43e3-ae04-132de04f2d6b-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-flsp4" (UID: "9e166c77-8d3b-43e3-ae04-132de04f2d6b") : secret "networking-console-plugin-cert" not found May 21 15:13:41.280005 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:41.279952 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cddef031-be16-4fae-94e0-3e4bb6fcf669-cert podName:cddef031-be16-4fae-94e0-3e4bb6fcf669 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:42.279935252 +0000 UTC m=+37.131377489 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cddef031-be16-4fae-94e0-3e4bb6fcf669-cert") pod "ingress-canary-5xx2h" (UID: "cddef031-be16-4fae-94e0-3e4bb6fcf669") : secret "canary-serving-cert" not found May 21 15:13:41.280005 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:41.279968 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-tls podName:d628e927-bb20-4718-9f22-5bf1466e69e4 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:42.279958923 +0000 UTC m=+37.131401160 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-tls") pod "image-registry-86b8889454-d87bd" (UID: "d628e927-bb20-4718-9f22-5bf1466e69e4") : secret "image-registry-tls" not found May 21 15:13:41.381072 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:41.381039 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92953616-a22e-45da-bab9-689855f9f01d-metrics-tls\") pod \"dns-default-l4hfq\" (UID: \"92953616-a22e-45da-bab9-689855f9f01d\") " pod="openshift-dns/dns-default-l4hfq" May 21 15:13:41.381230 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:41.381190 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 15:13:41.381295 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:41.381249 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92953616-a22e-45da-bab9-689855f9f01d-metrics-tls podName:92953616-a22e-45da-bab9-689855f9f01d nodeName:}" failed. No retries permitted until 2026-05-21 15:13:42.381232297 +0000 UTC m=+37.232674544 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/92953616-a22e-45da-bab9-689855f9f01d-metrics-tls") pod "dns-default-l4hfq" (UID: "92953616-a22e-45da-bab9-689855f9f01d") : secret "dns-default-metrics-tls" not found May 21 15:13:41.715488 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:41.715407 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q54fh" May 21 15:13:41.716010 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:41.715412 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:13:41.719666 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:41.719637 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 15:13:41.719666 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:41.719644 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 15:13:41.719797 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:41.719744 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wqls8\"" May 21 15:13:42.289523 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:42.289485 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e166c77-8d3b-43e3-ae04-132de04f2d6b-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-flsp4\" (UID: \"9e166c77-8d3b-43e3-ae04-132de04f2d6b\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-flsp4" May 21 15:13:42.289671 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:42.289602 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-tls\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:13:42.289671 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:42.289626 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 15:13:42.289769 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:42.289634 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cddef031-be16-4fae-94e0-3e4bb6fcf669-cert\") pod \"ingress-canary-5xx2h\" (UID: \"cddef031-be16-4fae-94e0-3e4bb6fcf669\") " pod="openshift-ingress-canary/ingress-canary-5xx2h" May 21 15:13:42.289769 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:42.289697 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e166c77-8d3b-43e3-ae04-132de04f2d6b-networking-console-plugin-cert podName:9e166c77-8d3b-43e3-ae04-132de04f2d6b nodeName:}" failed. No retries permitted until 2026-05-21 15:13:44.289676533 +0000 UTC m=+39.141118780 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9e166c77-8d3b-43e3-ae04-132de04f2d6b-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-flsp4" (UID: "9e166c77-8d3b-43e3-ae04-132de04f2d6b") : secret "networking-console-plugin-cert" not found May 21 15:13:42.289769 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:42.289710 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 15:13:42.289769 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:42.289728 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 15:13:42.289769 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:42.289741 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b8889454-d87bd: secret "image-registry-tls" not found May 21 15:13:42.289769 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:42.289756 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cddef031-be16-4fae-94e0-3e4bb6fcf669-cert podName:cddef031-be16-4fae-94e0-3e4bb6fcf669 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:44.289741725 +0000 UTC m=+39.141183965 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cddef031-be16-4fae-94e0-3e4bb6fcf669-cert") pod "ingress-canary-5xx2h" (UID: "cddef031-be16-4fae-94e0-3e4bb6fcf669") : secret "canary-serving-cert" not found May 21 15:13:42.289769 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:42.289772 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-tls podName:d628e927-bb20-4718-9f22-5bf1466e69e4 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:44.289763958 +0000 UTC m=+39.141206198 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-tls") pod "image-registry-86b8889454-d87bd" (UID: "d628e927-bb20-4718-9f22-5bf1466e69e4") : secret "image-registry-tls" not found May 21 15:13:42.391054 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:42.391022 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92953616-a22e-45da-bab9-689855f9f01d-metrics-tls\") pod \"dns-default-l4hfq\" (UID: \"92953616-a22e-45da-bab9-689855f9f01d\") " pod="openshift-dns/dns-default-l4hfq" May 21 15:13:42.391193 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:42.391168 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 15:13:42.391237 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:42.391232 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92953616-a22e-45da-bab9-689855f9f01d-metrics-tls podName:92953616-a22e-45da-bab9-689855f9f01d nodeName:}" failed. No retries permitted until 2026-05-21 15:13:44.391217083 +0000 UTC m=+39.242659316 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/92953616-a22e-45da-bab9-689855f9f01d-metrics-tls") pod "dns-default-l4hfq" (UID: "92953616-a22e-45da-bab9-689855f9f01d") : secret "dns-default-metrics-tls" not found May 21 15:13:44.307228 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:44.307048 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e166c77-8d3b-43e3-ae04-132de04f2d6b-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-flsp4\" (UID: \"9e166c77-8d3b-43e3-ae04-132de04f2d6b\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-flsp4" May 21 15:13:44.307693 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:44.307284 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-tls\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:13:44.307693 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:44.307192 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 15:13:44.307693 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:44.307308 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cddef031-be16-4fae-94e0-3e4bb6fcf669-cert\") pod \"ingress-canary-5xx2h\" (UID: \"cddef031-be16-4fae-94e0-3e4bb6fcf669\") " pod="openshift-ingress-canary/ingress-canary-5xx2h" May 21 15:13:44.307693 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:44.307387 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e166c77-8d3b-43e3-ae04-132de04f2d6b-networking-console-plugin-cert podName:9e166c77-8d3b-43e3-ae04-132de04f2d6b nodeName:}" failed. No retries permitted until 2026-05-21 15:13:48.307368642 +0000 UTC m=+43.158810880 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9e166c77-8d3b-43e3-ae04-132de04f2d6b-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-flsp4" (UID: "9e166c77-8d3b-43e3-ae04-132de04f2d6b") : secret "networking-console-plugin-cert" not found May 21 15:13:44.307693 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:44.307439 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 15:13:44.307693 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:44.307457 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 15:13:44.307693 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:44.307471 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b8889454-d87bd: secret "image-registry-tls" not found May 21 15:13:44.307693 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:44.307497 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cddef031-be16-4fae-94e0-3e4bb6fcf669-cert podName:cddef031-be16-4fae-94e0-3e4bb6fcf669 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:48.307480808 +0000 UTC m=+43.158923059 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cddef031-be16-4fae-94e0-3e4bb6fcf669-cert") pod "ingress-canary-5xx2h" (UID: "cddef031-be16-4fae-94e0-3e4bb6fcf669") : secret "canary-serving-cert" not found May 21 15:13:44.307693 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:44.307514 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-tls podName:d628e927-bb20-4718-9f22-5bf1466e69e4 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:48.307504525 +0000 UTC m=+43.158946760 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-tls") pod "image-registry-86b8889454-d87bd" (UID: "d628e927-bb20-4718-9f22-5bf1466e69e4") : secret "image-registry-tls" not found May 21 15:13:44.408276 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:44.408244 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92953616-a22e-45da-bab9-689855f9f01d-metrics-tls\") pod \"dns-default-l4hfq\" (UID: \"92953616-a22e-45da-bab9-689855f9f01d\") " pod="openshift-dns/dns-default-l4hfq" May 21 15:13:44.408437 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:44.408367 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 15:13:44.408437 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:44.408417 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92953616-a22e-45da-bab9-689855f9f01d-metrics-tls podName:92953616-a22e-45da-bab9-689855f9f01d nodeName:}" failed. No retries permitted until 2026-05-21 15:13:48.408404439 +0000 UTC m=+43.259846672 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/92953616-a22e-45da-bab9-689855f9f01d-metrics-tls") pod "dns-default-l4hfq" (UID: "92953616-a22e-45da-bab9-689855f9f01d") : secret "dns-default-metrics-tls" not found May 21 15:13:45.398153 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.398117 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56f97c6db-l9pwt"] May 21 15:13:45.436195 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.436156 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls"] May 21 15:13:45.436367 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.436291 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56f97c6db-l9pwt" May 21 15:13:45.440687 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.440638 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 21 15:13:45.440890 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.440871 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 21 15:13:45.440890 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.440893 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-g4lp6\"" May 21 15:13:45.441171 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.441146 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" May 21 15:13:45.441283 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.441219 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 21 15:13:45.451932 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.451910 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5785f9c76-4wcdr"] May 21 15:13:45.452066 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.452048 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" May 21 15:13:45.456423 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.456404 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" May 21 15:13:45.456520 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.456499 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" May 21 15:13:45.456700 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.456665 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" May 21 15:13:45.456887 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.456869 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" May 21 15:13:45.468048 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.468026 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56f97c6db-l9pwt"] May 21 15:13:45.468155 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.468056 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls"] May 21 15:13:45.468155 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.468071 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5785f9c76-4wcdr"] May 21 15:13:45.468258 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.468184 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5785f9c76-4wcdr" May 21 15:13:45.473981 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.473960 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 21 15:13:45.620228 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.620195 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b0bdb74-921d-4246-a557-1763f1ecab2a-tmp\") pod \"klusterlet-addon-workmgr-5785f9c76-4wcdr\" (UID: \"5b0bdb74-921d-4246-a557-1763f1ecab2a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5785f9c76-4wcdr" May 21 15:13:45.620228 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.620231 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/0df59a57-a982-4090-9fa4-3c557148ae3b-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7b7cc67597-72sls\" (UID: \"0df59a57-a982-4090-9fa4-3c557148ae3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" May 21 15:13:45.620439 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.620254 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/74881353-166e-4df3-afea-cdd4aa905518-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-56f97c6db-l9pwt\" (UID: \"74881353-166e-4df3-afea-cdd4aa905518\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56f97c6db-l9pwt" May 21 15:13:45.620439 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.620295 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0df59a57-a982-4090-9fa4-3c557148ae3b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7b7cc67597-72sls\" (UID: \"0df59a57-a982-4090-9fa4-3c557148ae3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" May 21 15:13:45.620439 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.620350 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6xzd\" (UniqueName: \"kubernetes.io/projected/0df59a57-a982-4090-9fa4-3c557148ae3b-kube-api-access-z6xzd\") pod \"cluster-proxy-proxy-agent-7b7cc67597-72sls\" (UID: \"0df59a57-a982-4090-9fa4-3c557148ae3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" May 21 15:13:45.620439 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.620380 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjtjh\" (UniqueName: \"kubernetes.io/projected/74881353-166e-4df3-afea-cdd4aa905518-kube-api-access-zjtjh\") pod \"managed-serviceaccount-addon-agent-56f97c6db-l9pwt\" (UID: \"74881353-166e-4df3-afea-cdd4aa905518\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56f97c6db-l9pwt" May 21 15:13:45.620439 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.620412 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5b0bdb74-921d-4246-a557-1763f1ecab2a-klusterlet-config\") pod \"klusterlet-addon-workmgr-5785f9c76-4wcdr\" (UID: \"5b0bdb74-921d-4246-a557-1763f1ecab2a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5785f9c76-4wcdr" May 21 15:13:45.620655 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.620456 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0df59a57-a982-4090-9fa4-3c557148ae3b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7b7cc67597-72sls\" (UID: \"0df59a57-a982-4090-9fa4-3c557148ae3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" May 21 15:13:45.620655 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.620475 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0df59a57-a982-4090-9fa4-3c557148ae3b-ca\") pod \"cluster-proxy-proxy-agent-7b7cc67597-72sls\" (UID: \"0df59a57-a982-4090-9fa4-3c557148ae3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" May 21 15:13:45.620655 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.620494 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0df59a57-a982-4090-9fa4-3c557148ae3b-hub\") pod \"cluster-proxy-proxy-agent-7b7cc67597-72sls\" (UID: \"0df59a57-a982-4090-9fa4-3c557148ae3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" May 21 15:13:45.620655 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.620520 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9d4w\" (UniqueName: \"kubernetes.io/projected/5b0bdb74-921d-4246-a557-1763f1ecab2a-kube-api-access-w9d4w\") pod \"klusterlet-addon-workmgr-5785f9c76-4wcdr\" (UID: \"5b0bdb74-921d-4246-a557-1763f1ecab2a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5785f9c76-4wcdr" May 21 15:13:45.721689 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.721657 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b0bdb74-921d-4246-a557-1763f1ecab2a-tmp\") pod \"klusterlet-addon-workmgr-5785f9c76-4wcdr\" (UID: \"5b0bdb74-921d-4246-a557-1763f1ecab2a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5785f9c76-4wcdr" May 21 15:13:45.721864 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.721695 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/0df59a57-a982-4090-9fa4-3c557148ae3b-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7b7cc67597-72sls\" (UID: \"0df59a57-a982-4090-9fa4-3c557148ae3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" May 21 15:13:45.721864 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.721728 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/74881353-166e-4df3-afea-cdd4aa905518-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-56f97c6db-l9pwt\" (UID: \"74881353-166e-4df3-afea-cdd4aa905518\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56f97c6db-l9pwt" May 21 15:13:45.721864 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.721767 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0df59a57-a982-4090-9fa4-3c557148ae3b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7b7cc67597-72sls\" (UID: \"0df59a57-a982-4090-9fa4-3c557148ae3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" May 21 15:13:45.721864 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.721806 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6xzd\" (UniqueName: \"kubernetes.io/projected/0df59a57-a982-4090-9fa4-3c557148ae3b-kube-api-access-z6xzd\") pod \"cluster-proxy-proxy-agent-7b7cc67597-72sls\" (UID: \"0df59a57-a982-4090-9fa4-3c557148ae3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" May 21 15:13:45.721864 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.721839 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zjtjh\" (UniqueName: \"kubernetes.io/projected/74881353-166e-4df3-afea-cdd4aa905518-kube-api-access-zjtjh\") pod \"managed-serviceaccount-addon-agent-56f97c6db-l9pwt\" (UID: \"74881353-166e-4df3-afea-cdd4aa905518\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56f97c6db-l9pwt" May 21 15:13:45.722114 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.721887 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5b0bdb74-921d-4246-a557-1763f1ecab2a-klusterlet-config\") pod \"klusterlet-addon-workmgr-5785f9c76-4wcdr\" (UID: \"5b0bdb74-921d-4246-a557-1763f1ecab2a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5785f9c76-4wcdr" May 21 15:13:45.722114 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.721963 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0df59a57-a982-4090-9fa4-3c557148ae3b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7b7cc67597-72sls\" (UID: \"0df59a57-a982-4090-9fa4-3c557148ae3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" May 21 15:13:45.722114 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.722095 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b0bdb74-921d-4246-a557-1763f1ecab2a-tmp\") pod \"klusterlet-addon-workmgr-5785f9c76-4wcdr\" (UID: \"5b0bdb74-921d-4246-a557-1763f1ecab2a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5785f9c76-4wcdr" May 21 15:13:45.722392 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.722365 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0df59a57-a982-4090-9fa4-3c557148ae3b-ca\") pod \"cluster-proxy-proxy-agent-7b7cc67597-72sls\" (UID: \"0df59a57-a982-4090-9fa4-3c557148ae3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" May 21 15:13:45.722518 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.722408 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0df59a57-a982-4090-9fa4-3c557148ae3b-hub\") pod \"cluster-proxy-proxy-agent-7b7cc67597-72sls\" (UID: \"0df59a57-a982-4090-9fa4-3c557148ae3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" May 21 15:13:45.722518 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.722419 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/0df59a57-a982-4090-9fa4-3c557148ae3b-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7b7cc67597-72sls\" (UID: \"0df59a57-a982-4090-9fa4-3c557148ae3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" May 21 15:13:45.722607 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.722551 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w9d4w\" (UniqueName: \"kubernetes.io/projected/5b0bdb74-921d-4246-a557-1763f1ecab2a-kube-api-access-w9d4w\") pod \"klusterlet-addon-workmgr-5785f9c76-4wcdr\" (UID: \"5b0bdb74-921d-4246-a557-1763f1ecab2a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5785f9c76-4wcdr" May 21 15:13:45.725973 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.725914 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5b0bdb74-921d-4246-a557-1763f1ecab2a-klusterlet-config\") pod \"klusterlet-addon-workmgr-5785f9c76-4wcdr\" (UID: \"5b0bdb74-921d-4246-a557-1763f1ecab2a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5785f9c76-4wcdr" May 21 15:13:45.726090 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.725970 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0df59a57-a982-4090-9fa4-3c557148ae3b-ca\") pod \"cluster-proxy-proxy-agent-7b7cc67597-72sls\" (UID: \"0df59a57-a982-4090-9fa4-3c557148ae3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" May 21 15:13:45.726090 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.725993 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0df59a57-a982-4090-9fa4-3c557148ae3b-hub\") pod \"cluster-proxy-proxy-agent-7b7cc67597-72sls\" (UID: \"0df59a57-a982-4090-9fa4-3c557148ae3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" May 21 15:13:45.726218 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.726198 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/74881353-166e-4df3-afea-cdd4aa905518-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-56f97c6db-l9pwt\" (UID: \"74881353-166e-4df3-afea-cdd4aa905518\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56f97c6db-l9pwt" May 21 15:13:45.729010 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.726412 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0df59a57-a982-4090-9fa4-3c557148ae3b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7b7cc67597-72sls\" (UID: \"0df59a57-a982-4090-9fa4-3c557148ae3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" May 21 15:13:45.729010 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.726488 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0df59a57-a982-4090-9fa4-3c557148ae3b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7b7cc67597-72sls\" (UID: \"0df59a57-a982-4090-9fa4-3c557148ae3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" May 21 15:13:45.730013 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.729990 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6xzd\" (UniqueName: \"kubernetes.io/projected/0df59a57-a982-4090-9fa4-3c557148ae3b-kube-api-access-z6xzd\") pod \"cluster-proxy-proxy-agent-7b7cc67597-72sls\" (UID: \"0df59a57-a982-4090-9fa4-3c557148ae3b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" May 21 15:13:45.731081 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.731062 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjtjh\" (UniqueName: \"kubernetes.io/projected/74881353-166e-4df3-afea-cdd4aa905518-kube-api-access-zjtjh\") pod \"managed-serviceaccount-addon-agent-56f97c6db-l9pwt\" (UID: \"74881353-166e-4df3-afea-cdd4aa905518\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56f97c6db-l9pwt" May 21 15:13:45.732856 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.732832 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9d4w\" (UniqueName: \"kubernetes.io/projected/5b0bdb74-921d-4246-a557-1763f1ecab2a-kube-api-access-w9d4w\") pod \"klusterlet-addon-workmgr-5785f9c76-4wcdr\" (UID: \"5b0bdb74-921d-4246-a557-1763f1ecab2a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5785f9c76-4wcdr" May 21 15:13:45.757457 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.757436 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56f97c6db-l9pwt" May 21 15:13:45.766085 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.766059 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" May 21 15:13:45.789739 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.789706 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5785f9c76-4wcdr" May 21 15:13:45.916366 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.916044 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls"] May 21 15:13:45.921192 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:45.921162 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0df59a57_a982_4090_9fa4_3c557148ae3b.slice/crio-66a8670e41d302d3506c38e741df8ac400462cfd4721659a9b6cc3aaeb2d7d7d WatchSource:0}: Error finding container 66a8670e41d302d3506c38e741df8ac400462cfd4721659a9b6cc3aaeb2d7d7d: Status 404 returned error can't find the container with id 66a8670e41d302d3506c38e741df8ac400462cfd4721659a9b6cc3aaeb2d7d7d May 21 15:13:45.927734 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.927689 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56f97c6db-l9pwt"] May 21 15:13:45.941942 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:45.941920 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5785f9c76-4wcdr"] May 21 15:13:45.945202 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:45.945181 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b0bdb74_921d_4246_a557_1763f1ecab2a.slice/crio-a4646eefabe8707566b9fdaeb3e4b3ad097db2d212a8e8a5d53203e01c2e7c51 WatchSource:0}: Error finding container a4646eefabe8707566b9fdaeb3e4b3ad097db2d212a8e8a5d53203e01c2e7c51: Status 404 returned error can't find the container with id a4646eefabe8707566b9fdaeb3e4b3ad097db2d212a8e8a5d53203e01c2e7c51 May 21 15:13:46.888568 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:46.888525 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56f97c6db-l9pwt" event={"ID":"74881353-166e-4df3-afea-cdd4aa905518","Type":"ContainerStarted","Data":"3b6ab3442782085562c30789fc072b455346b5a499ab6af72977e497c129abc2"} May 21 15:13:46.889738 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:46.889711 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5785f9c76-4wcdr" event={"ID":"5b0bdb74-921d-4246-a557-1763f1ecab2a","Type":"ContainerStarted","Data":"a4646eefabe8707566b9fdaeb3e4b3ad097db2d212a8e8a5d53203e01c2e7c51"} May 21 15:13:46.890821 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:46.890784 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" event={"ID":"0df59a57-a982-4090-9fa4-3c557148ae3b","Type":"ContainerStarted","Data":"66a8670e41d302d3506c38e741df8ac400462cfd4721659a9b6cc3aaeb2d7d7d"} May 21 15:13:48.244170 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:48.244131 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8da4a19d-0e83-46b4-9d33-9192394ad102-original-pull-secret\") pod \"global-pull-secret-syncer-q54fh\" (UID: \"8da4a19d-0e83-46b4-9d33-9192394ad102\") " pod="kube-system/global-pull-secret-syncer-q54fh" May 21 15:13:48.246353 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:48.246320 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8da4a19d-0e83-46b4-9d33-9192394ad102-original-pull-secret\") pod \"global-pull-secret-syncer-q54fh\" (UID: \"8da4a19d-0e83-46b4-9d33-9192394ad102\") " pod="kube-system/global-pull-secret-syncer-q54fh" May 21 15:13:48.325409 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:48.325370 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q54fh" May 21 15:13:48.345486 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:48.345450 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-tls\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:13:48.345619 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:48.345509 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cddef031-be16-4fae-94e0-3e4bb6fcf669-cert\") pod \"ingress-canary-5xx2h\" (UID: \"cddef031-be16-4fae-94e0-3e4bb6fcf669\") " pod="openshift-ingress-canary/ingress-canary-5xx2h" May 21 15:13:48.345619 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:48.345576 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 15:13:48.345619 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:48.345580 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e166c77-8d3b-43e3-ae04-132de04f2d6b-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-flsp4\" (UID: \"9e166c77-8d3b-43e3-ae04-132de04f2d6b\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-flsp4" May 21 15:13:48.345619 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:48.345594 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b8889454-d87bd: secret "image-registry-tls" not found May 21 15:13:48.345805 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:48.345644 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-tls podName:d628e927-bb20-4718-9f22-5bf1466e69e4 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:56.345629671 +0000 UTC m=+51.197071909 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-tls") pod "image-registry-86b8889454-d87bd" (UID: "d628e927-bb20-4718-9f22-5bf1466e69e4") : secret "image-registry-tls" not found May 21 15:13:48.345805 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:48.345669 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 15:13:48.345805 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:48.345717 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 15:13:48.345805 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:48.345729 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cddef031-be16-4fae-94e0-3e4bb6fcf669-cert podName:cddef031-be16-4fae-94e0-3e4bb6fcf669 nodeName:}" failed. No retries permitted until 2026-05-21 15:13:56.345712421 +0000 UTC m=+51.197154659 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cddef031-be16-4fae-94e0-3e4bb6fcf669-cert") pod "ingress-canary-5xx2h" (UID: "cddef031-be16-4fae-94e0-3e4bb6fcf669") : secret "canary-serving-cert" not found May 21 15:13:48.345805 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:48.345784 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e166c77-8d3b-43e3-ae04-132de04f2d6b-networking-console-plugin-cert podName:9e166c77-8d3b-43e3-ae04-132de04f2d6b nodeName:}" failed. No retries permitted until 2026-05-21 15:13:56.345767016 +0000 UTC m=+51.197209354 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9e166c77-8d3b-43e3-ae04-132de04f2d6b-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-flsp4" (UID: "9e166c77-8d3b-43e3-ae04-132de04f2d6b") : secret "networking-console-plugin-cert" not found May 21 15:13:48.441526 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:48.441494 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q54fh"] May 21 15:13:48.446889 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:48.446869 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92953616-a22e-45da-bab9-689855f9f01d-metrics-tls\") pod \"dns-default-l4hfq\" (UID: \"92953616-a22e-45da-bab9-689855f9f01d\") " pod="openshift-dns/dns-default-l4hfq" May 21 15:13:48.447042 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:48.447023 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 15:13:48.447110 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:48.447100 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92953616-a22e-45da-bab9-689855f9f01d-metrics-tls podName:92953616-a22e-45da-bab9-689855f9f01d nodeName:}" failed. No retries permitted until 2026-05-21 15:13:56.447079376 +0000 UTC m=+51.298521614 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/92953616-a22e-45da-bab9-689855f9f01d-metrics-tls") pod "dns-default-l4hfq" (UID: "92953616-a22e-45da-bab9-689855f9f01d") : secret "dns-default-metrics-tls" not found May 21 15:13:48.523088 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:13:48.523005 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8da4a19d_0e83_46b4_9d33_9192394ad102.slice/crio-bb3ee2c83ae3dde88d459b1a3c39d24edf15da5ad3d7b2115d14e0bd457f3443 WatchSource:0}: Error finding container bb3ee2c83ae3dde88d459b1a3c39d24edf15da5ad3d7b2115d14e0bd457f3443: Status 404 returned error can't find the container with id bb3ee2c83ae3dde88d459b1a3c39d24edf15da5ad3d7b2115d14e0bd457f3443 May 21 15:13:48.898636 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:48.898581 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-57tbw" event={"ID":"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da","Type":"ContainerStarted","Data":"998275c36735b52f2bdfc9eba55b6f3ac56c22f8b851b21a87ff69c46ba88286"} May 21 15:13:48.904862 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:48.904837 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q54fh" event={"ID":"8da4a19d-0e83-46b4-9d33-9192394ad102","Type":"ContainerStarted","Data":"bb3ee2c83ae3dde88d459b1a3c39d24edf15da5ad3d7b2115d14e0bd457f3443"} May 21 15:13:49.922672 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:49.921763 2563 generic.go:358] "Generic (PLEG): container finished" podID="1f245a8f-9cf0-4b38-a9cf-73bd4cb432da" containerID="998275c36735b52f2bdfc9eba55b6f3ac56c22f8b851b21a87ff69c46ba88286" exitCode=0 May 21 15:13:49.922672 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:49.921850 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-57tbw" event={"ID":"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da","Type":"ContainerDied","Data":"998275c36735b52f2bdfc9eba55b6f3ac56c22f8b851b21a87ff69c46ba88286"} May 21 15:13:50.929516 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:50.929471 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-57tbw" event={"ID":"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da","Type":"ContainerStarted","Data":"ad47bfc6ce3ad0c1f9f2bd32aca126e89ca0e2af452e668f0322c40dfbf8aace"} May 21 15:13:51.935207 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:51.935169 2563 generic.go:358] "Generic (PLEG): container finished" podID="1f245a8f-9cf0-4b38-a9cf-73bd4cb432da" containerID="ad47bfc6ce3ad0c1f9f2bd32aca126e89ca0e2af452e668f0322c40dfbf8aace" exitCode=0 May 21 15:13:51.935666 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:51.935246 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-57tbw" event={"ID":"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da","Type":"ContainerDied","Data":"ad47bfc6ce3ad0c1f9f2bd32aca126e89ca0e2af452e668f0322c40dfbf8aace"} May 21 15:13:56.416901 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:56.416858 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-tls\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:13:56.416901 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:56.416908 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cddef031-be16-4fae-94e0-3e4bb6fcf669-cert\") pod \"ingress-canary-5xx2h\" (UID: \"cddef031-be16-4fae-94e0-3e4bb6fcf669\") " pod="openshift-ingress-canary/ingress-canary-5xx2h" May 21 15:13:56.417457 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:56.416944 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e166c77-8d3b-43e3-ae04-132de04f2d6b-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-flsp4\" (UID: \"9e166c77-8d3b-43e3-ae04-132de04f2d6b\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-flsp4" May 21 15:13:56.417457 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:56.417051 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 15:13:56.417457 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:56.417053 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 15:13:56.417457 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:56.417077 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b8889454-d87bd: secret "image-registry-tls" not found May 21 15:13:56.417457 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:56.417079 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 15:13:56.417457 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:56.417136 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e166c77-8d3b-43e3-ae04-132de04f2d6b-networking-console-plugin-cert podName:9e166c77-8d3b-43e3-ae04-132de04f2d6b nodeName:}" failed. No retries permitted until 2026-05-21 15:14:12.417122668 +0000 UTC m=+67.268564910 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9e166c77-8d3b-43e3-ae04-132de04f2d6b-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-flsp4" (UID: "9e166c77-8d3b-43e3-ae04-132de04f2d6b") : secret "networking-console-plugin-cert" not found May 21 15:13:56.417457 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:56.417149 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-tls podName:d628e927-bb20-4718-9f22-5bf1466e69e4 nodeName:}" failed. No retries permitted until 2026-05-21 15:14:12.417143642 +0000 UTC m=+67.268585875 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-tls") pod "image-registry-86b8889454-d87bd" (UID: "d628e927-bb20-4718-9f22-5bf1466e69e4") : secret "image-registry-tls" not found May 21 15:13:56.417457 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:56.417162 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cddef031-be16-4fae-94e0-3e4bb6fcf669-cert podName:cddef031-be16-4fae-94e0-3e4bb6fcf669 nodeName:}" failed. No retries permitted until 2026-05-21 15:14:12.417154936 +0000 UTC m=+67.268597171 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cddef031-be16-4fae-94e0-3e4bb6fcf669-cert") pod "ingress-canary-5xx2h" (UID: "cddef031-be16-4fae-94e0-3e4bb6fcf669") : secret "canary-serving-cert" not found May 21 15:13:56.518839 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:56.518408 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92953616-a22e-45da-bab9-689855f9f01d-metrics-tls\") pod \"dns-default-l4hfq\" (UID: \"92953616-a22e-45da-bab9-689855f9f01d\") " pod="openshift-dns/dns-default-l4hfq" May 21 15:13:56.518839 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:56.518568 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 15:13:56.518839 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:13:56.518632 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92953616-a22e-45da-bab9-689855f9f01d-metrics-tls podName:92953616-a22e-45da-bab9-689855f9f01d nodeName:}" failed. No retries permitted until 2026-05-21 15:14:12.518612073 +0000 UTC m=+67.370054322 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/92953616-a22e-45da-bab9-689855f9f01d-metrics-tls") pod "dns-default-l4hfq" (UID: "92953616-a22e-45da-bab9-689855f9f01d") : secret "dns-default-metrics-tls" not found May 21 15:13:56.948316 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:56.948284 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-57tbw" event={"ID":"1f245a8f-9cf0-4b38-a9cf-73bd4cb432da","Type":"ContainerStarted","Data":"77729f39fddfa2f79d8ec800693b087b971c12f35c5677a23887f9f0e29eaee6"} May 21 15:13:56.949704 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:56.949668 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q54fh" event={"ID":"8da4a19d-0e83-46b4-9d33-9192394ad102","Type":"ContainerStarted","Data":"72a3d44e68b5d7012a60aae1b9c3189c8eee0b26739d864474f799e6df666bf8"} May 21 15:13:56.950887 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:56.950866 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5785f9c76-4wcdr" event={"ID":"5b0bdb74-921d-4246-a557-1763f1ecab2a","Type":"ContainerStarted","Data":"cf1b6369072d099832a27d3c3aa0bd3444676690de980ccb9d1325887619dabb"} May 21 15:13:56.951177 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:56.951113 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5785f9c76-4wcdr" May 21 15:13:56.952831 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:56.952807 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" event={"ID":"0df59a57-a982-4090-9fa4-3c557148ae3b","Type":"ContainerStarted","Data":"9777f9f3b605132ce8032a09f9be21d6665912b10ba5eee4b1de7beb5036757d"} May 21 15:13:56.953655 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:56.953632 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5785f9c76-4wcdr" May 21 15:13:56.954703 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:56.954677 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56f97c6db-l9pwt" event={"ID":"74881353-166e-4df3-afea-cdd4aa905518","Type":"ContainerStarted","Data":"b394fd355268d8b89e1235cc5268e161ab644bd909c26db5d6ef5a8820281c96"} May 21 15:13:56.970666 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:56.970616 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-57tbw" podStartSLOduration=11.720413609 podStartE2EDuration="51.970603774s" podCreationTimestamp="2026-05-21 15:13:05 +0000 UTC" firstStartedPulling="2026-05-21 15:13:08.328388729 +0000 UTC m=+3.179830964" lastFinishedPulling="2026-05-21 15:13:48.578578886 +0000 UTC m=+43.430021129" observedRunningTime="2026-05-21 15:13:56.96937911 +0000 UTC m=+51.820821366" watchObservedRunningTime="2026-05-21 15:13:56.970603774 +0000 UTC m=+51.822046031" May 21 15:13:56.982916 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:56.982784 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56f97c6db-l9pwt" podStartSLOduration=1.443526533 podStartE2EDuration="11.982769704s" podCreationTimestamp="2026-05-21 15:13:45 +0000 UTC" firstStartedPulling="2026-05-21 15:13:45.932369271 +0000 UTC m=+40.783811518" lastFinishedPulling="2026-05-21 15:13:56.471612441 +0000 UTC m=+51.323054689" observedRunningTime="2026-05-21 15:13:56.982470657 +0000 UTC m=+51.833912923" watchObservedRunningTime="2026-05-21 15:13:56.982769704 +0000 UTC m=+51.834211961" May 21 15:13:56.994533 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:56.994499 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-q54fh" podStartSLOduration=33.066238559 podStartE2EDuration="40.994487405s" podCreationTimestamp="2026-05-21 15:13:16 +0000 UTC" firstStartedPulling="2026-05-21 15:13:48.545039497 +0000 UTC m=+43.396481729" lastFinishedPulling="2026-05-21 15:13:56.473288326 +0000 UTC m=+51.324730575" observedRunningTime="2026-05-21 15:13:56.994452867 +0000 UTC m=+51.845895123" watchObservedRunningTime="2026-05-21 15:13:56.994487405 +0000 UTC m=+51.845929654" May 21 15:13:57.009465 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:57.009425 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5785f9c76-4wcdr" podStartSLOduration=1.494394546 podStartE2EDuration="12.009413949s" podCreationTimestamp="2026-05-21 15:13:45 +0000 UTC" firstStartedPulling="2026-05-21 15:13:45.946690261 +0000 UTC m=+40.798132495" lastFinishedPulling="2026-05-21 15:13:56.46170965 +0000 UTC m=+51.313151898" observedRunningTime="2026-05-21 15:13:57.008549514 +0000 UTC m=+51.859991770" watchObservedRunningTime="2026-05-21 15:13:57.009413949 +0000 UTC m=+51.860856204" May 21 15:13:58.960974 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:58.960885 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" event={"ID":"0df59a57-a982-4090-9fa4-3c557148ae3b","Type":"ContainerStarted","Data":"08ad6b8eaafee895ec6eb08a74c72c067c6e79acc36b512167950e5e5f676de6"} May 21 15:13:58.960974 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:58.960928 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" event={"ID":"0df59a57-a982-4090-9fa4-3c557148ae3b","Type":"ContainerStarted","Data":"20b761400e26a78d5fecef8a764f481fb8118f25ae68c862bb1b5ff5bfce5366"} May 21 15:13:58.978139 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:13:58.978075 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" podStartSLOduration=1.264374399 podStartE2EDuration="13.978060103s" podCreationTimestamp="2026-05-21 15:13:45 +0000 UTC" firstStartedPulling="2026-05-21 15:13:45.923484595 +0000 UTC m=+40.774926828" lastFinishedPulling="2026-05-21 15:13:58.63717029 +0000 UTC m=+53.488612532" observedRunningTime="2026-05-21 15:13:58.977137069 +0000 UTC m=+53.828579324" watchObservedRunningTime="2026-05-21 15:13:58.978060103 +0000 UTC m=+53.829502357" May 21 15:14:04.871902 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:14:04.871866 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kvwxg" May 21 15:14:11.429329 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:14:11.429283 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3f19b43-b2b6-47dc-a66e-e447f95fa680-metrics-certs\") pod \"network-metrics-daemon-rm6dz\" (UID: \"a3f19b43-b2b6-47dc-a66e-e447f95fa680\") " pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:14:11.431711 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:14:11.431693 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 15:14:11.439498 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:14:11.439482 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 15:14:11.439550 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:14:11.439532 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3f19b43-b2b6-47dc-a66e-e447f95fa680-metrics-certs podName:a3f19b43-b2b6-47dc-a66e-e447f95fa680 nodeName:}" failed. No retries permitted until 2026-05-21 15:15:15.439518451 +0000 UTC m=+130.290960685 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3f19b43-b2b6-47dc-a66e-e447f95fa680-metrics-certs") pod "network-metrics-daemon-rm6dz" (UID: "a3f19b43-b2b6-47dc-a66e-e447f95fa680") : secret "metrics-daemon-secret" not found May 21 15:14:11.631460 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:14:11.631421 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-txxgt\" (UniqueName: \"kubernetes.io/projected/6d7e4b15-f2f5-422c-b325-52c38980aa18-kube-api-access-txxgt\") pod \"network-check-target-6d2bf\" (UID: \"6d7e4b15-f2f5-422c-b325-52c38980aa18\") " pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:14:11.633884 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:14:11.633867 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 15:14:11.644593 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:14:11.644575 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 15:14:11.655945 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:14:11.655919 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txxgt\" (UniqueName: \"kubernetes.io/projected/6d7e4b15-f2f5-422c-b325-52c38980aa18-kube-api-access-txxgt\") pod \"network-check-target-6d2bf\" (UID: \"6d7e4b15-f2f5-422c-b325-52c38980aa18\") " pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:14:11.924549 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:14:11.924513 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x4qds\"" May 21 15:14:11.933147 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:14:11.933121 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:14:12.046970 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:14:12.046939 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6d2bf"] May 21 15:14:12.050313 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:14:12.050286 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d7e4b15_f2f5_422c_b325_52c38980aa18.slice/crio-5fbe1f5e6fb82ef07f5fbe4d6e12eec1e60c768b032ed076c8623c0d2b8bc2b6 WatchSource:0}: Error finding container 5fbe1f5e6fb82ef07f5fbe4d6e12eec1e60c768b032ed076c8623c0d2b8bc2b6: Status 404 returned error can't find the container with id 5fbe1f5e6fb82ef07f5fbe4d6e12eec1e60c768b032ed076c8623c0d2b8bc2b6 May 21 15:14:12.437490 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:14:12.437423 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-tls\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:14:12.437490 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:14:12.437468 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cddef031-be16-4fae-94e0-3e4bb6fcf669-cert\") pod \"ingress-canary-5xx2h\" (UID: \"cddef031-be16-4fae-94e0-3e4bb6fcf669\") " pod="openshift-ingress-canary/ingress-canary-5xx2h" May 21 15:14:12.437978 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:14:12.437513 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e166c77-8d3b-43e3-ae04-132de04f2d6b-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-flsp4\" (UID: \"9e166c77-8d3b-43e3-ae04-132de04f2d6b\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-flsp4" May 21 15:14:12.437978 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:14:12.437603 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 15:14:12.437978 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:14:12.437627 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b8889454-d87bd: secret "image-registry-tls" not found May 21 15:14:12.437978 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:14:12.437629 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 15:14:12.437978 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:14:12.437664 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 15:14:12.437978 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:14:12.437689 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-tls podName:d628e927-bb20-4718-9f22-5bf1466e69e4 nodeName:}" failed. No retries permitted until 2026-05-21 15:14:44.437667944 +0000 UTC m=+99.289110196 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-tls") pod "image-registry-86b8889454-d87bd" (UID: "d628e927-bb20-4718-9f22-5bf1466e69e4") : secret "image-registry-tls" not found May 21 15:14:12.437978 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:14:12.437713 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e166c77-8d3b-43e3-ae04-132de04f2d6b-networking-console-plugin-cert podName:9e166c77-8d3b-43e3-ae04-132de04f2d6b nodeName:}" failed. No retries permitted until 2026-05-21 15:14:44.437696802 +0000 UTC m=+99.289139040 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9e166c77-8d3b-43e3-ae04-132de04f2d6b-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-flsp4" (UID: "9e166c77-8d3b-43e3-ae04-132de04f2d6b") : secret "networking-console-plugin-cert" not found May 21 15:14:12.437978 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:14:12.437730 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cddef031-be16-4fae-94e0-3e4bb6fcf669-cert podName:cddef031-be16-4fae-94e0-3e4bb6fcf669 nodeName:}" failed. No retries permitted until 2026-05-21 15:14:44.437722287 +0000 UTC m=+99.289164520 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cddef031-be16-4fae-94e0-3e4bb6fcf669-cert") pod "ingress-canary-5xx2h" (UID: "cddef031-be16-4fae-94e0-3e4bb6fcf669") : secret "canary-serving-cert" not found May 21 15:14:12.537907 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:14:12.537875 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92953616-a22e-45da-bab9-689855f9f01d-metrics-tls\") pod \"dns-default-l4hfq\" (UID: \"92953616-a22e-45da-bab9-689855f9f01d\") " pod="openshift-dns/dns-default-l4hfq" May 21 15:14:12.538061 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:14:12.538031 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 15:14:12.538123 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:14:12.538094 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92953616-a22e-45da-bab9-689855f9f01d-metrics-tls podName:92953616-a22e-45da-bab9-689855f9f01d nodeName:}" failed. No retries permitted until 2026-05-21 15:14:44.538079558 +0000 UTC m=+99.389521796 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/92953616-a22e-45da-bab9-689855f9f01d-metrics-tls") pod "dns-default-l4hfq" (UID: "92953616-a22e-45da-bab9-689855f9f01d") : secret "dns-default-metrics-tls" not found May 21 15:14:12.996823 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:14:12.996785 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6d2bf" event={"ID":"6d7e4b15-f2f5-422c-b325-52c38980aa18","Type":"ContainerStarted","Data":"5fbe1f5e6fb82ef07f5fbe4d6e12eec1e60c768b032ed076c8623c0d2b8bc2b6"} May 21 15:14:15.002897 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:14:15.002858 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6d2bf" event={"ID":"6d7e4b15-f2f5-422c-b325-52c38980aa18","Type":"ContainerStarted","Data":"4897977fe2a9d0d002c93e96517c5a53fb4b2abc38d6dc593033fec4c02f744d"} May 21 15:14:15.003266 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:14:15.002986 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:14:15.016349 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:14:15.016303 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6d2bf" podStartSLOduration=66.446225732 podStartE2EDuration="1m9.016290097s" podCreationTimestamp="2026-05-21 15:13:06 +0000 UTC" firstStartedPulling="2026-05-21 15:14:12.052233204 +0000 UTC m=+66.903675437" lastFinishedPulling="2026-05-21 15:14:14.622297561 +0000 UTC m=+69.473739802" observedRunningTime="2026-05-21 15:14:15.016139767 +0000 UTC m=+69.867582021" watchObservedRunningTime="2026-05-21 15:14:15.016290097 +0000 UTC m=+69.867732351" May 21 15:14:44.477257 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:14:44.477215 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-tls\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:14:44.477257 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:14:44.477258 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cddef031-be16-4fae-94e0-3e4bb6fcf669-cert\") pod \"ingress-canary-5xx2h\" (UID: \"cddef031-be16-4fae-94e0-3e4bb6fcf669\") " pod="openshift-ingress-canary/ingress-canary-5xx2h" May 21 15:14:44.477801 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:14:44.477296 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e166c77-8d3b-43e3-ae04-132de04f2d6b-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-flsp4\" (UID: \"9e166c77-8d3b-43e3-ae04-132de04f2d6b\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-flsp4" May 21 15:14:44.477801 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:14:44.477410 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 15:14:44.477801 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:14:44.477438 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-86b8889454-d87bd: secret "image-registry-tls" not found May 21 15:14:44.477801 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:14:44.477439 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 15:14:44.477801 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:14:44.477439 2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 15:14:44.477801 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:14:44.477504 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-tls podName:d628e927-bb20-4718-9f22-5bf1466e69e4 nodeName:}" failed. No retries permitted until 2026-05-21 15:15:48.477483096 +0000 UTC m=+163.328925331 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-tls") pod "image-registry-86b8889454-d87bd" (UID: "d628e927-bb20-4718-9f22-5bf1466e69e4") : secret "image-registry-tls" not found May 21 15:14:44.477801 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:14:44.477524 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cddef031-be16-4fae-94e0-3e4bb6fcf669-cert podName:cddef031-be16-4fae-94e0-3e4bb6fcf669 nodeName:}" failed. No retries permitted until 2026-05-21 15:15:48.477514462 +0000 UTC m=+163.328956703 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cddef031-be16-4fae-94e0-3e4bb6fcf669-cert") pod "ingress-canary-5xx2h" (UID: "cddef031-be16-4fae-94e0-3e4bb6fcf669") : secret "canary-serving-cert" not found May 21 15:14:44.477801 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:14:44.477540 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e166c77-8d3b-43e3-ae04-132de04f2d6b-networking-console-plugin-cert podName:9e166c77-8d3b-43e3-ae04-132de04f2d6b nodeName:}" failed. No retries permitted until 2026-05-21 15:15:48.477530283 +0000 UTC m=+163.328972524 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9e166c77-8d3b-43e3-ae04-132de04f2d6b-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-flsp4" (UID: "9e166c77-8d3b-43e3-ae04-132de04f2d6b") : secret "networking-console-plugin-cert" not found May 21 15:14:44.578193 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:14:44.578160 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92953616-a22e-45da-bab9-689855f9f01d-metrics-tls\") pod \"dns-default-l4hfq\" (UID: \"92953616-a22e-45da-bab9-689855f9f01d\") " pod="openshift-dns/dns-default-l4hfq" May 21 15:14:44.578323 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:14:44.578305 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 15:14:44.578401 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:14:44.578391 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92953616-a22e-45da-bab9-689855f9f01d-metrics-tls podName:92953616-a22e-45da-bab9-689855f9f01d nodeName:}" failed. No retries permitted until 2026-05-21 15:15:48.578372989 +0000 UTC m=+163.429815225 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/92953616-a22e-45da-bab9-689855f9f01d-metrics-tls") pod "dns-default-l4hfq" (UID: "92953616-a22e-45da-bab9-689855f9f01d") : secret "dns-default-metrics-tls" not found May 21 15:14:46.007430 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:14:46.007399 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6d2bf" May 21 15:15:15.511650 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:15.511594 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3f19b43-b2b6-47dc-a66e-e447f95fa680-metrics-certs\") pod \"network-metrics-daemon-rm6dz\" (UID: \"a3f19b43-b2b6-47dc-a66e-e447f95fa680\") " pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:15:15.512131 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:15:15.511722 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 15:15:15.512131 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:15:15.511782 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3f19b43-b2b6-47dc-a66e-e447f95fa680-metrics-certs podName:a3f19b43-b2b6-47dc-a66e-e447f95fa680 nodeName:}" failed. No retries permitted until 2026-05-21 15:17:17.511764922 +0000 UTC m=+252.363207157 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3f19b43-b2b6-47dc-a66e-e447f95fa680-metrics-certs") pod "network-metrics-daemon-rm6dz" (UID: "a3f19b43-b2b6-47dc-a66e-e447f95fa680") : secret "metrics-daemon-secret" not found May 21 15:15:25.216991 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:25.216964 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qk6gn_fee7957c-3284-486f-ab40-ba1ce992878a/dns-node-resolver/0.log" May 21 15:15:26.216917 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:26.216886 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kvk52_867c5016-c412-463c-b76f-abddcdbfae50/node-ca/0.log" May 21 15:15:43.567679 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:15:43.567632 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-86b8889454-d87bd" podUID="d628e927-bb20-4718-9f22-5bf1466e69e4" May 21 15:15:43.578973 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:15:43.578952 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-flsp4" podUID="9e166c77-8d3b-43e3-ae04-132de04f2d6b" May 21 15:15:43.596131 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:15:43.596105 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-5xx2h" podUID="cddef031-be16-4fae-94e0-3e4bb6fcf669" May 21 15:15:43.693074 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:15:43.693047 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-l4hfq" podUID="92953616-a22e-45da-bab9-689855f9f01d" May 21 15:15:44.201873 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:44.201838 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5xx2h" May 21 15:15:44.202035 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:44.201838 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:15:44.729505 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:15:44.729456 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rm6dz" podUID="a3f19b43-b2b6-47dc-a66e-e447f95fa680" May 21 15:15:47.104519 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:47.104477 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-k9vq7"] May 21 15:15:47.106547 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:47.106531 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k9vq7" May 21 15:15:47.110526 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:47.110500 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 15:15:47.110661 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:47.110642 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 15:15:47.110721 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:47.110696 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 15:15:47.110888 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:47.110874 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 15:15:47.110932 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:47.110877 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fv6sn\"" May 21 15:15:47.127598 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:47.127573 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k9vq7"] May 21 15:15:47.245473 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:47.245431 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/af0d51b3-553a-4ef3-a892-d17bb34dbaf7-crio-socket\") pod \"insights-runtime-extractor-k9vq7\" (UID: \"af0d51b3-553a-4ef3-a892-d17bb34dbaf7\") " pod="openshift-insights/insights-runtime-extractor-k9vq7" May 21 15:15:47.245664 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:47.245501 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af0d51b3-553a-4ef3-a892-d17bb34dbaf7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9vq7\" (UID: \"af0d51b3-553a-4ef3-a892-d17bb34dbaf7\") " pod="openshift-insights/insights-runtime-extractor-k9vq7" May 21 15:15:47.245664 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:47.245528 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t46hs\" (UniqueName: \"kubernetes.io/projected/af0d51b3-553a-4ef3-a892-d17bb34dbaf7-kube-api-access-t46hs\") pod \"insights-runtime-extractor-k9vq7\" (UID: \"af0d51b3-553a-4ef3-a892-d17bb34dbaf7\") " pod="openshift-insights/insights-runtime-extractor-k9vq7" May 21 15:15:47.245664 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:47.245612 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/af0d51b3-553a-4ef3-a892-d17bb34dbaf7-data-volume\") pod \"insights-runtime-extractor-k9vq7\" (UID: \"af0d51b3-553a-4ef3-a892-d17bb34dbaf7\") " pod="openshift-insights/insights-runtime-extractor-k9vq7" May 21 15:15:47.245664 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:47.245649 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af0d51b3-553a-4ef3-a892-d17bb34dbaf7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9vq7\" (UID: \"af0d51b3-553a-4ef3-a892-d17bb34dbaf7\") " pod="openshift-insights/insights-runtime-extractor-k9vq7" May 21 15:15:47.346736 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:47.346688 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/af0d51b3-553a-4ef3-a892-d17bb34dbaf7-crio-socket\") pod \"insights-runtime-extractor-k9vq7\" (UID: \"af0d51b3-553a-4ef3-a892-d17bb34dbaf7\") " pod="openshift-insights/insights-runtime-extractor-k9vq7" May 21 15:15:47.346909 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:47.346756 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af0d51b3-553a-4ef3-a892-d17bb34dbaf7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9vq7\" (UID: \"af0d51b3-553a-4ef3-a892-d17bb34dbaf7\") " pod="openshift-insights/insights-runtime-extractor-k9vq7" May 21 15:15:47.346909 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:47.346783 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t46hs\" (UniqueName: \"kubernetes.io/projected/af0d51b3-553a-4ef3-a892-d17bb34dbaf7-kube-api-access-t46hs\") pod \"insights-runtime-extractor-k9vq7\" (UID: \"af0d51b3-553a-4ef3-a892-d17bb34dbaf7\") " pod="openshift-insights/insights-runtime-extractor-k9vq7" May 21 15:15:47.346909 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:47.346811 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/af0d51b3-553a-4ef3-a892-d17bb34dbaf7-crio-socket\") pod \"insights-runtime-extractor-k9vq7\" (UID: \"af0d51b3-553a-4ef3-a892-d17bb34dbaf7\") " pod="openshift-insights/insights-runtime-extractor-k9vq7" May 21 15:15:47.346909 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:47.346866 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/af0d51b3-553a-4ef3-a892-d17bb34dbaf7-data-volume\") pod \"insights-runtime-extractor-k9vq7\" (UID: \"af0d51b3-553a-4ef3-a892-d17bb34dbaf7\") " pod="openshift-insights/insights-runtime-extractor-k9vq7" May 21 15:15:47.346909 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:47.346891 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af0d51b3-553a-4ef3-a892-d17bb34dbaf7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9vq7\" (UID: \"af0d51b3-553a-4ef3-a892-d17bb34dbaf7\") " pod="openshift-insights/insights-runtime-extractor-k9vq7" May 21 15:15:47.347249 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:47.347194 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/af0d51b3-553a-4ef3-a892-d17bb34dbaf7-data-volume\") pod \"insights-runtime-extractor-k9vq7\" (UID: \"af0d51b3-553a-4ef3-a892-d17bb34dbaf7\") " pod="openshift-insights/insights-runtime-extractor-k9vq7" May 21 15:15:47.347435 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:47.347419 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/af0d51b3-553a-4ef3-a892-d17bb34dbaf7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9vq7\" (UID: \"af0d51b3-553a-4ef3-a892-d17bb34dbaf7\") " pod="openshift-insights/insights-runtime-extractor-k9vq7" May 21 15:15:47.349191 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:47.349163 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/af0d51b3-553a-4ef3-a892-d17bb34dbaf7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9vq7\" (UID: \"af0d51b3-553a-4ef3-a892-d17bb34dbaf7\") " pod="openshift-insights/insights-runtime-extractor-k9vq7" May 21 15:15:47.362955 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:47.362901 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t46hs\" (UniqueName: \"kubernetes.io/projected/af0d51b3-553a-4ef3-a892-d17bb34dbaf7-kube-api-access-t46hs\") pod \"insights-runtime-extractor-k9vq7\" (UID: \"af0d51b3-553a-4ef3-a892-d17bb34dbaf7\") " pod="openshift-insights/insights-runtime-extractor-k9vq7" May 21 15:15:47.415888 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:47.415862 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k9vq7" May 21 15:15:47.539019 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:47.538987 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k9vq7"] May 21 15:15:47.542634 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:15:47.542609 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf0d51b3_553a_4ef3_a892_d17bb34dbaf7.slice/crio-d338e75191067034a23cf7a6a0fb02da8b7197fe377ca7ea9f345f00d14fb0d9 WatchSource:0}: Error finding container d338e75191067034a23cf7a6a0fb02da8b7197fe377ca7ea9f345f00d14fb0d9: Status 404 returned error can't find the container with id d338e75191067034a23cf7a6a0fb02da8b7197fe377ca7ea9f345f00d14fb0d9 May 21 15:15:48.211382 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:48.211352 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k9vq7" event={"ID":"af0d51b3-553a-4ef3-a892-d17bb34dbaf7","Type":"ContainerStarted","Data":"b78136448f316ac48a0e7383b091052afd605291c387cfd32c98023a1c82fc44"} May 21 15:15:48.211713 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:48.211392 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k9vq7" event={"ID":"af0d51b3-553a-4ef3-a892-d17bb34dbaf7","Type":"ContainerStarted","Data":"d338e75191067034a23cf7a6a0fb02da8b7197fe377ca7ea9f345f00d14fb0d9"} May 21 15:15:48.556556 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:48.556523 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-tls\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:15:48.556778 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:48.556567 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cddef031-be16-4fae-94e0-3e4bb6fcf669-cert\") pod \"ingress-canary-5xx2h\" (UID: \"cddef031-be16-4fae-94e0-3e4bb6fcf669\") " pod="openshift-ingress-canary/ingress-canary-5xx2h" May 21 15:15:48.556778 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:48.556615 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e166c77-8d3b-43e3-ae04-132de04f2d6b-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-flsp4\" (UID: \"9e166c77-8d3b-43e3-ae04-132de04f2d6b\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-flsp4" May 21 15:15:48.559006 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:48.558974 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9e166c77-8d3b-43e3-ae04-132de04f2d6b-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-flsp4\" (UID: \"9e166c77-8d3b-43e3-ae04-132de04f2d6b\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-flsp4" May 21 15:15:48.559108 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:48.559043 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-tls\") pod \"image-registry-86b8889454-d87bd\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:15:48.559150 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:48.559114 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cddef031-be16-4fae-94e0-3e4bb6fcf669-cert\") pod \"ingress-canary-5xx2h\" (UID: \"cddef031-be16-4fae-94e0-3e4bb6fcf669\") " pod="openshift-ingress-canary/ingress-canary-5xx2h" May 21 15:15:48.657404 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:48.657367 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92953616-a22e-45da-bab9-689855f9f01d-metrics-tls\") pod \"dns-default-l4hfq\" (UID: \"92953616-a22e-45da-bab9-689855f9f01d\") " pod="openshift-dns/dns-default-l4hfq" May 21 15:15:48.659313 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:48.659296 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92953616-a22e-45da-bab9-689855f9f01d-metrics-tls\") pod \"dns-default-l4hfq\" (UID: \"92953616-a22e-45da-bab9-689855f9f01d\") " pod="openshift-dns/dns-default-l4hfq" May 21 15:15:48.704923 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:48.704901 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-d4dlc\"" May 21 15:15:48.705031 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:48.704905 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jhr97\"" May 21 15:15:48.712700 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:48.712676 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5xx2h" May 21 15:15:48.712700 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:48.712691 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:15:48.858076 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:48.858028 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86b8889454-d87bd"] May 21 15:15:48.862394 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:15:48.862362 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd628e927_bb20_4718_9f22_5bf1466e69e4.slice/crio-be0106e0ebb7f86bfafac919ede06319a2bd0c103d7d5920ec7ead139119383e WatchSource:0}: Error finding container be0106e0ebb7f86bfafac919ede06319a2bd0c103d7d5920ec7ead139119383e: Status 404 returned error can't find the container with id be0106e0ebb7f86bfafac919ede06319a2bd0c103d7d5920ec7ead139119383e May 21 15:15:48.870472 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:48.870408 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5xx2h"] May 21 15:15:48.873948 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:15:48.873922 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcddef031_be16_4fae_94e0_3e4bb6fcf669.slice/crio-c5312a36ff497c45c96ce4c071191007c3dcd79408678d0ebedc3f25d360500c WatchSource:0}: Error finding container c5312a36ff497c45c96ce4c071191007c3dcd79408678d0ebedc3f25d360500c: Status 404 returned error can't find the container with id c5312a36ff497c45c96ce4c071191007c3dcd79408678d0ebedc3f25d360500c May 21 15:15:49.215508 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:49.215423 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k9vq7" event={"ID":"af0d51b3-553a-4ef3-a892-d17bb34dbaf7","Type":"ContainerStarted","Data":"28c2f78bfab2e0bec2800826d5be4a49dfafe03a65ba4afc410c68967f11621e"} May 21 15:15:49.217146 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:49.217122 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86b8889454-d87bd" event={"ID":"d628e927-bb20-4718-9f22-5bf1466e69e4","Type":"ContainerStarted","Data":"a30a7f13d5566fc0071461ffec87a8f4cfdf6949f84c1079c1864385c0383b3f"} May 21 15:15:49.217284 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:49.217155 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86b8889454-d87bd" event={"ID":"d628e927-bb20-4718-9f22-5bf1466e69e4","Type":"ContainerStarted","Data":"be0106e0ebb7f86bfafac919ede06319a2bd0c103d7d5920ec7ead139119383e"} May 21 15:15:49.217284 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:49.217256 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:15:49.218267 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:49.218239 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5xx2h" event={"ID":"cddef031-be16-4fae-94e0-3e4bb6fcf669","Type":"ContainerStarted","Data":"c5312a36ff497c45c96ce4c071191007c3dcd79408678d0ebedc3f25d360500c"} May 21 15:15:49.236730 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:49.236685 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-86b8889454-d87bd" podStartSLOduration=163.236672335 podStartE2EDuration="2m43.236672335s" podCreationTimestamp="2026-05-21 15:13:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:15:49.236598939 +0000 UTC m=+164.088041221" watchObservedRunningTime="2026-05-21 15:15:49.236672335 +0000 UTC m=+164.088114589" May 21 15:15:50.222478 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:50.222440 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k9vq7" event={"ID":"af0d51b3-553a-4ef3-a892-d17bb34dbaf7","Type":"ContainerStarted","Data":"15df23bc6c46d75cc460cb864fbdc7b8aac10ebb908bde7d11a9bc0a89a6d946"} May 21 15:15:50.240346 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:50.240282 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-k9vq7" podStartSLOduration=1.28480529 podStartE2EDuration="3.240264345s" podCreationTimestamp="2026-05-21 15:15:47 +0000 UTC" firstStartedPulling="2026-05-21 15:15:47.596744521 +0000 UTC m=+162.448186753" lastFinishedPulling="2026-05-21 15:15:49.552203564 +0000 UTC m=+164.403645808" observedRunningTime="2026-05-21 15:15:50.239588431 +0000 UTC m=+165.091030745" watchObservedRunningTime="2026-05-21 15:15:50.240264345 +0000 UTC m=+165.091706602" May 21 15:15:51.226389 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:51.226332 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5xx2h" event={"ID":"cddef031-be16-4fae-94e0-3e4bb6fcf669","Type":"ContainerStarted","Data":"ef09104d0922fd0a3c275a666fb926f2d7969ad87f48f5d4cf9e977ddb51ff63"} May 21 15:15:51.241041 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:51.240989 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5xx2h" podStartSLOduration=129.451614383 podStartE2EDuration="2m11.240976365s" podCreationTimestamp="2026-05-21 15:13:40 +0000 UTC" firstStartedPulling="2026-05-21 15:15:48.875946856 +0000 UTC m=+163.727389092" lastFinishedPulling="2026-05-21 15:15:50.665308837 +0000 UTC m=+165.516751074" observedRunningTime="2026-05-21 15:15:51.24001172 +0000 UTC m=+166.091453976" watchObservedRunningTime="2026-05-21 15:15:51.240976365 +0000 UTC m=+166.092418675" May 21 15:15:54.712681 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:54.712646 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-flsp4" May 21 15:15:54.714755 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:54.714734 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pqm9t\"" May 21 15:15:54.723227 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:54.723207 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-flsp4" May 21 15:15:54.836507 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:54.836456 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-flsp4"] May 21 15:15:54.840379 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:15:54.840346 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e166c77_8d3b_43e3_ae04_132de04f2d6b.slice/crio-f0ee6589085c879853b391d34dfd193046045216f5e9a69c294a71a3e18c2a33 WatchSource:0}: Error finding container f0ee6589085c879853b391d34dfd193046045216f5e9a69c294a71a3e18c2a33: Status 404 returned error can't find the container with id f0ee6589085c879853b391d34dfd193046045216f5e9a69c294a71a3e18c2a33 May 21 15:15:55.238231 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:55.238152 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-flsp4" event={"ID":"9e166c77-8d3b-43e3-ae04-132de04f2d6b","Type":"ContainerStarted","Data":"f0ee6589085c879853b391d34dfd193046045216f5e9a69c294a71a3e18c2a33"} May 21 15:15:56.712825 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:56.712799 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:15:56.952493 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:56.952399 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5785f9c76-4wcdr" podUID="5b0bdb74-921d-4246-a557-1763f1ecab2a" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.12:8000/readyz\": dial tcp 10.132.0.12:8000: connect: connection refused" May 21 15:15:57.244513 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:57.244479 2563 generic.go:358] "Generic (PLEG): container finished" podID="5b0bdb74-921d-4246-a557-1763f1ecab2a" containerID="cf1b6369072d099832a27d3c3aa0bd3444676690de980ccb9d1325887619dabb" exitCode=1 May 21 15:15:57.244685 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:57.244560 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5785f9c76-4wcdr" event={"ID":"5b0bdb74-921d-4246-a557-1763f1ecab2a","Type":"ContainerDied","Data":"cf1b6369072d099832a27d3c3aa0bd3444676690de980ccb9d1325887619dabb"} May 21 15:15:57.244944 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:57.244927 2563 scope.go:117] "RemoveContainer" containerID="cf1b6369072d099832a27d3c3aa0bd3444676690de980ccb9d1325887619dabb" May 21 15:15:57.245807 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:57.245781 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-flsp4" event={"ID":"9e166c77-8d3b-43e3-ae04-132de04f2d6b","Type":"ContainerStarted","Data":"1c1ec04b2a0e3b9dcfb06462e3230e495a9f8826667ec307032151804b6fc2d9"} May 21 15:15:57.246987 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:57.246966 2563 generic.go:358] "Generic (PLEG): container finished" podID="74881353-166e-4df3-afea-cdd4aa905518" containerID="b394fd355268d8b89e1235cc5268e161ab644bd909c26db5d6ef5a8820281c96" exitCode=255 May 21 15:15:57.247093 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:57.247002 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56f97c6db-l9pwt" event={"ID":"74881353-166e-4df3-afea-cdd4aa905518","Type":"ContainerDied","Data":"b394fd355268d8b89e1235cc5268e161ab644bd909c26db5d6ef5a8820281c96"} May 21 15:15:57.247296 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:57.247279 2563 scope.go:117] "RemoveContainer" containerID="b394fd355268d8b89e1235cc5268e161ab644bd909c26db5d6ef5a8820281c96" May 21 15:15:57.273841 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:57.273636 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-flsp4" podStartSLOduration=169.810203389 podStartE2EDuration="2m51.273622463s" podCreationTimestamp="2026-05-21 15:13:06 +0000 UTC" firstStartedPulling="2026-05-21 15:15:54.842313361 +0000 UTC m=+169.693755607" lastFinishedPulling="2026-05-21 15:15:56.305732448 +0000 UTC m=+171.157174681" observedRunningTime="2026-05-21 15:15:57.272718317 +0000 UTC m=+172.124160573" watchObservedRunningTime="2026-05-21 15:15:57.273622463 +0000 UTC m=+172.125064717" May 21 15:15:58.250811 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:58.250770 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5785f9c76-4wcdr" event={"ID":"5b0bdb74-921d-4246-a557-1763f1ecab2a","Type":"ContainerStarted","Data":"4c4828e3af1f7aae341e21086d1344c11588322b509f011ec203eaaa8a580162"} May 21 15:15:58.251197 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:58.251091 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5785f9c76-4wcdr" May 21 15:15:58.251729 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:58.251704 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5785f9c76-4wcdr" May 21 15:15:58.252487 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:58.252465 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56f97c6db-l9pwt" event={"ID":"74881353-166e-4df3-afea-cdd4aa905518","Type":"ContainerStarted","Data":"3a04d9bfef0f411038fae72d93709ee36ea9c06584259cb400566603fcdffeef"} May 21 15:15:58.712611 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:58.712532 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l4hfq" May 21 15:15:58.714651 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:58.714628 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d98kf\"" May 21 15:15:58.723755 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:58.723739 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l4hfq" May 21 15:15:58.842146 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:58.842115 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l4hfq"] May 21 15:15:58.845942 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:15:58.845906 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92953616_a22e_45da_bab9_689855f9f01d.slice/crio-0208c8b8a6762a3f82a5ac2c74c4bb716f44b6ce8076b139681d7cf0b4cad857 WatchSource:0}: Error finding container 0208c8b8a6762a3f82a5ac2c74c4bb716f44b6ce8076b139681d7cf0b4cad857: Status 404 returned error can't find the container with id 0208c8b8a6762a3f82a5ac2c74c4bb716f44b6ce8076b139681d7cf0b4cad857 May 21 15:15:59.255275 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:15:59.255242 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l4hfq" event={"ID":"92953616-a22e-45da-bab9-689855f9f01d","Type":"ContainerStarted","Data":"0208c8b8a6762a3f82a5ac2c74c4bb716f44b6ce8076b139681d7cf0b4cad857"} May 21 15:16:01.262475 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:01.262439 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l4hfq" event={"ID":"92953616-a22e-45da-bab9-689855f9f01d","Type":"ContainerStarted","Data":"5ed77e8cbacb45f66de29e9870e750b156d87d0f3ebbb61151d5f492f6c47488"} May 21 15:16:01.262475 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:01.262478 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l4hfq" event={"ID":"92953616-a22e-45da-bab9-689855f9f01d","Type":"ContainerStarted","Data":"636835641adfc811d3e2027cdc0845561be89717a25446d095083af352aec404"} May 21 15:16:01.262867 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:01.262573 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-l4hfq" May 21 15:16:01.277745 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:01.277701 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-l4hfq" podStartSLOduration=139.516740798 podStartE2EDuration="2m21.277687594s" podCreationTimestamp="2026-05-21 15:13:40 +0000 UTC" firstStartedPulling="2026-05-21 15:15:58.847891013 +0000 UTC m=+173.699333260" lastFinishedPulling="2026-05-21 15:16:00.60883782 +0000 UTC m=+175.460280056" observedRunningTime="2026-05-21 15:16:01.277467689 +0000 UTC m=+176.128909944" watchObservedRunningTime="2026-05-21 15:16:01.277687594 +0000 UTC m=+176.129129848" May 21 15:16:07.237678 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.237643 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9lrrt"] May 21 15:16:07.241969 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.241950 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9lrrt" May 21 15:16:07.244448 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.244412 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 15:16:07.244568 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.244467 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 15:16:07.244568 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.244510 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 15:16:07.244568 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.244547 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 15:16:07.245249 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.245231 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 15:16:07.245249 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.245236 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8zxxj\"" May 21 15:16:07.245413 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.245256 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 15:16:07.388623 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.388594 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b55dee17-3278-4adf-9074-f41d8bec58af-node-exporter-tls\") pod \"node-exporter-9lrrt\" (UID: \"b55dee17-3278-4adf-9074-f41d8bec58af\") " pod="openshift-monitoring/node-exporter-9lrrt" May 21 15:16:07.388784 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.388641 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpn5p\" (UniqueName: \"kubernetes.io/projected/b55dee17-3278-4adf-9074-f41d8bec58af-kube-api-access-mpn5p\") pod \"node-exporter-9lrrt\" (UID: \"b55dee17-3278-4adf-9074-f41d8bec58af\") " pod="openshift-monitoring/node-exporter-9lrrt" May 21 15:16:07.388784 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.388661 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b55dee17-3278-4adf-9074-f41d8bec58af-root\") pod \"node-exporter-9lrrt\" (UID: \"b55dee17-3278-4adf-9074-f41d8bec58af\") " pod="openshift-monitoring/node-exporter-9lrrt" May 21 15:16:07.388784 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.388707 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b55dee17-3278-4adf-9074-f41d8bec58af-node-exporter-textfile\") pod \"node-exporter-9lrrt\" (UID: \"b55dee17-3278-4adf-9074-f41d8bec58af\") " pod="openshift-monitoring/node-exporter-9lrrt" May 21 15:16:07.388784 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.388727 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b55dee17-3278-4adf-9074-f41d8bec58af-node-exporter-wtmp\") pod \"node-exporter-9lrrt\" (UID: \"b55dee17-3278-4adf-9074-f41d8bec58af\") " pod="openshift-monitoring/node-exporter-9lrrt" May 21 15:16:07.388784 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.388744 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b55dee17-3278-4adf-9074-f41d8bec58af-node-exporter-accelerators-collector-config\") pod \"node-exporter-9lrrt\" (UID: \"b55dee17-3278-4adf-9074-f41d8bec58af\") " pod="openshift-monitoring/node-exporter-9lrrt" May 21 15:16:07.388981 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.388822 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b55dee17-3278-4adf-9074-f41d8bec58af-metrics-client-ca\") pod \"node-exporter-9lrrt\" (UID: \"b55dee17-3278-4adf-9074-f41d8bec58af\") " pod="openshift-monitoring/node-exporter-9lrrt" May 21 15:16:07.388981 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.388856 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b55dee17-3278-4adf-9074-f41d8bec58af-sys\") pod \"node-exporter-9lrrt\" (UID: \"b55dee17-3278-4adf-9074-f41d8bec58af\") " pod="openshift-monitoring/node-exporter-9lrrt" May 21 15:16:07.388981 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.388891 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b55dee17-3278-4adf-9074-f41d8bec58af-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9lrrt\" (UID: \"b55dee17-3278-4adf-9074-f41d8bec58af\") " pod="openshift-monitoring/node-exporter-9lrrt" May 21 15:16:07.489843 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.489769 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b55dee17-3278-4adf-9074-f41d8bec58af-sys\") pod \"node-exporter-9lrrt\" (UID: \"b55dee17-3278-4adf-9074-f41d8bec58af\") " pod="openshift-monitoring/node-exporter-9lrrt" May 21 15:16:07.489843 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.489806 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b55dee17-3278-4adf-9074-f41d8bec58af-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9lrrt\" (UID: \"b55dee17-3278-4adf-9074-f41d8bec58af\") " pod="openshift-monitoring/node-exporter-9lrrt" May 21 15:16:07.489843 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.489842 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b55dee17-3278-4adf-9074-f41d8bec58af-node-exporter-tls\") pod \"node-exporter-9lrrt\" (UID: \"b55dee17-3278-4adf-9074-f41d8bec58af\") " pod="openshift-monitoring/node-exporter-9lrrt" May 21 15:16:07.490107 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.489871 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mpn5p\" (UniqueName: \"kubernetes.io/projected/b55dee17-3278-4adf-9074-f41d8bec58af-kube-api-access-mpn5p\") pod \"node-exporter-9lrrt\" (UID: \"b55dee17-3278-4adf-9074-f41d8bec58af\") " pod="openshift-monitoring/node-exporter-9lrrt" May 21 15:16:07.490107 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.489877 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b55dee17-3278-4adf-9074-f41d8bec58af-sys\") pod \"node-exporter-9lrrt\" (UID: \"b55dee17-3278-4adf-9074-f41d8bec58af\") " pod="openshift-monitoring/node-exporter-9lrrt" May 21 15:16:07.490107 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.489886 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b55dee17-3278-4adf-9074-f41d8bec58af-root\") pod \"node-exporter-9lrrt\" (UID: \"b55dee17-3278-4adf-9074-f41d8bec58af\") " pod="openshift-monitoring/node-exporter-9lrrt" May 21 15:16:07.490107 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.489929 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b55dee17-3278-4adf-9074-f41d8bec58af-root\") pod \"node-exporter-9lrrt\" (UID: \"b55dee17-3278-4adf-9074-f41d8bec58af\") " pod="openshift-monitoring/node-exporter-9lrrt" May 21 15:16:07.490107 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.489961 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b55dee17-3278-4adf-9074-f41d8bec58af-node-exporter-textfile\") pod \"node-exporter-9lrrt\" (UID: \"b55dee17-3278-4adf-9074-f41d8bec58af\") " pod="openshift-monitoring/node-exporter-9lrrt" May 21 15:16:07.490107 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.489998 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b55dee17-3278-4adf-9074-f41d8bec58af-node-exporter-wtmp\") pod \"node-exporter-9lrrt\" (UID: \"b55dee17-3278-4adf-9074-f41d8bec58af\") " pod="openshift-monitoring/node-exporter-9lrrt" May 21 15:16:07.490107 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.490036 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b55dee17-3278-4adf-9074-f41d8bec58af-node-exporter-accelerators-collector-config\") pod \"node-exporter-9lrrt\" (UID: \"b55dee17-3278-4adf-9074-f41d8bec58af\") " pod="openshift-monitoring/node-exporter-9lrrt" May 21 15:16:07.490107 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.490078 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b55dee17-3278-4adf-9074-f41d8bec58af-metrics-client-ca\") pod \"node-exporter-9lrrt\" (UID: \"b55dee17-3278-4adf-9074-f41d8bec58af\") " pod="openshift-monitoring/node-exporter-9lrrt" May 21 15:16:07.490569 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.490214 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b55dee17-3278-4adf-9074-f41d8bec58af-node-exporter-wtmp\") pod \"node-exporter-9lrrt\" (UID: \"b55dee17-3278-4adf-9074-f41d8bec58af\") " pod="openshift-monitoring/node-exporter-9lrrt" May 21 15:16:07.490569 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.490322 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b55dee17-3278-4adf-9074-f41d8bec58af-node-exporter-textfile\") pod \"node-exporter-9lrrt\" (UID: \"b55dee17-3278-4adf-9074-f41d8bec58af\") " pod="openshift-monitoring/node-exporter-9lrrt" May 21 15:16:07.490672 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.490628 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b55dee17-3278-4adf-9074-f41d8bec58af-node-exporter-accelerators-collector-config\") pod \"node-exporter-9lrrt\" (UID: \"b55dee17-3278-4adf-9074-f41d8bec58af\") " pod="openshift-monitoring/node-exporter-9lrrt" May 21 15:16:07.490672 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.490643 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b55dee17-3278-4adf-9074-f41d8bec58af-metrics-client-ca\") pod \"node-exporter-9lrrt\" (UID: \"b55dee17-3278-4adf-9074-f41d8bec58af\") " pod="openshift-monitoring/node-exporter-9lrrt" May 21 15:16:07.492185 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.492160 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b55dee17-3278-4adf-9074-f41d8bec58af-node-exporter-tls\") pod \"node-exporter-9lrrt\" (UID: \"b55dee17-3278-4adf-9074-f41d8bec58af\") " pod="openshift-monitoring/node-exporter-9lrrt" May 21 15:16:07.492185 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.492175 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b55dee17-3278-4adf-9074-f41d8bec58af-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9lrrt\" (UID: \"b55dee17-3278-4adf-9074-f41d8bec58af\") " pod="openshift-monitoring/node-exporter-9lrrt" May 21 15:16:07.497220 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.497196 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpn5p\" (UniqueName: \"kubernetes.io/projected/b55dee17-3278-4adf-9074-f41d8bec58af-kube-api-access-mpn5p\") pod \"node-exporter-9lrrt\" (UID: \"b55dee17-3278-4adf-9074-f41d8bec58af\") " pod="openshift-monitoring/node-exporter-9lrrt" May 21 15:16:07.550491 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:07.550467 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9lrrt" May 21 15:16:07.560299 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:16:07.560276 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb55dee17_3278_4adf_9074_f41d8bec58af.slice/crio-6006935be26fa0794b533383b4c84c73936519ac1787a594137f39e702d345d2 WatchSource:0}: Error finding container 6006935be26fa0794b533383b4c84c73936519ac1787a594137f39e702d345d2: Status 404 returned error can't find the container with id 6006935be26fa0794b533383b4c84c73936519ac1787a594137f39e702d345d2 May 21 15:16:08.281113 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:08.281063 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9lrrt" event={"ID":"b55dee17-3278-4adf-9074-f41d8bec58af","Type":"ContainerStarted","Data":"6006935be26fa0794b533383b4c84c73936519ac1787a594137f39e702d345d2"} May 21 15:16:08.717455 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:08.717425 2563 patch_prober.go:28] interesting pod/image-registry-86b8889454-d87bd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 21 15:16:08.717559 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:08.717484 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-86b8889454-d87bd" podUID="d628e927-bb20-4718-9f22-5bf1466e69e4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 15:16:09.285073 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:09.285034 2563 generic.go:358] "Generic (PLEG): container finished" podID="b55dee17-3278-4adf-9074-f41d8bec58af" containerID="d155e5ff25a5fbde8af4f4eede990dab249492e3bbec03ce03e7f40a757d7231" exitCode=0 May 21 15:16:09.285462 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:09.285085 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9lrrt" event={"ID":"b55dee17-3278-4adf-9074-f41d8bec58af","Type":"ContainerDied","Data":"d155e5ff25a5fbde8af4f4eede990dab249492e3bbec03ce03e7f40a757d7231"} May 21 15:16:10.226682 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:10.226649 2563 patch_prober.go:28] interesting pod/image-registry-86b8889454-d87bd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 21 15:16:10.226833 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:10.226701 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-86b8889454-d87bd" podUID="d628e927-bb20-4718-9f22-5bf1466e69e4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 15:16:10.289659 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:10.289626 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9lrrt" event={"ID":"b55dee17-3278-4adf-9074-f41d8bec58af","Type":"ContainerStarted","Data":"f65d6995ea3346c0cfed5ec55a1f2c3adfd7ab08ad281346b512b33cc5813152"} May 21 15:16:10.289659 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:10.289659 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9lrrt" event={"ID":"b55dee17-3278-4adf-9074-f41d8bec58af","Type":"ContainerStarted","Data":"63402e7a013885b6059023a3e20f9bae394b9627344522685896618f0c6df924"} May 21 15:16:10.309442 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:10.309402 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9lrrt" podStartSLOduration=2.206156299 podStartE2EDuration="3.309391163s" podCreationTimestamp="2026-05-21 15:16:07 +0000 UTC" firstStartedPulling="2026-05-21 15:16:07.562255881 +0000 UTC m=+182.413698118" lastFinishedPulling="2026-05-21 15:16:08.665490737 +0000 UTC m=+183.516932982" observedRunningTime="2026-05-21 15:16:10.307618608 +0000 UTC m=+185.159060863" watchObservedRunningTime="2026-05-21 15:16:10.309391163 +0000 UTC m=+185.160833455" May 21 15:16:11.267790 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:11.267759 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-l4hfq" May 21 15:16:18.716854 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:18.716820 2563 patch_prober.go:28] interesting pod/image-registry-86b8889454-d87bd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 21 15:16:18.717376 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:18.716873 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-86b8889454-d87bd" podUID="d628e927-bb20-4718-9f22-5bf1466e69e4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 15:16:19.720906 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:19.720875 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-86b8889454-d87bd"] May 21 15:16:19.724815 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:19.724788 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:16:33.705948 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:33.705916 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5xx2h_cddef031-be16-4fae-94e0-3e4bb6fcf669/serve-healthcheck-canary/0.log" May 21 15:16:35.767908 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:35.767857 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" podUID="0df59a57-a982-4090-9fa4-3c557148ae3b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 15:16:44.739063 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:44.738996 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-86b8889454-d87bd" podUID="d628e927-bb20-4718-9f22-5bf1466e69e4" containerName="registry" containerID="cri-o://a30a7f13d5566fc0071461ffec87a8f4cfdf6949f84c1079c1864385c0383b3f" gracePeriod=30 May 21 15:16:44.994768 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:44.994708 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:16:45.041827 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.041797 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49gwj\" (UniqueName: \"kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-kube-api-access-49gwj\") pod \"d628e927-bb20-4718-9f22-5bf1466e69e4\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " May 21 15:16:45.041827 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.041830 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-certificates\") pod \"d628e927-bb20-4718-9f22-5bf1466e69e4\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " May 21 15:16:45.042073 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.041861 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-bound-sa-token\") pod \"d628e927-bb20-4718-9f22-5bf1466e69e4\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " May 21 15:16:45.042073 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.041892 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d628e927-bb20-4718-9f22-5bf1466e69e4-installation-pull-secrets\") pod \"d628e927-bb20-4718-9f22-5bf1466e69e4\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " May 21 15:16:45.042073 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.041922 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d628e927-bb20-4718-9f22-5bf1466e69e4-image-registry-private-configuration\") pod \"d628e927-bb20-4718-9f22-5bf1466e69e4\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " May 21 15:16:45.042073 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.041958 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d628e927-bb20-4718-9f22-5bf1466e69e4-ca-trust-extracted\") pod \"d628e927-bb20-4718-9f22-5bf1466e69e4\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " May 21 15:16:45.042073 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.041990 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d628e927-bb20-4718-9f22-5bf1466e69e4-trusted-ca\") pod \"d628e927-bb20-4718-9f22-5bf1466e69e4\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " May 21 15:16:45.042073 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.042036 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-tls\") pod \"d628e927-bb20-4718-9f22-5bf1466e69e4\" (UID: \"d628e927-bb20-4718-9f22-5bf1466e69e4\") " May 21 15:16:45.043198 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.042792 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d628e927-bb20-4718-9f22-5bf1466e69e4" (UID: "d628e927-bb20-4718-9f22-5bf1466e69e4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 15:16:45.043198 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.043153 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d628e927-bb20-4718-9f22-5bf1466e69e4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d628e927-bb20-4718-9f22-5bf1466e69e4" (UID: "d628e927-bb20-4718-9f22-5bf1466e69e4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 15:16:45.044531 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.044502 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-kube-api-access-49gwj" (OuterVolumeSpecName: "kube-api-access-49gwj") pod "d628e927-bb20-4718-9f22-5bf1466e69e4" (UID: "d628e927-bb20-4718-9f22-5bf1466e69e4"). InnerVolumeSpecName "kube-api-access-49gwj". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:16:45.045127 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.045102 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d628e927-bb20-4718-9f22-5bf1466e69e4" (UID: "d628e927-bb20-4718-9f22-5bf1466e69e4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:16:45.045268 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.045231 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d628e927-bb20-4718-9f22-5bf1466e69e4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d628e927-bb20-4718-9f22-5bf1466e69e4" (UID: "d628e927-bb20-4718-9f22-5bf1466e69e4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 15:16:45.046726 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.046685 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d628e927-bb20-4718-9f22-5bf1466e69e4" (UID: "d628e927-bb20-4718-9f22-5bf1466e69e4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:16:45.047427 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.047397 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d628e927-bb20-4718-9f22-5bf1466e69e4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d628e927-bb20-4718-9f22-5bf1466e69e4" (UID: "d628e927-bb20-4718-9f22-5bf1466e69e4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 15:16:45.052494 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.052471 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d628e927-bb20-4718-9f22-5bf1466e69e4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d628e927-bb20-4718-9f22-5bf1466e69e4" (UID: "d628e927-bb20-4718-9f22-5bf1466e69e4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 15:16:45.142712 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.142678 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d628e927-bb20-4718-9f22-5bf1466e69e4-trusted-ca\") on node \"ip-10-0-142-73.ec2.internal\" DevicePath \"\"" May 21 15:16:45.142853 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.142720 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-tls\") on node \"ip-10-0-142-73.ec2.internal\" DevicePath \"\"" May 21 15:16:45.142853 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.142736 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49gwj\" (UniqueName: \"kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-kube-api-access-49gwj\") on node \"ip-10-0-142-73.ec2.internal\" DevicePath \"\"" May 21 15:16:45.142853 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.142753 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d628e927-bb20-4718-9f22-5bf1466e69e4-registry-certificates\") on node \"ip-10-0-142-73.ec2.internal\" DevicePath \"\"" May 21 15:16:45.142853 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.142768 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d628e927-bb20-4718-9f22-5bf1466e69e4-bound-sa-token\") on node \"ip-10-0-142-73.ec2.internal\" DevicePath \"\"" May 21 15:16:45.142853 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.142782 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d628e927-bb20-4718-9f22-5bf1466e69e4-installation-pull-secrets\") on node \"ip-10-0-142-73.ec2.internal\" DevicePath \"\"" May 21 15:16:45.142853 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.142796 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d628e927-bb20-4718-9f22-5bf1466e69e4-image-registry-private-configuration\") on node \"ip-10-0-142-73.ec2.internal\" DevicePath \"\"" May 21 15:16:45.142853 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.142812 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d628e927-bb20-4718-9f22-5bf1466e69e4-ca-trust-extracted\") on node \"ip-10-0-142-73.ec2.internal\" DevicePath \"\"" May 21 15:16:45.379532 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.379447 2563 generic.go:358] "Generic (PLEG): container finished" podID="d628e927-bb20-4718-9f22-5bf1466e69e4" containerID="a30a7f13d5566fc0071461ffec87a8f4cfdf6949f84c1079c1864385c0383b3f" exitCode=0 May 21 15:16:45.379532 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.379515 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86b8889454-d87bd" May 21 15:16:45.379746 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.379528 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86b8889454-d87bd" event={"ID":"d628e927-bb20-4718-9f22-5bf1466e69e4","Type":"ContainerDied","Data":"a30a7f13d5566fc0071461ffec87a8f4cfdf6949f84c1079c1864385c0383b3f"} May 21 15:16:45.379746 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.379575 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86b8889454-d87bd" event={"ID":"d628e927-bb20-4718-9f22-5bf1466e69e4","Type":"ContainerDied","Data":"be0106e0ebb7f86bfafac919ede06319a2bd0c103d7d5920ec7ead139119383e"} May 21 15:16:45.379746 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.379594 2563 scope.go:117] "RemoveContainer" containerID="a30a7f13d5566fc0071461ffec87a8f4cfdf6949f84c1079c1864385c0383b3f" May 21 15:16:45.388847 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.388830 2563 scope.go:117] "RemoveContainer" containerID="a30a7f13d5566fc0071461ffec87a8f4cfdf6949f84c1079c1864385c0383b3f" May 21 15:16:45.389082 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:16:45.389063 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a30a7f13d5566fc0071461ffec87a8f4cfdf6949f84c1079c1864385c0383b3f\": container with ID starting with a30a7f13d5566fc0071461ffec87a8f4cfdf6949f84c1079c1864385c0383b3f not found: ID does not exist" containerID="a30a7f13d5566fc0071461ffec87a8f4cfdf6949f84c1079c1864385c0383b3f" May 21 15:16:45.389152 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.389089 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a30a7f13d5566fc0071461ffec87a8f4cfdf6949f84c1079c1864385c0383b3f"} err="failed to get container status \"a30a7f13d5566fc0071461ffec87a8f4cfdf6949f84c1079c1864385c0383b3f\": rpc error: code = NotFound desc = could not find container \"a30a7f13d5566fc0071461ffec87a8f4cfdf6949f84c1079c1864385c0383b3f\": container with ID starting with a30a7f13d5566fc0071461ffec87a8f4cfdf6949f84c1079c1864385c0383b3f not found: ID does not exist" May 21 15:16:45.399961 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.399937 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-86b8889454-d87bd"] May 21 15:16:45.403209 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.403189 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-86b8889454-d87bd"] May 21 15:16:45.715959 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.715878 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d628e927-bb20-4718-9f22-5bf1466e69e4" path="/var/lib/kubelet/pods/d628e927-bb20-4718-9f22-5bf1466e69e4/volumes" May 21 15:16:45.767437 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:45.767401 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" podUID="0df59a57-a982-4090-9fa4-3c557148ae3b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 15:16:55.767576 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:55.767536 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" podUID="0df59a57-a982-4090-9fa4-3c557148ae3b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 15:16:55.768182 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:55.767614 2563 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" May 21 15:16:55.768280 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:55.768256 2563 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"08ad6b8eaafee895ec6eb08a74c72c067c6e79acc36b512167950e5e5f676de6"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" containerMessage="Container service-proxy failed liveness probe, will be restarted" May 21 15:16:55.768359 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:55.768309 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" podUID="0df59a57-a982-4090-9fa4-3c557148ae3b" containerName="service-proxy" containerID="cri-o://08ad6b8eaafee895ec6eb08a74c72c067c6e79acc36b512167950e5e5f676de6" gracePeriod=30 May 21 15:16:56.407624 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:56.407591 2563 generic.go:358] "Generic (PLEG): container finished" podID="0df59a57-a982-4090-9fa4-3c557148ae3b" containerID="08ad6b8eaafee895ec6eb08a74c72c067c6e79acc36b512167950e5e5f676de6" exitCode=2 May 21 15:16:56.407783 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:56.407644 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" event={"ID":"0df59a57-a982-4090-9fa4-3c557148ae3b","Type":"ContainerDied","Data":"08ad6b8eaafee895ec6eb08a74c72c067c6e79acc36b512167950e5e5f676de6"} May 21 15:16:56.407783 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:16:56.407672 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b7cc67597-72sls" event={"ID":"0df59a57-a982-4090-9fa4-3c557148ae3b","Type":"ContainerStarted","Data":"0d876ca9c460007c3189bfe365e5e6c1a5a53bb8a2c889a3759215d8bd394502"} May 21 15:17:17.579632 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:17:17.579584 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3f19b43-b2b6-47dc-a66e-e447f95fa680-metrics-certs\") pod \"network-metrics-daemon-rm6dz\" (UID: \"a3f19b43-b2b6-47dc-a66e-e447f95fa680\") " pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:17:17.581878 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:17:17.581856 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3f19b43-b2b6-47dc-a66e-e447f95fa680-metrics-certs\") pod \"network-metrics-daemon-rm6dz\" (UID: \"a3f19b43-b2b6-47dc-a66e-e447f95fa680\") " pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:17:17.715238 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:17:17.715202 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wqls8\"" May 21 15:17:17.723767 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:17:17.723739 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm6dz" May 21 15:17:17.848584 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:17:17.848516 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rm6dz"] May 21 15:17:17.851423 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:17:17.851386 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3f19b43_b2b6_47dc_a66e_e447f95fa680.slice/crio-1ad94203a9905dede1cff0d92e733f95843034e4fe34e6f01e74e7245885f426 WatchSource:0}: Error finding container 1ad94203a9905dede1cff0d92e733f95843034e4fe34e6f01e74e7245885f426: Status 404 returned error can't find the container with id 1ad94203a9905dede1cff0d92e733f95843034e4fe34e6f01e74e7245885f426 May 21 15:17:18.461587 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:17:18.461547 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rm6dz" event={"ID":"a3f19b43-b2b6-47dc-a66e-e447f95fa680","Type":"ContainerStarted","Data":"1ad94203a9905dede1cff0d92e733f95843034e4fe34e6f01e74e7245885f426"} May 21 15:17:19.465816 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:17:19.465780 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rm6dz" event={"ID":"a3f19b43-b2b6-47dc-a66e-e447f95fa680","Type":"ContainerStarted","Data":"955924e1d7529767fbe39ecb3f2cb5d7b6910d64e939f3620e14bc084db2859d"} May 21 15:17:19.465816 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:17:19.465818 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rm6dz" event={"ID":"a3f19b43-b2b6-47dc-a66e-e447f95fa680","Type":"ContainerStarted","Data":"235ed4a72580e0f775d0b6f24459378faebea8f787a4d113779fceaabbd1b765"} May 21 15:17:19.481749 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:17:19.481704 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rm6dz" podStartSLOduration=253.447112724 podStartE2EDuration="4m14.48169109s" podCreationTimestamp="2026-05-21 15:13:05 +0000 UTC" firstStartedPulling="2026-05-21 15:17:17.853190986 +0000 UTC m=+252.704633219" lastFinishedPulling="2026-05-21 15:17:18.887769349 +0000 UTC m=+253.739211585" observedRunningTime="2026-05-21 15:17:19.480003272 +0000 UTC m=+254.331445524" watchObservedRunningTime="2026-05-21 15:17:19.48169109 +0000 UTC m=+254.333133344" May 21 15:18:05.608407 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:18:05.608381 2563 kubelet.go:1628] "Image garbage collection succeeded" May 21 15:20:37.316092 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:20:37.316013 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-45z88"] May 21 15:20:37.316569 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:20:37.316228 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d628e927-bb20-4718-9f22-5bf1466e69e4" containerName="registry" May 21 15:20:37.316569 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:20:37.316240 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d628e927-bb20-4718-9f22-5bf1466e69e4" containerName="registry" May 21 15:20:37.316569 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:20:37.316288 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="d628e927-bb20-4718-9f22-5bf1466e69e4" containerName="registry" May 21 15:20:37.318939 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:20:37.318924 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-45z88" May 21 15:20:37.321228 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:20:37.321201 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-8ndvf\"" May 21 15:20:37.321367 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:20:37.321230 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 21 15:20:37.321835 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:20:37.321820 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 21 15:20:37.328508 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:20:37.328488 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-45z88"] May 21 15:20:37.437967 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:20:37.437939 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a1afcba3-9808-473f-8e99-f8f6776cc13e-bound-sa-token\") pod \"cert-manager-79c8d999ff-45z88\" (UID: \"a1afcba3-9808-473f-8e99-f8f6776cc13e\") " pod="cert-manager/cert-manager-79c8d999ff-45z88" May 21 15:20:37.437967 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:20:37.437971 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q25hp\" (UniqueName: \"kubernetes.io/projected/a1afcba3-9808-473f-8e99-f8f6776cc13e-kube-api-access-q25hp\") pod \"cert-manager-79c8d999ff-45z88\" (UID: \"a1afcba3-9808-473f-8e99-f8f6776cc13e\") " pod="cert-manager/cert-manager-79c8d999ff-45z88" May 21 15:20:37.538890 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:20:37.538861 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a1afcba3-9808-473f-8e99-f8f6776cc13e-bound-sa-token\") pod \"cert-manager-79c8d999ff-45z88\" (UID: \"a1afcba3-9808-473f-8e99-f8f6776cc13e\") " pod="cert-manager/cert-manager-79c8d999ff-45z88" May 21 15:20:37.539012 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:20:37.538892 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q25hp\" (UniqueName: \"kubernetes.io/projected/a1afcba3-9808-473f-8e99-f8f6776cc13e-kube-api-access-q25hp\") pod \"cert-manager-79c8d999ff-45z88\" (UID: \"a1afcba3-9808-473f-8e99-f8f6776cc13e\") " pod="cert-manager/cert-manager-79c8d999ff-45z88" May 21 15:20:37.549195 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:20:37.549171 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a1afcba3-9808-473f-8e99-f8f6776cc13e-bound-sa-token\") pod \"cert-manager-79c8d999ff-45z88\" (UID: \"a1afcba3-9808-473f-8e99-f8f6776cc13e\") " pod="cert-manager/cert-manager-79c8d999ff-45z88" May 21 15:20:37.549313 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:20:37.549242 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q25hp\" (UniqueName: \"kubernetes.io/projected/a1afcba3-9808-473f-8e99-f8f6776cc13e-kube-api-access-q25hp\") pod \"cert-manager-79c8d999ff-45z88\" (UID: \"a1afcba3-9808-473f-8e99-f8f6776cc13e\") " pod="cert-manager/cert-manager-79c8d999ff-45z88" May 21 15:20:37.627871 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:20:37.627817 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-45z88" May 21 15:20:37.752222 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:20:37.752196 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-45z88"] May 21 15:20:37.754590 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:20:37.754566 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1afcba3_9808_473f_8e99_f8f6776cc13e.slice/crio-6cdbdee20e573717b25d4fa0bdb3a81c4b3142c4b046dc60f53af877420344f5 WatchSource:0}: Error finding container 6cdbdee20e573717b25d4fa0bdb3a81c4b3142c4b046dc60f53af877420344f5: Status 404 returned error can't find the container with id 6cdbdee20e573717b25d4fa0bdb3a81c4b3142c4b046dc60f53af877420344f5 May 21 15:20:37.756387 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:20:37.756372 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 15:20:37.957480 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:20:37.957403 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-45z88" event={"ID":"a1afcba3-9808-473f-8e99-f8f6776cc13e","Type":"ContainerStarted","Data":"6cdbdee20e573717b25d4fa0bdb3a81c4b3142c4b046dc60f53af877420344f5"} May 21 15:20:40.966595 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:20:40.966559 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-45z88" event={"ID":"a1afcba3-9808-473f-8e99-f8f6776cc13e","Type":"ContainerStarted","Data":"ee02acd7a8c7f89d745b651a24928168d53a2bd42a316aee100220675a1da18f"} May 21 15:20:40.983767 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:20:40.983710 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-45z88" podStartSLOduration=1.641701473 podStartE2EDuration="3.983693588s" podCreationTimestamp="2026-05-21 15:20:37 +0000 UTC" firstStartedPulling="2026-05-21 15:20:37.756505562 +0000 UTC m=+452.607947809" lastFinishedPulling="2026-05-21 15:20:40.098497683 +0000 UTC m=+454.949939924" observedRunningTime="2026-05-21 15:20:40.983328481 +0000 UTC m=+455.834770737" watchObservedRunningTime="2026-05-21 15:20:40.983693588 +0000 UTC m=+455.835135845" May 21 15:21:07.876606 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:07.876565 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-594496b99d-8r75t"] May 21 15:21:07.878812 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:07.878792 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-8r75t" May 21 15:21:07.882622 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:07.882605 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 15:21:07.882778 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:07.882761 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 15:21:07.883398 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:07.883377 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 15:21:07.883667 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:07.883648 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 15:21:07.883765 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:07.883705 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7qw64\"" May 21 15:21:07.902117 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:07.902092 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-594496b99d-8r75t"] May 21 15:21:07.950585 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:07.950551 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8gxv\" (UniqueName: \"kubernetes.io/projected/db7da750-b43b-498e-8bbb-3f105aed9011-kube-api-access-b8gxv\") pod \"opendatahub-operator-controller-manager-594496b99d-8r75t\" (UID: \"db7da750-b43b-498e-8bbb-3f105aed9011\") " pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-8r75t" May 21 15:21:07.950707 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:07.950595 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db7da750-b43b-498e-8bbb-3f105aed9011-webhook-cert\") pod \"opendatahub-operator-controller-manager-594496b99d-8r75t\" (UID: \"db7da750-b43b-498e-8bbb-3f105aed9011\") " pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-8r75t" May 21 15:21:07.950707 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:07.950640 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/db7da750-b43b-498e-8bbb-3f105aed9011-apiservice-cert\") pod \"opendatahub-operator-controller-manager-594496b99d-8r75t\" (UID: \"db7da750-b43b-498e-8bbb-3f105aed9011\") " pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-8r75t" May 21 15:21:08.051944 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:08.051902 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b8gxv\" (UniqueName: \"kubernetes.io/projected/db7da750-b43b-498e-8bbb-3f105aed9011-kube-api-access-b8gxv\") pod \"opendatahub-operator-controller-manager-594496b99d-8r75t\" (UID: \"db7da750-b43b-498e-8bbb-3f105aed9011\") " pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-8r75t" May 21 15:21:08.051944 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:08.051949 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db7da750-b43b-498e-8bbb-3f105aed9011-webhook-cert\") pod \"opendatahub-operator-controller-manager-594496b99d-8r75t\" (UID: \"db7da750-b43b-498e-8bbb-3f105aed9011\") " pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-8r75t" May 21 15:21:08.052150 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:08.051977 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/db7da750-b43b-498e-8bbb-3f105aed9011-apiservice-cert\") pod \"opendatahub-operator-controller-manager-594496b99d-8r75t\" (UID: \"db7da750-b43b-498e-8bbb-3f105aed9011\") " pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-8r75t" May 21 15:21:08.054464 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:08.054435 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/db7da750-b43b-498e-8bbb-3f105aed9011-apiservice-cert\") pod \"opendatahub-operator-controller-manager-594496b99d-8r75t\" (UID: \"db7da750-b43b-498e-8bbb-3f105aed9011\") " pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-8r75t" May 21 15:21:08.054464 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:08.054461 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db7da750-b43b-498e-8bbb-3f105aed9011-webhook-cert\") pod \"opendatahub-operator-controller-manager-594496b99d-8r75t\" (UID: \"db7da750-b43b-498e-8bbb-3f105aed9011\") " pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-8r75t" May 21 15:21:08.061597 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:08.061574 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8gxv\" (UniqueName: \"kubernetes.io/projected/db7da750-b43b-498e-8bbb-3f105aed9011-kube-api-access-b8gxv\") pod \"opendatahub-operator-controller-manager-594496b99d-8r75t\" (UID: \"db7da750-b43b-498e-8bbb-3f105aed9011\") " pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-8r75t" May 21 15:21:08.191528 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:08.191443 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-8r75t" May 21 15:21:08.324356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:08.324310 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-594496b99d-8r75t"] May 21 15:21:08.329092 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:21:08.329068 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb7da750_b43b_498e_8bbb_3f105aed9011.slice/crio-688788682aea7501d8b3bd7a6c96d6ddc017a8856b632e83728ce1b07e10a21b WatchSource:0}: Error finding container 688788682aea7501d8b3bd7a6c96d6ddc017a8856b632e83728ce1b07e10a21b: Status 404 returned error can't find the container with id 688788682aea7501d8b3bd7a6c96d6ddc017a8856b632e83728ce1b07e10a21b May 21 15:21:09.041356 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:09.041305 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-8r75t" event={"ID":"db7da750-b43b-498e-8bbb-3f105aed9011","Type":"ContainerStarted","Data":"688788682aea7501d8b3bd7a6c96d6ddc017a8856b632e83728ce1b07e10a21b"} May 21 15:21:11.049191 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:11.049162 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-8r75t" event={"ID":"db7da750-b43b-498e-8bbb-3f105aed9011","Type":"ContainerStarted","Data":"5223c6cd155883c64a2f0da76c50329bb106f6ae62dda40a05c1de565d1a68e2"} May 21 15:21:11.049556 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:11.049271 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-8r75t" May 21 15:21:11.108865 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:11.108799 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-8r75t" podStartSLOduration=1.480380239 podStartE2EDuration="4.108778966s" podCreationTimestamp="2026-05-21 15:21:07 +0000 UTC" firstStartedPulling="2026-05-21 15:21:08.33073267 +0000 UTC m=+483.182174902" lastFinishedPulling="2026-05-21 15:21:10.959131393 +0000 UTC m=+485.810573629" observedRunningTime="2026-05-21 15:21:11.106578279 +0000 UTC m=+485.958020535" watchObservedRunningTime="2026-05-21 15:21:11.108778966 +0000 UTC m=+485.960221222" May 21 15:21:22.053609 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:22.053575 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-594496b99d-8r75t" May 21 15:21:29.130217 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:29.130178 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-tdd2v"] May 21 15:21:29.132732 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:29.132710 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-tdd2v" May 21 15:21:29.134940 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:29.134911 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" May 21 15:21:29.135060 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:29.135003 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-pkj89\"" May 21 15:21:29.140304 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:29.140280 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-tdd2v"] May 21 15:21:29.306446 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:29.306412 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9zbx\" (UniqueName: \"kubernetes.io/projected/5f482fb0-9b22-4d74-817a-72ad541fdc1c-kube-api-access-b9zbx\") pod \"odh-model-controller-858dbf95b8-tdd2v\" (UID: \"5f482fb0-9b22-4d74-817a-72ad541fdc1c\") " pod="opendatahub/odh-model-controller-858dbf95b8-tdd2v" May 21 15:21:29.306613 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:29.306462 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f482fb0-9b22-4d74-817a-72ad541fdc1c-cert\") pod \"odh-model-controller-858dbf95b8-tdd2v\" (UID: \"5f482fb0-9b22-4d74-817a-72ad541fdc1c\") " pod="opendatahub/odh-model-controller-858dbf95b8-tdd2v" May 21 15:21:29.407355 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:29.407261 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f482fb0-9b22-4d74-817a-72ad541fdc1c-cert\") pod \"odh-model-controller-858dbf95b8-tdd2v\" (UID: \"5f482fb0-9b22-4d74-817a-72ad541fdc1c\") " pod="opendatahub/odh-model-controller-858dbf95b8-tdd2v" May 21 15:21:29.407479 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:29.407358 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b9zbx\" (UniqueName: \"kubernetes.io/projected/5f482fb0-9b22-4d74-817a-72ad541fdc1c-kube-api-access-b9zbx\") pod \"odh-model-controller-858dbf95b8-tdd2v\" (UID: \"5f482fb0-9b22-4d74-817a-72ad541fdc1c\") " pod="opendatahub/odh-model-controller-858dbf95b8-tdd2v" May 21 15:21:29.407479 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:21:29.407437 2563 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 21 15:21:29.407557 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:21:29.407504 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f482fb0-9b22-4d74-817a-72ad541fdc1c-cert podName:5f482fb0-9b22-4d74-817a-72ad541fdc1c nodeName:}" failed. No retries permitted until 2026-05-21 15:21:29.90748484 +0000 UTC m=+504.758927078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5f482fb0-9b22-4d74-817a-72ad541fdc1c-cert") pod "odh-model-controller-858dbf95b8-tdd2v" (UID: "5f482fb0-9b22-4d74-817a-72ad541fdc1c") : secret "odh-model-controller-webhook-cert" not found May 21 15:21:29.416207 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:29.416179 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9zbx\" (UniqueName: \"kubernetes.io/projected/5f482fb0-9b22-4d74-817a-72ad541fdc1c-kube-api-access-b9zbx\") pod \"odh-model-controller-858dbf95b8-tdd2v\" (UID: \"5f482fb0-9b22-4d74-817a-72ad541fdc1c\") " pod="opendatahub/odh-model-controller-858dbf95b8-tdd2v" May 21 15:21:29.912190 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:29.912149 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f482fb0-9b22-4d74-817a-72ad541fdc1c-cert\") pod \"odh-model-controller-858dbf95b8-tdd2v\" (UID: \"5f482fb0-9b22-4d74-817a-72ad541fdc1c\") " pod="opendatahub/odh-model-controller-858dbf95b8-tdd2v" May 21 15:21:29.912409 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:21:29.912278 2563 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 21 15:21:29.912409 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:21:29.912332 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f482fb0-9b22-4d74-817a-72ad541fdc1c-cert podName:5f482fb0-9b22-4d74-817a-72ad541fdc1c nodeName:}" failed. No retries permitted until 2026-05-21 15:21:30.912316575 +0000 UTC m=+505.763758808 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5f482fb0-9b22-4d74-817a-72ad541fdc1c-cert") pod "odh-model-controller-858dbf95b8-tdd2v" (UID: "5f482fb0-9b22-4d74-817a-72ad541fdc1c") : secret "odh-model-controller-webhook-cert" not found May 21 15:21:30.919959 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:30.919913 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f482fb0-9b22-4d74-817a-72ad541fdc1c-cert\") pod \"odh-model-controller-858dbf95b8-tdd2v\" (UID: \"5f482fb0-9b22-4d74-817a-72ad541fdc1c\") " pod="opendatahub/odh-model-controller-858dbf95b8-tdd2v" May 21 15:21:30.922304 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:30.922281 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f482fb0-9b22-4d74-817a-72ad541fdc1c-cert\") pod \"odh-model-controller-858dbf95b8-tdd2v\" (UID: \"5f482fb0-9b22-4d74-817a-72ad541fdc1c\") " pod="opendatahub/odh-model-controller-858dbf95b8-tdd2v" May 21 15:21:30.942447 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:30.942424 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-tdd2v" May 21 15:21:31.061989 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:31.061953 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-tdd2v"] May 21 15:21:31.065874 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:21:31.065847 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f482fb0_9b22_4d74_817a_72ad541fdc1c.slice/crio-1007f56692ab99a5532b565e82317c7f8e27cd29cf86b7812960ea01fb215960 WatchSource:0}: Error finding container 1007f56692ab99a5532b565e82317c7f8e27cd29cf86b7812960ea01fb215960: Status 404 returned error can't find the container with id 1007f56692ab99a5532b565e82317c7f8e27cd29cf86b7812960ea01fb215960 May 21 15:21:31.102280 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:31.102251 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-tdd2v" event={"ID":"5f482fb0-9b22-4d74-817a-72ad541fdc1c","Type":"ContainerStarted","Data":"1007f56692ab99a5532b565e82317c7f8e27cd29cf86b7812960ea01fb215960"} May 21 15:21:34.121176 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:34.121147 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-bs7vb"] May 21 15:21:34.125348 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:34.125307 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-bs7vb" May 21 15:21:34.127549 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:34.127498 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-vxj4g\"" May 21 15:21:34.128057 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:34.128013 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" May 21 15:21:34.137457 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:34.137431 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-bs7vb"] May 21 15:21:34.245180 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:34.245152 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47a4a252-0e8a-4d0a-90a5-907ca863a16b-cert\") pod \"kserve-controller-manager-856948b99f-bs7vb\" (UID: \"47a4a252-0e8a-4d0a-90a5-907ca863a16b\") " pod="opendatahub/kserve-controller-manager-856948b99f-bs7vb" May 21 15:21:34.245371 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:34.245190 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6hhm\" (UniqueName: \"kubernetes.io/projected/47a4a252-0e8a-4d0a-90a5-907ca863a16b-kube-api-access-t6hhm\") pod \"kserve-controller-manager-856948b99f-bs7vb\" (UID: \"47a4a252-0e8a-4d0a-90a5-907ca863a16b\") " pod="opendatahub/kserve-controller-manager-856948b99f-bs7vb" May 21 15:21:34.346042 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:34.345985 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47a4a252-0e8a-4d0a-90a5-907ca863a16b-cert\") pod \"kserve-controller-manager-856948b99f-bs7vb\" (UID: \"47a4a252-0e8a-4d0a-90a5-907ca863a16b\") " pod="opendatahub/kserve-controller-manager-856948b99f-bs7vb" May 21 15:21:34.346042 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:34.346021 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t6hhm\" (UniqueName: \"kubernetes.io/projected/47a4a252-0e8a-4d0a-90a5-907ca863a16b-kube-api-access-t6hhm\") pod \"kserve-controller-manager-856948b99f-bs7vb\" (UID: \"47a4a252-0e8a-4d0a-90a5-907ca863a16b\") " pod="opendatahub/kserve-controller-manager-856948b99f-bs7vb" May 21 15:21:34.346176 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:21:34.346135 2563 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found May 21 15:21:34.346213 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:21:34.346198 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47a4a252-0e8a-4d0a-90a5-907ca863a16b-cert podName:47a4a252-0e8a-4d0a-90a5-907ca863a16b nodeName:}" failed. No retries permitted until 2026-05-21 15:21:34.846182872 +0000 UTC m=+509.697625109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/47a4a252-0e8a-4d0a-90a5-907ca863a16b-cert") pod "kserve-controller-manager-856948b99f-bs7vb" (UID: "47a4a252-0e8a-4d0a-90a5-907ca863a16b") : secret "kserve-webhook-server-cert" not found May 21 15:21:34.356212 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:34.356189 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6hhm\" (UniqueName: \"kubernetes.io/projected/47a4a252-0e8a-4d0a-90a5-907ca863a16b-kube-api-access-t6hhm\") pod \"kserve-controller-manager-856948b99f-bs7vb\" (UID: \"47a4a252-0e8a-4d0a-90a5-907ca863a16b\") " pod="opendatahub/kserve-controller-manager-856948b99f-bs7vb" May 21 15:21:34.850695 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:34.850659 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47a4a252-0e8a-4d0a-90a5-907ca863a16b-cert\") pod \"kserve-controller-manager-856948b99f-bs7vb\" (UID: \"47a4a252-0e8a-4d0a-90a5-907ca863a16b\") " pod="opendatahub/kserve-controller-manager-856948b99f-bs7vb" May 21 15:21:34.853041 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:34.853017 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47a4a252-0e8a-4d0a-90a5-907ca863a16b-cert\") pod \"kserve-controller-manager-856948b99f-bs7vb\" (UID: \"47a4a252-0e8a-4d0a-90a5-907ca863a16b\") " pod="opendatahub/kserve-controller-manager-856948b99f-bs7vb" May 21 15:21:35.047777 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:35.047737 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-bs7vb" May 21 15:21:35.114887 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:35.114806 2563 generic.go:358] "Generic (PLEG): container finished" podID="5f482fb0-9b22-4d74-817a-72ad541fdc1c" containerID="c7f26a8e44f0c579f2bed8c58a606d5280f6469f86e2bcfdec49a163a3af1b43" exitCode=1 May 21 15:21:35.114887 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:35.114869 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-tdd2v" event={"ID":"5f482fb0-9b22-4d74-817a-72ad541fdc1c","Type":"ContainerDied","Data":"c7f26a8e44f0c579f2bed8c58a606d5280f6469f86e2bcfdec49a163a3af1b43"} May 21 15:21:35.115092 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:35.115077 2563 scope.go:117] "RemoveContainer" containerID="c7f26a8e44f0c579f2bed8c58a606d5280f6469f86e2bcfdec49a163a3af1b43" May 21 15:21:35.171453 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:35.171419 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-bs7vb"] May 21 15:21:35.174380 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:21:35.174354 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47a4a252_0e8a_4d0a_90a5_907ca863a16b.slice/crio-65423a75e7570fb1c0a65e690503e234b30dc84297bf56b599b7c250f17b00a7 WatchSource:0}: Error finding container 65423a75e7570fb1c0a65e690503e234b30dc84297bf56b599b7c250f17b00a7: Status 404 returned error can't find the container with id 65423a75e7570fb1c0a65e690503e234b30dc84297bf56b599b7c250f17b00a7 May 21 15:21:36.119103 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:36.119067 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-bs7vb" event={"ID":"47a4a252-0e8a-4d0a-90a5-907ca863a16b","Type":"ContainerStarted","Data":"65423a75e7570fb1c0a65e690503e234b30dc84297bf56b599b7c250f17b00a7"} May 21 15:21:36.120537 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:36.120511 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-tdd2v" event={"ID":"5f482fb0-9b22-4d74-817a-72ad541fdc1c","Type":"ContainerStarted","Data":"f8076b18b55184d0279e2d48c5d857e2bc400c6cc6d222867d91086a70a6a264"} May 21 15:21:36.120693 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:36.120679 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-tdd2v" May 21 15:21:36.137539 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:36.137463 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-tdd2v" podStartSLOduration=2.7466451320000003 podStartE2EDuration="7.137447361s" podCreationTimestamp="2026-05-21 15:21:29 +0000 UTC" firstStartedPulling="2026-05-21 15:21:31.067864256 +0000 UTC m=+505.919306490" lastFinishedPulling="2026-05-21 15:21:35.458666479 +0000 UTC m=+510.310108719" observedRunningTime="2026-05-21 15:21:36.136795502 +0000 UTC m=+510.988237748" watchObservedRunningTime="2026-05-21 15:21:36.137447361 +0000 UTC m=+510.988889617" May 21 15:21:36.647734 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:36.647699 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7bd665b65-d9rxp"] May 21 15:21:36.651288 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:36.651268 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7bd665b65-d9rxp" May 21 15:21:36.653880 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:36.653856 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 21 15:21:36.654170 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:36.654145 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 15:21:36.654253 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:36.654202 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 21 15:21:36.654253 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:36.654215 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-74m2v\"" May 21 15:21:36.654384 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:36.654275 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 15:21:36.674280 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:36.674256 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7bd665b65-d9rxp"] May 21 15:21:36.768568 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:36.768516 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87grl\" (UniqueName: \"kubernetes.io/projected/ed6ce027-c496-4e6e-adb8-6c60f21166f3-kube-api-access-87grl\") pod \"kube-auth-proxy-7bd665b65-d9rxp\" (UID: \"ed6ce027-c496-4e6e-adb8-6c60f21166f3\") " pod="openshift-ingress/kube-auth-proxy-7bd665b65-d9rxp" May 21 15:21:36.768759 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:36.768574 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed6ce027-c496-4e6e-adb8-6c60f21166f3-tls-certs\") pod \"kube-auth-proxy-7bd665b65-d9rxp\" (UID: \"ed6ce027-c496-4e6e-adb8-6c60f21166f3\") " pod="openshift-ingress/kube-auth-proxy-7bd665b65-d9rxp" May 21 15:21:36.768759 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:36.768661 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed6ce027-c496-4e6e-adb8-6c60f21166f3-tmp\") pod \"kube-auth-proxy-7bd665b65-d9rxp\" (UID: \"ed6ce027-c496-4e6e-adb8-6c60f21166f3\") " pod="openshift-ingress/kube-auth-proxy-7bd665b65-d9rxp" May 21 15:21:36.869873 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:36.869836 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed6ce027-c496-4e6e-adb8-6c60f21166f3-tmp\") pod \"kube-auth-proxy-7bd665b65-d9rxp\" (UID: \"ed6ce027-c496-4e6e-adb8-6c60f21166f3\") " pod="openshift-ingress/kube-auth-proxy-7bd665b65-d9rxp" May 21 15:21:36.870058 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:36.869883 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-87grl\" (UniqueName: \"kubernetes.io/projected/ed6ce027-c496-4e6e-adb8-6c60f21166f3-kube-api-access-87grl\") pod \"kube-auth-proxy-7bd665b65-d9rxp\" (UID: \"ed6ce027-c496-4e6e-adb8-6c60f21166f3\") " pod="openshift-ingress/kube-auth-proxy-7bd665b65-d9rxp" May 21 15:21:36.870058 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:36.870021 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed6ce027-c496-4e6e-adb8-6c60f21166f3-tls-certs\") pod \"kube-auth-proxy-7bd665b65-d9rxp\" (UID: \"ed6ce027-c496-4e6e-adb8-6c60f21166f3\") " pod="openshift-ingress/kube-auth-proxy-7bd665b65-d9rxp" May 21 15:21:36.872250 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:36.872224 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed6ce027-c496-4e6e-adb8-6c60f21166f3-tmp\") pod \"kube-auth-proxy-7bd665b65-d9rxp\" (UID: \"ed6ce027-c496-4e6e-adb8-6c60f21166f3\") " pod="openshift-ingress/kube-auth-proxy-7bd665b65-d9rxp" May 21 15:21:36.872748 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:36.872728 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed6ce027-c496-4e6e-adb8-6c60f21166f3-tls-certs\") pod \"kube-auth-proxy-7bd665b65-d9rxp\" (UID: \"ed6ce027-c496-4e6e-adb8-6c60f21166f3\") " pod="openshift-ingress/kube-auth-proxy-7bd665b65-d9rxp" May 21 15:21:36.879534 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:36.879511 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87grl\" (UniqueName: \"kubernetes.io/projected/ed6ce027-c496-4e6e-adb8-6c60f21166f3-kube-api-access-87grl\") pod \"kube-auth-proxy-7bd665b65-d9rxp\" (UID: \"ed6ce027-c496-4e6e-adb8-6c60f21166f3\") " pod="openshift-ingress/kube-auth-proxy-7bd665b65-d9rxp" May 21 15:21:36.961759 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:36.961684 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7bd665b65-d9rxp" May 21 15:21:37.084968 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:37.084936 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7bd665b65-d9rxp"] May 21 15:21:37.088811 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:21:37.088783 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded6ce027_c496_4e6e_adb8_6c60f21166f3.slice/crio-303e13439444f731a55e77ce419997eec74aeda48d51e7ff481fbdc032495cbe WatchSource:0}: Error finding container 303e13439444f731a55e77ce419997eec74aeda48d51e7ff481fbdc032495cbe: Status 404 returned error can't find the container with id 303e13439444f731a55e77ce419997eec74aeda48d51e7ff481fbdc032495cbe May 21 15:21:37.124387 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:37.124360 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7bd665b65-d9rxp" event={"ID":"ed6ce027-c496-4e6e-adb8-6c60f21166f3","Type":"ContainerStarted","Data":"303e13439444f731a55e77ce419997eec74aeda48d51e7ff481fbdc032495cbe"} May 21 15:21:40.137717 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:40.137672 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-bs7vb" event={"ID":"47a4a252-0e8a-4d0a-90a5-907ca863a16b","Type":"ContainerStarted","Data":"8d0df343f9d860eb38587ec905e129f901d9be79a6506a904481f9f92a9dd9b2"} May 21 15:21:40.138210 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:40.137824 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-bs7vb" May 21 15:21:40.154300 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:40.154236 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-bs7vb" podStartSLOduration=1.6948792259999998 podStartE2EDuration="6.154223748s" podCreationTimestamp="2026-05-21 15:21:34 +0000 UTC" firstStartedPulling="2026-05-21 15:21:35.175666529 +0000 UTC m=+510.027108762" lastFinishedPulling="2026-05-21 15:21:39.635011051 +0000 UTC m=+514.486453284" observedRunningTime="2026-05-21 15:21:40.153805509 +0000 UTC m=+515.005247767" watchObservedRunningTime="2026-05-21 15:21:40.154223748 +0000 UTC m=+515.005666014" May 21 15:21:41.141355 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:41.141298 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7bd665b65-d9rxp" event={"ID":"ed6ce027-c496-4e6e-adb8-6c60f21166f3","Type":"ContainerStarted","Data":"e97e7b312f123a0bc5cd1bde44fb491af7e9af4448f9adc2f562930221402e9b"} May 21 15:21:41.158143 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:41.158093 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7bd665b65-d9rxp" podStartSLOduration=1.719672476 podStartE2EDuration="5.15808074s" podCreationTimestamp="2026-05-21 15:21:36 +0000 UTC" firstStartedPulling="2026-05-21 15:21:37.090701586 +0000 UTC m=+511.942143818" lastFinishedPulling="2026-05-21 15:21:40.529109849 +0000 UTC m=+515.380552082" observedRunningTime="2026-05-21 15:21:41.156536232 +0000 UTC m=+516.007978486" watchObservedRunningTime="2026-05-21 15:21:41.15808074 +0000 UTC m=+516.009522994" May 21 15:21:47.126791 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:47.126758 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-tdd2v" May 21 15:21:51.561921 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:51.561885 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-lccq8"] May 21 15:21:51.567848 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:51.567823 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-lccq8" May 21 15:21:51.570228 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:51.570208 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" May 21 15:21:51.570712 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:51.570674 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-7nnsv\"" May 21 15:21:51.570820 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:51.570756 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" May 21 15:21:51.580495 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:51.580472 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-lccq8"] May 21 15:21:51.586773 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:51.586748 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hhk6\" (UniqueName: \"kubernetes.io/projected/dd1bfd9e-4d5c-4229-96e6-474304ee6d17-kube-api-access-5hhk6\") pod \"servicemesh-operator3-55f49c5f94-lccq8\" (UID: \"dd1bfd9e-4d5c-4229-96e6-474304ee6d17\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-lccq8" May 21 15:21:51.586877 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:51.586835 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/dd1bfd9e-4d5c-4229-96e6-474304ee6d17-operator-config\") pod \"servicemesh-operator3-55f49c5f94-lccq8\" (UID: \"dd1bfd9e-4d5c-4229-96e6-474304ee6d17\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-lccq8" May 21 15:21:51.687669 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:51.687632 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/dd1bfd9e-4d5c-4229-96e6-474304ee6d17-operator-config\") pod \"servicemesh-operator3-55f49c5f94-lccq8\" (UID: \"dd1bfd9e-4d5c-4229-96e6-474304ee6d17\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-lccq8" May 21 15:21:51.687854 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:51.687686 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5hhk6\" (UniqueName: \"kubernetes.io/projected/dd1bfd9e-4d5c-4229-96e6-474304ee6d17-kube-api-access-5hhk6\") pod \"servicemesh-operator3-55f49c5f94-lccq8\" (UID: \"dd1bfd9e-4d5c-4229-96e6-474304ee6d17\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-lccq8" May 21 15:21:51.690107 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:51.690078 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/dd1bfd9e-4d5c-4229-96e6-474304ee6d17-operator-config\") pod \"servicemesh-operator3-55f49c5f94-lccq8\" (UID: \"dd1bfd9e-4d5c-4229-96e6-474304ee6d17\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-lccq8" May 21 15:21:51.695139 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:51.695064 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hhk6\" (UniqueName: \"kubernetes.io/projected/dd1bfd9e-4d5c-4229-96e6-474304ee6d17-kube-api-access-5hhk6\") pod \"servicemesh-operator3-55f49c5f94-lccq8\" (UID: \"dd1bfd9e-4d5c-4229-96e6-474304ee6d17\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-lccq8" May 21 15:21:51.877710 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:51.877629 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-lccq8" May 21 15:21:52.006217 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:52.006180 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-lccq8"] May 21 15:21:52.009475 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:21:52.009438 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd1bfd9e_4d5c_4229_96e6_474304ee6d17.slice/crio-2c316cba45ddf891ee0cb8ef6e4de3a43847e0896136e67270d03a05a1674a83 WatchSource:0}: Error finding container 2c316cba45ddf891ee0cb8ef6e4de3a43847e0896136e67270d03a05a1674a83: Status 404 returned error can't find the container with id 2c316cba45ddf891ee0cb8ef6e4de3a43847e0896136e67270d03a05a1674a83 May 21 15:21:52.171741 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:52.171658 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-lccq8" event={"ID":"dd1bfd9e-4d5c-4229-96e6-474304ee6d17","Type":"ContainerStarted","Data":"2c316cba45ddf891ee0cb8ef6e4de3a43847e0896136e67270d03a05a1674a83"} May 21 15:21:55.183210 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:55.183132 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-lccq8" event={"ID":"dd1bfd9e-4d5c-4229-96e6-474304ee6d17","Type":"ContainerStarted","Data":"3b18d1f1c71a7598c1a7cbd144084b1805e3cfdfa93fa1df91ad5a02a8979f39"} May 21 15:21:55.183601 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:55.183267 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-lccq8" May 21 15:21:55.206133 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:21:55.206064 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-lccq8" podStartSLOduration=1.581559671 podStartE2EDuration="4.206046292s" podCreationTimestamp="2026-05-21 15:21:51 +0000 UTC" firstStartedPulling="2026-05-21 15:21:52.011988676 +0000 UTC m=+526.863430912" lastFinishedPulling="2026-05-21 15:21:54.63647529 +0000 UTC m=+529.487917533" observedRunningTime="2026-05-21 15:21:55.204733499 +0000 UTC m=+530.056175755" watchObservedRunningTime="2026-05-21 15:21:55.206046292 +0000 UTC m=+530.057488548" May 21 15:22:06.189056 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:06.189024 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-lccq8" May 21 15:22:08.518062 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.518025 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp"] May 21 15:22:08.522121 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.522096 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp" May 21 15:22:08.524758 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.524737 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" May 21 15:22:08.524827 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.524757 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" May 21 15:22:08.524827 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.524737 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 21 15:22:08.525097 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.525080 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-d4g7q\"" May 21 15:22:08.525502 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.525487 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" May 21 15:22:08.540872 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.540854 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp"] May 21 15:22:08.633667 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.633637 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f80b0fff-1cf0-4553-b04e-e5579518aae7-local-certs\") pod \"istiod-openshift-gateway-798958bb55-95nfp\" (UID: \"f80b0fff-1cf0-4553-b04e-e5579518aae7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp" May 21 15:22:08.633812 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.633672 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f80b0fff-1cf0-4553-b04e-e5579518aae7-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-95nfp\" (UID: \"f80b0fff-1cf0-4553-b04e-e5579518aae7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp" May 21 15:22:08.633812 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.633699 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f80b0fff-1cf0-4553-b04e-e5579518aae7-istio-token\") pod \"istiod-openshift-gateway-798958bb55-95nfp\" (UID: \"f80b0fff-1cf0-4553-b04e-e5579518aae7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp" May 21 15:22:08.633812 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.633772 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djlkx\" (UniqueName: \"kubernetes.io/projected/f80b0fff-1cf0-4553-b04e-e5579518aae7-kube-api-access-djlkx\") pod \"istiod-openshift-gateway-798958bb55-95nfp\" (UID: \"f80b0fff-1cf0-4553-b04e-e5579518aae7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp" May 21 15:22:08.633933 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.633826 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f80b0fff-1cf0-4553-b04e-e5579518aae7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-95nfp\" (UID: \"f80b0fff-1cf0-4553-b04e-e5579518aae7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp" May 21 15:22:08.633933 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.633858 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f80b0fff-1cf0-4553-b04e-e5579518aae7-cacerts\") pod \"istiod-openshift-gateway-798958bb55-95nfp\" (UID: \"f80b0fff-1cf0-4553-b04e-e5579518aae7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp" May 21 15:22:08.633933 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.633904 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f80b0fff-1cf0-4553-b04e-e5579518aae7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-95nfp\" (UID: \"f80b0fff-1cf0-4553-b04e-e5579518aae7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp" May 21 15:22:08.734927 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.734884 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f80b0fff-1cf0-4553-b04e-e5579518aae7-istio-token\") pod \"istiod-openshift-gateway-798958bb55-95nfp\" (UID: \"f80b0fff-1cf0-4553-b04e-e5579518aae7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp" May 21 15:22:08.734927 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.734925 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-djlkx\" (UniqueName: \"kubernetes.io/projected/f80b0fff-1cf0-4553-b04e-e5579518aae7-kube-api-access-djlkx\") pod \"istiod-openshift-gateway-798958bb55-95nfp\" (UID: \"f80b0fff-1cf0-4553-b04e-e5579518aae7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp" May 21 15:22:08.735159 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.734971 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f80b0fff-1cf0-4553-b04e-e5579518aae7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-95nfp\" (UID: \"f80b0fff-1cf0-4553-b04e-e5579518aae7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp" May 21 15:22:08.735159 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.734999 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f80b0fff-1cf0-4553-b04e-e5579518aae7-cacerts\") pod \"istiod-openshift-gateway-798958bb55-95nfp\" (UID: \"f80b0fff-1cf0-4553-b04e-e5579518aae7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp" May 21 15:22:08.735159 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.735049 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f80b0fff-1cf0-4553-b04e-e5579518aae7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-95nfp\" (UID: \"f80b0fff-1cf0-4553-b04e-e5579518aae7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp" May 21 15:22:08.735159 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.735094 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f80b0fff-1cf0-4553-b04e-e5579518aae7-local-certs\") pod \"istiod-openshift-gateway-798958bb55-95nfp\" (UID: \"f80b0fff-1cf0-4553-b04e-e5579518aae7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp" May 21 15:22:08.735159 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.735117 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f80b0fff-1cf0-4553-b04e-e5579518aae7-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-95nfp\" (UID: \"f80b0fff-1cf0-4553-b04e-e5579518aae7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp" May 21 15:22:08.735721 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.735693 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f80b0fff-1cf0-4553-b04e-e5579518aae7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-95nfp\" (UID: \"f80b0fff-1cf0-4553-b04e-e5579518aae7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp" May 21 15:22:08.738160 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.738133 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f80b0fff-1cf0-4553-b04e-e5579518aae7-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-95nfp\" (UID: \"f80b0fff-1cf0-4553-b04e-e5579518aae7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp" May 21 15:22:08.738479 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.738458 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f80b0fff-1cf0-4553-b04e-e5579518aae7-cacerts\") pod \"istiod-openshift-gateway-798958bb55-95nfp\" (UID: \"f80b0fff-1cf0-4553-b04e-e5579518aae7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp" May 21 15:22:08.741034 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.741003 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f80b0fff-1cf0-4553-b04e-e5579518aae7-local-certs\") pod \"istiod-openshift-gateway-798958bb55-95nfp\" (UID: \"f80b0fff-1cf0-4553-b04e-e5579518aae7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp" May 21 15:22:08.742443 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.742398 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f80b0fff-1cf0-4553-b04e-e5579518aae7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-95nfp\" (UID: \"f80b0fff-1cf0-4553-b04e-e5579518aae7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp" May 21 15:22:08.743422 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.742966 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djlkx\" (UniqueName: \"kubernetes.io/projected/f80b0fff-1cf0-4553-b04e-e5579518aae7-kube-api-access-djlkx\") pod \"istiod-openshift-gateway-798958bb55-95nfp\" (UID: \"f80b0fff-1cf0-4553-b04e-e5579518aae7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp" May 21 15:22:08.743627 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.743586 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f80b0fff-1cf0-4553-b04e-e5579518aae7-istio-token\") pod \"istiod-openshift-gateway-798958bb55-95nfp\" (UID: \"f80b0fff-1cf0-4553-b04e-e5579518aae7\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp" May 21 15:22:08.832204 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.831701 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp" May 21 15:22:08.976248 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:08.976215 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp"] May 21 15:22:08.979303 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:22:08.979273 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf80b0fff_1cf0_4553_b04e_e5579518aae7.slice/crio-05af14a316a5d7107f176cf17afce20ab227949afb6bd08c169bef94ae1ff40d WatchSource:0}: Error finding container 05af14a316a5d7107f176cf17afce20ab227949afb6bd08c169bef94ae1ff40d: Status 404 returned error can't find the container with id 05af14a316a5d7107f176cf17afce20ab227949afb6bd08c169bef94ae1ff40d May 21 15:22:09.225353 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:09.225305 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp" event={"ID":"f80b0fff-1cf0-4553-b04e-e5579518aae7","Type":"ContainerStarted","Data":"05af14a316a5d7107f176cf17afce20ab227949afb6bd08c169bef94ae1ff40d"} May 21 15:22:11.148263 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:11.148229 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-bs7vb" May 21 15:22:11.657036 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:11.656987 2563 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 15:22:11.657167 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:11.657086 2563 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 15:22:12.237667 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:12.237637 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp" event={"ID":"f80b0fff-1cf0-4553-b04e-e5579518aae7","Type":"ContainerStarted","Data":"cd72fa4dc3f478bf6dcbe16044d730635d3553ab007ba500676e0860c45e181d"} May 21 15:22:12.238098 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:12.237831 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp" May 21 15:22:12.239450 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:12.239427 2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-95nfp container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= May 21 15:22:12.239517 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:12.239476 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp" podUID="f80b0fff-1cf0-4553-b04e-e5579518aae7" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 15:22:12.257445 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:12.257358 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp" podStartSLOduration=1.5817922709999999 podStartE2EDuration="4.257329666s" podCreationTimestamp="2026-05-21 15:22:08 +0000 UTC" firstStartedPulling="2026-05-21 15:22:08.981223086 +0000 UTC m=+543.832665322" lastFinishedPulling="2026-05-21 15:22:11.656760472 +0000 UTC m=+546.508202717" observedRunningTime="2026-05-21 15:22:12.25695714 +0000 UTC m=+547.108399396" watchObservedRunningTime="2026-05-21 15:22:12.257329666 +0000 UTC m=+547.108771921" May 21 15:22:13.241941 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:22:13.241912 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-95nfp" May 21 15:23:02.676004 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:02.675970 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tkq74"] May 21 15:23:02.680927 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:02.680726 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tkq74" May 21 15:23:02.683063 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:02.683032 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 15:23:02.683183 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:02.683075 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-89s62\"" May 21 15:23:02.683183 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:02.683099 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 15:23:02.690866 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:02.690839 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tkq74"] May 21 15:23:02.747684 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:02.747651 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/39905af6-2371-4aa9-9b93-beeeeb45ad49-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tkq74\" (UID: \"39905af6-2371-4aa9-9b93-beeeeb45ad49\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tkq74" May 21 15:23:02.747857 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:02.747710 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgpgs\" (UniqueName: \"kubernetes.io/projected/39905af6-2371-4aa9-9b93-beeeeb45ad49-kube-api-access-sgpgs\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tkq74\" (UID: \"39905af6-2371-4aa9-9b93-beeeeb45ad49\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tkq74" May 21 15:23:02.848903 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:02.848851 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sgpgs\" (UniqueName: \"kubernetes.io/projected/39905af6-2371-4aa9-9b93-beeeeb45ad49-kube-api-access-sgpgs\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tkq74\" (UID: \"39905af6-2371-4aa9-9b93-beeeeb45ad49\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tkq74" May 21 15:23:02.849096 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:02.848926 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/39905af6-2371-4aa9-9b93-beeeeb45ad49-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tkq74\" (UID: \"39905af6-2371-4aa9-9b93-beeeeb45ad49\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tkq74" May 21 15:23:02.849265 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:02.849246 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/39905af6-2371-4aa9-9b93-beeeeb45ad49-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tkq74\" (UID: \"39905af6-2371-4aa9-9b93-beeeeb45ad49\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tkq74" May 21 15:23:02.857579 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:02.857557 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgpgs\" (UniqueName: \"kubernetes.io/projected/39905af6-2371-4aa9-9b93-beeeeb45ad49-kube-api-access-sgpgs\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tkq74\" (UID: \"39905af6-2371-4aa9-9b93-beeeeb45ad49\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tkq74" May 21 15:23:02.992387 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:02.992323 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tkq74" May 21 15:23:03.124013 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:03.123842 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tkq74"] May 21 15:23:03.127166 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:23:03.127139 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39905af6_2371_4aa9_9b93_beeeeb45ad49.slice/crio-8473ec92f234c88204bbb16329511ca18016a3bb1c8b0aec33db065972c188f3 WatchSource:0}: Error finding container 8473ec92f234c88204bbb16329511ca18016a3bb1c8b0aec33db065972c188f3: Status 404 returned error can't find the container with id 8473ec92f234c88204bbb16329511ca18016a3bb1c8b0aec33db065972c188f3 May 21 15:23:03.390427 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:03.390318 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tkq74" event={"ID":"39905af6-2371-4aa9-9b93-beeeeb45ad49","Type":"ContainerStarted","Data":"8473ec92f234c88204bbb16329511ca18016a3bb1c8b0aec33db065972c188f3"} May 21 15:23:09.412175 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:09.412139 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tkq74" event={"ID":"39905af6-2371-4aa9-9b93-beeeeb45ad49","Type":"ContainerStarted","Data":"5673744d9cd56f6e658ab9cc298ed9007f0538822f7885b425425c97114fb459"} May 21 15:23:09.412651 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:09.412250 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tkq74" May 21 15:23:09.436845 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:09.436771 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tkq74" podStartSLOduration=1.745182862 podStartE2EDuration="7.436754507s" podCreationTimestamp="2026-05-21 15:23:02 +0000 UTC" firstStartedPulling="2026-05-21 15:23:03.129346978 +0000 UTC m=+597.980789223" lastFinishedPulling="2026-05-21 15:23:08.820918617 +0000 UTC m=+603.672360868" observedRunningTime="2026-05-21 15:23:09.434771546 +0000 UTC m=+604.286213801" watchObservedRunningTime="2026-05-21 15:23:09.436754507 +0000 UTC m=+604.288196765" May 21 15:23:09.979164 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:09.979125 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-tffqk"] May 21 15:23:09.982435 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:09.982413 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-tffqk" May 21 15:23:09.984426 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:09.984403 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" May 21 15:23:09.984512 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:09.984447 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-7gftn\"" May 21 15:23:09.992852 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:09.992832 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-tffqk"] May 21 15:23:10.109392 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:10.109333 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlgh6\" (UniqueName: \"kubernetes.io/projected/4f912091-324e-4b2b-bf5a-f2b4187e766b-kube-api-access-hlgh6\") pod \"dns-operator-controller-manager-648d5c98bc-tffqk\" (UID: \"4f912091-324e-4b2b-bf5a-f2b4187e766b\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-tffqk" May 21 15:23:10.210590 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:10.210555 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hlgh6\" (UniqueName: \"kubernetes.io/projected/4f912091-324e-4b2b-bf5a-f2b4187e766b-kube-api-access-hlgh6\") pod \"dns-operator-controller-manager-648d5c98bc-tffqk\" (UID: \"4f912091-324e-4b2b-bf5a-f2b4187e766b\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-tffqk" May 21 15:23:10.218706 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:10.218680 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlgh6\" (UniqueName: \"kubernetes.io/projected/4f912091-324e-4b2b-bf5a-f2b4187e766b-kube-api-access-hlgh6\") pod \"dns-operator-controller-manager-648d5c98bc-tffqk\" (UID: \"4f912091-324e-4b2b-bf5a-f2b4187e766b\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-tffqk" May 21 15:23:10.292576 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:10.292509 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-tffqk" May 21 15:23:10.424993 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:10.424965 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-tffqk"] May 21 15:23:10.428213 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:23:10.428189 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f912091_324e_4b2b_bf5a_f2b4187e766b.slice/crio-a63afbd4bee430db70f699fa9835d8dbadc2ccef1e34a06e1dced512fbe21d9d WatchSource:0}: Error finding container a63afbd4bee430db70f699fa9835d8dbadc2ccef1e34a06e1dced512fbe21d9d: Status 404 returned error can't find the container with id a63afbd4bee430db70f699fa9835d8dbadc2ccef1e34a06e1dced512fbe21d9d May 21 15:23:11.419776 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:11.419741 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-tffqk" event={"ID":"4f912091-324e-4b2b-bf5a-f2b4187e766b","Type":"ContainerStarted","Data":"a63afbd4bee430db70f699fa9835d8dbadc2ccef1e34a06e1dced512fbe21d9d"} May 21 15:23:13.427129 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:13.427091 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-tffqk" event={"ID":"4f912091-324e-4b2b-bf5a-f2b4187e766b","Type":"ContainerStarted","Data":"cbb6c5b70d60731a4a325b3aa61d10f9e0f824d8fd7272144b6ea9996fb24719"} May 21 15:23:13.427601 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:13.427216 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-tffqk" May 21 15:23:13.445397 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:13.445351 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-tffqk" podStartSLOduration=2.325372217 podStartE2EDuration="4.445324522s" podCreationTimestamp="2026-05-21 15:23:09 +0000 UTC" firstStartedPulling="2026-05-21 15:23:10.430483653 +0000 UTC m=+605.281925889" lastFinishedPulling="2026-05-21 15:23:12.550435947 +0000 UTC m=+607.401878194" observedRunningTime="2026-05-21 15:23:13.443871124 +0000 UTC m=+608.295313379" watchObservedRunningTime="2026-05-21 15:23:13.445324522 +0000 UTC m=+608.296766776" May 21 15:23:20.417795 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:20.417764 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tkq74" May 21 15:23:22.107088 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.107052 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tkq74"] May 21 15:23:22.107558 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.107307 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tkq74" podUID="39905af6-2371-4aa9-9b93-beeeeb45ad49" containerName="manager" containerID="cri-o://5673744d9cd56f6e658ab9cc298ed9007f0538822f7885b425425c97114fb459" gracePeriod=2 May 21 15:23:22.134255 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.134227 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tkq74"] May 21 15:23:22.147670 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.147649 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sptgq"] May 21 15:23:22.147948 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.147935 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39905af6-2371-4aa9-9b93-beeeeb45ad49" containerName="manager" May 21 15:23:22.147994 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.147949 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="39905af6-2371-4aa9-9b93-beeeeb45ad49" containerName="manager" May 21 15:23:22.148027 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.147996 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="39905af6-2371-4aa9-9b93-beeeeb45ad49" containerName="manager" May 21 15:23:22.150694 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.150676 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sptgq" May 21 15:23:22.152632 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.152600 2563 status_manager.go:895] "Failed to get status for pod" podUID="39905af6-2371-4aa9-9b93-beeeeb45ad49" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tkq74" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-tkq74\" is forbidden: User \"system:node:ip-10-0-142-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-73.ec2.internal' and this object" May 21 15:23:22.162255 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.162232 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sptgq"] May 21 15:23:22.303804 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.303774 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg4jc\" (UniqueName: \"kubernetes.io/projected/aaaefc56-0593-4fee-adba-e89b8b128ce3-kube-api-access-gg4jc\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-sptgq\" (UID: \"aaaefc56-0593-4fee-adba-e89b8b128ce3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sptgq" May 21 15:23:22.303946 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.303852 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aaaefc56-0593-4fee-adba-e89b8b128ce3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-sptgq\" (UID: \"aaaefc56-0593-4fee-adba-e89b8b128ce3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sptgq" May 21 15:23:22.334210 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.334188 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tkq74" May 21 15:23:22.335885 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.335861 2563 status_manager.go:895] "Failed to get status for pod" podUID="39905af6-2371-4aa9-9b93-beeeeb45ad49" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tkq74" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-tkq74\" is forbidden: User \"system:node:ip-10-0-142-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-73.ec2.internal' and this object" May 21 15:23:22.404390 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.404284 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgpgs\" (UniqueName: \"kubernetes.io/projected/39905af6-2371-4aa9-9b93-beeeeb45ad49-kube-api-access-sgpgs\") pod \"39905af6-2371-4aa9-9b93-beeeeb45ad49\" (UID: \"39905af6-2371-4aa9-9b93-beeeeb45ad49\") " May 21 15:23:22.404538 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.404400 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/39905af6-2371-4aa9-9b93-beeeeb45ad49-extensions-socket-volume\") pod \"39905af6-2371-4aa9-9b93-beeeeb45ad49\" (UID: \"39905af6-2371-4aa9-9b93-beeeeb45ad49\") " May 21 15:23:22.404538 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.404490 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aaaefc56-0593-4fee-adba-e89b8b128ce3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-sptgq\" (UID: \"aaaefc56-0593-4fee-adba-e89b8b128ce3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sptgq" May 21 15:23:22.404624 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.404567 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gg4jc\" (UniqueName: \"kubernetes.io/projected/aaaefc56-0593-4fee-adba-e89b8b128ce3-kube-api-access-gg4jc\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-sptgq\" (UID: \"aaaefc56-0593-4fee-adba-e89b8b128ce3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sptgq" May 21 15:23:22.404889 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.404864 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aaaefc56-0593-4fee-adba-e89b8b128ce3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-sptgq\" (UID: \"aaaefc56-0593-4fee-adba-e89b8b128ce3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sptgq" May 21 15:23:22.404964 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.404944 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39905af6-2371-4aa9-9b93-beeeeb45ad49-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "39905af6-2371-4aa9-9b93-beeeeb45ad49" (UID: "39905af6-2371-4aa9-9b93-beeeeb45ad49"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 15:23:22.406501 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.406478 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39905af6-2371-4aa9-9b93-beeeeb45ad49-kube-api-access-sgpgs" (OuterVolumeSpecName: "kube-api-access-sgpgs") pod "39905af6-2371-4aa9-9b93-beeeeb45ad49" (UID: "39905af6-2371-4aa9-9b93-beeeeb45ad49"). InnerVolumeSpecName "kube-api-access-sgpgs". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:23:22.412324 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.412298 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg4jc\" (UniqueName: \"kubernetes.io/projected/aaaefc56-0593-4fee-adba-e89b8b128ce3-kube-api-access-gg4jc\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-sptgq\" (UID: \"aaaefc56-0593-4fee-adba-e89b8b128ce3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sptgq" May 21 15:23:22.455930 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.455896 2563 generic.go:358] "Generic (PLEG): container finished" podID="39905af6-2371-4aa9-9b93-beeeeb45ad49" containerID="5673744d9cd56f6e658ab9cc298ed9007f0538822f7885b425425c97114fb459" exitCode=0 May 21 15:23:22.456061 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.455951 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tkq74" May 21 15:23:22.456061 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.455978 2563 scope.go:117] "RemoveContainer" containerID="5673744d9cd56f6e658ab9cc298ed9007f0538822f7885b425425c97114fb459" May 21 15:23:22.457911 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.457880 2563 status_manager.go:895] "Failed to get status for pod" podUID="39905af6-2371-4aa9-9b93-beeeeb45ad49" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tkq74" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-tkq74\" is forbidden: User \"system:node:ip-10-0-142-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-73.ec2.internal' and this object" May 21 15:23:22.464451 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.464429 2563 scope.go:117] "RemoveContainer" containerID="5673744d9cd56f6e658ab9cc298ed9007f0538822f7885b425425c97114fb459" May 21 15:23:22.464725 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:23:22.464709 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5673744d9cd56f6e658ab9cc298ed9007f0538822f7885b425425c97114fb459\": container with ID starting with 5673744d9cd56f6e658ab9cc298ed9007f0538822f7885b425425c97114fb459 not found: ID does not exist" containerID="5673744d9cd56f6e658ab9cc298ed9007f0538822f7885b425425c97114fb459" May 21 15:23:22.464791 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.464733 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5673744d9cd56f6e658ab9cc298ed9007f0538822f7885b425425c97114fb459"} err="failed to get container status \"5673744d9cd56f6e658ab9cc298ed9007f0538822f7885b425425c97114fb459\": rpc error: code = NotFound desc = could not find container \"5673744d9cd56f6e658ab9cc298ed9007f0538822f7885b425425c97114fb459\": container with ID starting with 5673744d9cd56f6e658ab9cc298ed9007f0538822f7885b425425c97114fb459 not found: ID does not exist" May 21 15:23:22.466620 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.466599 2563 status_manager.go:895] "Failed to get status for pod" podUID="39905af6-2371-4aa9-9b93-beeeeb45ad49" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tkq74" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-tkq74\" is forbidden: User \"system:node:ip-10-0-142-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-73.ec2.internal' and this object" May 21 15:23:22.483772 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.483758 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sptgq" May 21 15:23:22.505660 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.505618 2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/39905af6-2371-4aa9-9b93-beeeeb45ad49-extensions-socket-volume\") on node \"ip-10-0-142-73.ec2.internal\" DevicePath \"\"" May 21 15:23:22.505660 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.505656 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgpgs\" (UniqueName: \"kubernetes.io/projected/39905af6-2371-4aa9-9b93-beeeeb45ad49-kube-api-access-sgpgs\") on node \"ip-10-0-142-73.ec2.internal\" DevicePath \"\"" May 21 15:23:22.608859 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:22.608826 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sptgq"] May 21 15:23:22.614231 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:23:22.614203 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaaefc56_0593_4fee_adba_e89b8b128ce3.slice/crio-49e8099adb0d71d8455d1baf343fc4ccbb314927f9f7cce46a97e7f286fa2b6c WatchSource:0}: Error finding container 49e8099adb0d71d8455d1baf343fc4ccbb314927f9f7cce46a97e7f286fa2b6c: Status 404 returned error can't find the container with id 49e8099adb0d71d8455d1baf343fc4ccbb314927f9f7cce46a97e7f286fa2b6c May 21 15:23:23.176889 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:23.176858 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pg4hj"] May 21 15:23:23.180036 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:23.180020 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pg4hj" May 21 15:23:23.181845 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:23.181817 2563 status_manager.go:895] "Failed to get status for pod" podUID="39905af6-2371-4aa9-9b93-beeeeb45ad49" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tkq74" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-tkq74\" is forbidden: User \"system:node:ip-10-0-142-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-73.ec2.internal' and this object" May 21 15:23:23.193908 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:23.193887 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pg4hj"] May 21 15:23:23.312570 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:23.312540 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2d58\" (UniqueName: \"kubernetes.io/projected/65996b8a-7720-4fb5-9191-d666c9e34131-kube-api-access-c2d58\") pod \"kuadrant-operator-controller-manager-55c7f4c975-pg4hj\" (UID: \"65996b8a-7720-4fb5-9191-d666c9e34131\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pg4hj" May 21 15:23:23.312725 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:23.312649 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65996b8a-7720-4fb5-9191-d666c9e34131-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-pg4hj\" (UID: \"65996b8a-7720-4fb5-9191-d666c9e34131\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pg4hj" May 21 15:23:23.413310 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:23.413276 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65996b8a-7720-4fb5-9191-d666c9e34131-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-pg4hj\" (UID: \"65996b8a-7720-4fb5-9191-d666c9e34131\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pg4hj" May 21 15:23:23.413466 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:23.413320 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2d58\" (UniqueName: \"kubernetes.io/projected/65996b8a-7720-4fb5-9191-d666c9e34131-kube-api-access-c2d58\") pod \"kuadrant-operator-controller-manager-55c7f4c975-pg4hj\" (UID: \"65996b8a-7720-4fb5-9191-d666c9e34131\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pg4hj" May 21 15:23:23.413686 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:23.413665 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65996b8a-7720-4fb5-9191-d666c9e34131-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-pg4hj\" (UID: \"65996b8a-7720-4fb5-9191-d666c9e34131\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pg4hj" May 21 15:23:23.423154 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:23.423124 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2d58\" (UniqueName: \"kubernetes.io/projected/65996b8a-7720-4fb5-9191-d666c9e34131-kube-api-access-c2d58\") pod \"kuadrant-operator-controller-manager-55c7f4c975-pg4hj\" (UID: \"65996b8a-7720-4fb5-9191-d666c9e34131\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pg4hj" May 21 15:23:23.461748 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:23.461685 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sptgq" event={"ID":"aaaefc56-0593-4fee-adba-e89b8b128ce3","Type":"ContainerStarted","Data":"aa250b45667fc4a3f61f5fb0cce9911ea0ced6b1ddd6eab8f22ddb4149063233"} May 21 15:23:23.461748 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:23.461726 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sptgq" event={"ID":"aaaefc56-0593-4fee-adba-e89b8b128ce3","Type":"ContainerStarted","Data":"49e8099adb0d71d8455d1baf343fc4ccbb314927f9f7cce46a97e7f286fa2b6c"} May 21 15:23:23.461904 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:23.461829 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sptgq" May 21 15:23:23.463723 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:23.463697 2563 status_manager.go:895] "Failed to get status for pod" podUID="39905af6-2371-4aa9-9b93-beeeeb45ad49" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tkq74" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-tkq74\" is forbidden: User \"system:node:ip-10-0-142-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-73.ec2.internal' and this object" May 21 15:23:23.485667 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:23.485630 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sptgq" podStartSLOduration=1.485619037 podStartE2EDuration="1.485619037s" podCreationTimestamp="2026-05-21 15:23:22 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:23:23.48349699 +0000 UTC m=+618.334939245" watchObservedRunningTime="2026-05-21 15:23:23.485619037 +0000 UTC m=+618.337061364" May 21 15:23:23.489999 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:23.489977 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pg4hj" May 21 15:23:23.625187 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:23.625157 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pg4hj"] May 21 15:23:23.626531 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:23:23.626504 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65996b8a_7720_4fb5_9191_d666c9e34131.slice/crio-83247a179893f2c6a9ede62ef77a2bddb294ac861575c1b5baf75c1ce3bbbab2 WatchSource:0}: Error finding container 83247a179893f2c6a9ede62ef77a2bddb294ac861575c1b5baf75c1ce3bbbab2: Status 404 returned error can't find the container with id 83247a179893f2c6a9ede62ef77a2bddb294ac861575c1b5baf75c1ce3bbbab2 May 21 15:23:23.716533 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:23.716468 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39905af6-2371-4aa9-9b93-beeeeb45ad49" path="/var/lib/kubelet/pods/39905af6-2371-4aa9-9b93-beeeeb45ad49/volumes" May 21 15:23:24.431964 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:24.431936 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-tffqk" May 21 15:23:24.466631 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:24.466593 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pg4hj" event={"ID":"65996b8a-7720-4fb5-9191-d666c9e34131","Type":"ContainerStarted","Data":"2cab18f9cf9fcfaaab36abafa8740e199ae82bc7407f59b8b0207a588bbb5ef9"} May 21 15:23:24.466825 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:24.466640 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pg4hj" event={"ID":"65996b8a-7720-4fb5-9191-d666c9e34131","Type":"ContainerStarted","Data":"83247a179893f2c6a9ede62ef77a2bddb294ac861575c1b5baf75c1ce3bbbab2"} May 21 15:23:24.466825 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:24.466686 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pg4hj" May 21 15:23:24.488095 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:24.488050 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pg4hj" podStartSLOduration=1.488032734 podStartE2EDuration="1.488032734s" podCreationTimestamp="2026-05-21 15:23:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:23:24.486090241 +0000 UTC m=+619.337532496" watchObservedRunningTime="2026-05-21 15:23:24.488032734 +0000 UTC m=+619.339474988" May 21 15:23:34.469064 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:34.468994 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sptgq" May 21 15:23:35.471830 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:35.471802 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pg4hj" May 21 15:23:35.522266 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:35.522235 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sptgq"] May 21 15:23:35.522487 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:35.522460 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sptgq" podUID="aaaefc56-0593-4fee-adba-e89b8b128ce3" containerName="manager" containerID="cri-o://aa250b45667fc4a3f61f5fb0cce9911ea0ced6b1ddd6eab8f22ddb4149063233" gracePeriod=10 May 21 15:23:35.768205 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:35.768182 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sptgq" May 21 15:23:35.906020 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:35.905989 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gg4jc\" (UniqueName: \"kubernetes.io/projected/aaaefc56-0593-4fee-adba-e89b8b128ce3-kube-api-access-gg4jc\") pod \"aaaefc56-0593-4fee-adba-e89b8b128ce3\" (UID: \"aaaefc56-0593-4fee-adba-e89b8b128ce3\") " May 21 15:23:35.906020 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:35.906023 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aaaefc56-0593-4fee-adba-e89b8b128ce3-extensions-socket-volume\") pod \"aaaefc56-0593-4fee-adba-e89b8b128ce3\" (UID: \"aaaefc56-0593-4fee-adba-e89b8b128ce3\") " May 21 15:23:35.906510 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:35.906477 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaaefc56-0593-4fee-adba-e89b8b128ce3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "aaaefc56-0593-4fee-adba-e89b8b128ce3" (UID: "aaaefc56-0593-4fee-adba-e89b8b128ce3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 15:23:35.908047 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:35.908026 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaaefc56-0593-4fee-adba-e89b8b128ce3-kube-api-access-gg4jc" (OuterVolumeSpecName: "kube-api-access-gg4jc") pod "aaaefc56-0593-4fee-adba-e89b8b128ce3" (UID: "aaaefc56-0593-4fee-adba-e89b8b128ce3"). InnerVolumeSpecName "kube-api-access-gg4jc". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:23:36.007452 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:36.007381 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gg4jc\" (UniqueName: \"kubernetes.io/projected/aaaefc56-0593-4fee-adba-e89b8b128ce3-kube-api-access-gg4jc\") on node \"ip-10-0-142-73.ec2.internal\" DevicePath \"\"" May 21 15:23:36.007452 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:36.007405 2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aaaefc56-0593-4fee-adba-e89b8b128ce3-extensions-socket-volume\") on node \"ip-10-0-142-73.ec2.internal\" DevicePath \"\"" May 21 15:23:36.506279 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:36.506248 2563 generic.go:358] "Generic (PLEG): container finished" podID="aaaefc56-0593-4fee-adba-e89b8b128ce3" containerID="aa250b45667fc4a3f61f5fb0cce9911ea0ced6b1ddd6eab8f22ddb4149063233" exitCode=0 May 21 15:23:36.506693 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:36.506308 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sptgq" May 21 15:23:36.506693 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:36.506317 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sptgq" event={"ID":"aaaefc56-0593-4fee-adba-e89b8b128ce3","Type":"ContainerDied","Data":"aa250b45667fc4a3f61f5fb0cce9911ea0ced6b1ddd6eab8f22ddb4149063233"} May 21 15:23:36.506693 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:36.506363 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sptgq" event={"ID":"aaaefc56-0593-4fee-adba-e89b8b128ce3","Type":"ContainerDied","Data":"49e8099adb0d71d8455d1baf343fc4ccbb314927f9f7cce46a97e7f286fa2b6c"} May 21 15:23:36.506693 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:36.506379 2563 scope.go:117] "RemoveContainer" containerID="aa250b45667fc4a3f61f5fb0cce9911ea0ced6b1ddd6eab8f22ddb4149063233" May 21 15:23:36.514486 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:36.514471 2563 scope.go:117] "RemoveContainer" containerID="aa250b45667fc4a3f61f5fb0cce9911ea0ced6b1ddd6eab8f22ddb4149063233" May 21 15:23:36.514717 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:23:36.514699 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa250b45667fc4a3f61f5fb0cce9911ea0ced6b1ddd6eab8f22ddb4149063233\": container with ID starting with aa250b45667fc4a3f61f5fb0cce9911ea0ced6b1ddd6eab8f22ddb4149063233 not found: ID does not exist" containerID="aa250b45667fc4a3f61f5fb0cce9911ea0ced6b1ddd6eab8f22ddb4149063233" May 21 15:23:36.514779 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:36.514729 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa250b45667fc4a3f61f5fb0cce9911ea0ced6b1ddd6eab8f22ddb4149063233"} err="failed to get container status \"aa250b45667fc4a3f61f5fb0cce9911ea0ced6b1ddd6eab8f22ddb4149063233\": rpc error: code = NotFound desc = could not find container \"aa250b45667fc4a3f61f5fb0cce9911ea0ced6b1ddd6eab8f22ddb4149063233\": container with ID starting with aa250b45667fc4a3f61f5fb0cce9911ea0ced6b1ddd6eab8f22ddb4149063233 not found: ID does not exist" May 21 15:23:36.525970 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:36.525850 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sptgq"] May 21 15:23:36.531820 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:36.531799 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sptgq"] May 21 15:23:37.716835 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:37.716801 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aaaefc56-0593-4fee-adba-e89b8b128ce3" path="/var/lib/kubelet/pods/aaaefc56-0593-4fee-adba-e89b8b128ce3/volumes" May 21 15:23:55.995687 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:55.995653 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-2nb29"] May 21 15:23:55.996094 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:55.995960 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaaefc56-0593-4fee-adba-e89b8b128ce3" containerName="manager" May 21 15:23:55.996094 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:55.995974 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaaefc56-0593-4fee-adba-e89b8b128ce3" containerName="manager" May 21 15:23:55.996094 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:55.996031 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="aaaefc56-0593-4fee-adba-e89b8b128ce3" containerName="manager" May 21 15:23:56.001859 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:56.001840 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-2nb29" May 21 15:23:56.003901 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:56.003883 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rrcmn\"" May 21 15:23:56.003901 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:56.003891 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" May 21 15:23:56.007431 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:56.007409 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-2nb29"] May 21 15:23:56.059607 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:56.059570 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcxn8\" (UniqueName: \"kubernetes.io/projected/dc7dca18-a54f-44ab-be42-d4d80d52186c-kube-api-access-rcxn8\") pod \"limitador-limitador-7d549b5b-2nb29\" (UID: \"dc7dca18-a54f-44ab-be42-d4d80d52186c\") " pod="kuadrant-system/limitador-limitador-7d549b5b-2nb29" May 21 15:23:56.059751 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:56.059643 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dc7dca18-a54f-44ab-be42-d4d80d52186c-config-file\") pod \"limitador-limitador-7d549b5b-2nb29\" (UID: \"dc7dca18-a54f-44ab-be42-d4d80d52186c\") " pod="kuadrant-system/limitador-limitador-7d549b5b-2nb29" May 21 15:23:56.085113 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:56.085084 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-2nb29"] May 21 15:23:56.160436 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:56.160404 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rcxn8\" (UniqueName: \"kubernetes.io/projected/dc7dca18-a54f-44ab-be42-d4d80d52186c-kube-api-access-rcxn8\") pod \"limitador-limitador-7d549b5b-2nb29\" (UID: \"dc7dca18-a54f-44ab-be42-d4d80d52186c\") " pod="kuadrant-system/limitador-limitador-7d549b5b-2nb29" May 21 15:23:56.160606 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:56.160462 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dc7dca18-a54f-44ab-be42-d4d80d52186c-config-file\") pod \"limitador-limitador-7d549b5b-2nb29\" (UID: \"dc7dca18-a54f-44ab-be42-d4d80d52186c\") " pod="kuadrant-system/limitador-limitador-7d549b5b-2nb29" May 21 15:23:56.161080 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:56.161059 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dc7dca18-a54f-44ab-be42-d4d80d52186c-config-file\") pod \"limitador-limitador-7d549b5b-2nb29\" (UID: \"dc7dca18-a54f-44ab-be42-d4d80d52186c\") " pod="kuadrant-system/limitador-limitador-7d549b5b-2nb29" May 21 15:23:56.169844 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:56.169811 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcxn8\" (UniqueName: \"kubernetes.io/projected/dc7dca18-a54f-44ab-be42-d4d80d52186c-kube-api-access-rcxn8\") pod \"limitador-limitador-7d549b5b-2nb29\" (UID: \"dc7dca18-a54f-44ab-be42-d4d80d52186c\") " pod="kuadrant-system/limitador-limitador-7d549b5b-2nb29" May 21 15:23:56.312503 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:56.312425 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-2nb29" May 21 15:23:56.453699 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:56.453664 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-2nb29"] May 21 15:23:56.456780 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:23:56.456758 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc7dca18_a54f_44ab_be42_d4d80d52186c.slice/crio-30141eff49dc995e37aebd0e64badd9c6530bd9e175f190d709dbb736f166b00 WatchSource:0}: Error finding container 30141eff49dc995e37aebd0e64badd9c6530bd9e175f190d709dbb736f166b00: Status 404 returned error can't find the container with id 30141eff49dc995e37aebd0e64badd9c6530bd9e175f190d709dbb736f166b00 May 21 15:23:56.570808 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:56.570719 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-2nb29" event={"ID":"dc7dca18-a54f-44ab-be42-d4d80d52186c","Type":"ContainerStarted","Data":"30141eff49dc995e37aebd0e64badd9c6530bd9e175f190d709dbb736f166b00"} May 21 15:23:59.582074 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:59.582038 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-2nb29" event={"ID":"dc7dca18-a54f-44ab-be42-d4d80d52186c","Type":"ContainerStarted","Data":"6a308fd288f87f2364163f135e9fe82733b258efe17f7a8dbd70688e62b91ed7"} May 21 15:23:59.582509 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:59.582093 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-2nb29" May 21 15:23:59.599271 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:23:59.599220 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-2nb29" podStartSLOduration=1.641659958 podStartE2EDuration="4.599207701s" podCreationTimestamp="2026-05-21 15:23:55 +0000 UTC" firstStartedPulling="2026-05-21 15:23:56.458879671 +0000 UTC m=+651.310321903" lastFinishedPulling="2026-05-21 15:23:59.416427409 +0000 UTC m=+654.267869646" observedRunningTime="2026-05-21 15:23:59.597519982 +0000 UTC m=+654.448962236" watchObservedRunningTime="2026-05-21 15:23:59.599207701 +0000 UTC m=+654.450649955" May 21 15:24:10.586542 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:10.586508 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-2nb29" May 21 15:24:11.710734 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:11.710704 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-2nb29"] May 21 15:24:11.711159 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:11.710890 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-2nb29" podUID="dc7dca18-a54f-44ab-be42-d4d80d52186c" containerName="limitador" containerID="cri-o://6a308fd288f87f2364163f135e9fe82733b258efe17f7a8dbd70688e62b91ed7" gracePeriod=30 May 21 15:24:12.244113 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:12.244092 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-2nb29" May 21 15:24:12.286133 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:12.286070 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcxn8\" (UniqueName: \"kubernetes.io/projected/dc7dca18-a54f-44ab-be42-d4d80d52186c-kube-api-access-rcxn8\") pod \"dc7dca18-a54f-44ab-be42-d4d80d52186c\" (UID: \"dc7dca18-a54f-44ab-be42-d4d80d52186c\") " May 21 15:24:12.286258 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:12.286131 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dc7dca18-a54f-44ab-be42-d4d80d52186c-config-file\") pod \"dc7dca18-a54f-44ab-be42-d4d80d52186c\" (UID: \"dc7dca18-a54f-44ab-be42-d4d80d52186c\") " May 21 15:24:12.286502 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:12.286469 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc7dca18-a54f-44ab-be42-d4d80d52186c-config-file" (OuterVolumeSpecName: "config-file") pod "dc7dca18-a54f-44ab-be42-d4d80d52186c" (UID: "dc7dca18-a54f-44ab-be42-d4d80d52186c"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 15:24:12.287989 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:12.287969 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc7dca18-a54f-44ab-be42-d4d80d52186c-kube-api-access-rcxn8" (OuterVolumeSpecName: "kube-api-access-rcxn8") pod "dc7dca18-a54f-44ab-be42-d4d80d52186c" (UID: "dc7dca18-a54f-44ab-be42-d4d80d52186c"). InnerVolumeSpecName "kube-api-access-rcxn8". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:24:12.387519 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:12.387490 2563 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dc7dca18-a54f-44ab-be42-d4d80d52186c-config-file\") on node \"ip-10-0-142-73.ec2.internal\" DevicePath \"\"" May 21 15:24:12.387519 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:12.387514 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcxn8\" (UniqueName: \"kubernetes.io/projected/dc7dca18-a54f-44ab-be42-d4d80d52186c-kube-api-access-rcxn8\") on node \"ip-10-0-142-73.ec2.internal\" DevicePath \"\"" May 21 15:24:12.625210 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:12.625142 2563 generic.go:358] "Generic (PLEG): container finished" podID="dc7dca18-a54f-44ab-be42-d4d80d52186c" containerID="6a308fd288f87f2364163f135e9fe82733b258efe17f7a8dbd70688e62b91ed7" exitCode=0 May 21 15:24:12.625351 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:12.625207 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-2nb29" May 21 15:24:12.625351 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:12.625224 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-2nb29" event={"ID":"dc7dca18-a54f-44ab-be42-d4d80d52186c","Type":"ContainerDied","Data":"6a308fd288f87f2364163f135e9fe82733b258efe17f7a8dbd70688e62b91ed7"} May 21 15:24:12.625351 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:12.625261 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-2nb29" event={"ID":"dc7dca18-a54f-44ab-be42-d4d80d52186c","Type":"ContainerDied","Data":"30141eff49dc995e37aebd0e64badd9c6530bd9e175f190d709dbb736f166b00"} May 21 15:24:12.625351 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:12.625276 2563 scope.go:117] "RemoveContainer" containerID="6a308fd288f87f2364163f135e9fe82733b258efe17f7a8dbd70688e62b91ed7" May 21 15:24:12.633253 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:12.633232 2563 scope.go:117] "RemoveContainer" containerID="6a308fd288f87f2364163f135e9fe82733b258efe17f7a8dbd70688e62b91ed7" May 21 15:24:12.633515 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:24:12.633494 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a308fd288f87f2364163f135e9fe82733b258efe17f7a8dbd70688e62b91ed7\": container with ID starting with 6a308fd288f87f2364163f135e9fe82733b258efe17f7a8dbd70688e62b91ed7 not found: ID does not exist" containerID="6a308fd288f87f2364163f135e9fe82733b258efe17f7a8dbd70688e62b91ed7" May 21 15:24:12.633576 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:12.633528 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a308fd288f87f2364163f135e9fe82733b258efe17f7a8dbd70688e62b91ed7"} err="failed to get container status \"6a308fd288f87f2364163f135e9fe82733b258efe17f7a8dbd70688e62b91ed7\": rpc error: code = NotFound desc = could not find container \"6a308fd288f87f2364163f135e9fe82733b258efe17f7a8dbd70688e62b91ed7\": container with ID starting with 6a308fd288f87f2364163f135e9fe82733b258efe17f7a8dbd70688e62b91ed7 not found: ID does not exist" May 21 15:24:12.644284 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:12.644261 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-2nb29"] May 21 15:24:12.648687 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:12.648666 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-2nb29"] May 21 15:24:13.715876 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:13.715842 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc7dca18-a54f-44ab-be42-d4d80d52186c" path="/var/lib/kubelet/pods/dc7dca18-a54f-44ab-be42-d4d80d52186c/volumes" May 21 15:24:17.051552 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:17.051517 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-h7w7q"] May 21 15:24:17.052100 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:17.051955 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc7dca18-a54f-44ab-be42-d4d80d52186c" containerName="limitador" May 21 15:24:17.052100 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:17.051976 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc7dca18-a54f-44ab-be42-d4d80d52186c" containerName="limitador" May 21 15:24:17.052100 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:17.052073 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="dc7dca18-a54f-44ab-be42-d4d80d52186c" containerName="limitador" May 21 15:24:17.056496 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:17.056475 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-h7w7q" May 21 15:24:17.063129 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:17.062945 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" May 21 15:24:17.063464 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:17.063449 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-w6jkg\"" May 21 15:24:17.064747 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:17.064724 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-h7w7q"] May 21 15:24:17.122233 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:17.122210 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ac139ef9-b591-41fa-8087-f4d28061a060-data\") pod \"postgres-68c4fbbd6f-h7w7q\" (UID: \"ac139ef9-b591-41fa-8087-f4d28061a060\") " pod="opendatahub/postgres-68c4fbbd6f-h7w7q" May 21 15:24:17.122398 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:17.122243 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chmh4\" (UniqueName: \"kubernetes.io/projected/ac139ef9-b591-41fa-8087-f4d28061a060-kube-api-access-chmh4\") pod \"postgres-68c4fbbd6f-h7w7q\" (UID: \"ac139ef9-b591-41fa-8087-f4d28061a060\") " pod="opendatahub/postgres-68c4fbbd6f-h7w7q" May 21 15:24:17.222604 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:17.222571 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ac139ef9-b591-41fa-8087-f4d28061a060-data\") pod \"postgres-68c4fbbd6f-h7w7q\" (UID: \"ac139ef9-b591-41fa-8087-f4d28061a060\") " pod="opendatahub/postgres-68c4fbbd6f-h7w7q" May 21 15:24:17.222604 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:17.222606 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-chmh4\" (UniqueName: \"kubernetes.io/projected/ac139ef9-b591-41fa-8087-f4d28061a060-kube-api-access-chmh4\") pod \"postgres-68c4fbbd6f-h7w7q\" (UID: \"ac139ef9-b591-41fa-8087-f4d28061a060\") " pod="opendatahub/postgres-68c4fbbd6f-h7w7q" May 21 15:24:17.222938 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:17.222906 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ac139ef9-b591-41fa-8087-f4d28061a060-data\") pod \"postgres-68c4fbbd6f-h7w7q\" (UID: \"ac139ef9-b591-41fa-8087-f4d28061a060\") " pod="opendatahub/postgres-68c4fbbd6f-h7w7q" May 21 15:24:17.231144 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:17.231125 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chmh4\" (UniqueName: \"kubernetes.io/projected/ac139ef9-b591-41fa-8087-f4d28061a060-kube-api-access-chmh4\") pod \"postgres-68c4fbbd6f-h7w7q\" (UID: \"ac139ef9-b591-41fa-8087-f4d28061a060\") " pod="opendatahub/postgres-68c4fbbd6f-h7w7q" May 21 15:24:17.368073 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:17.367985 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-h7w7q" May 21 15:24:17.492203 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:17.492172 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-h7w7q"] May 21 15:24:17.495208 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:24:17.495179 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac139ef9_b591_41fa_8087_f4d28061a060.slice/crio-d492d8c682420915977e6429ea6e5211f60e0f156732fe481b4653fd6f53568f WatchSource:0}: Error finding container d492d8c682420915977e6429ea6e5211f60e0f156732fe481b4653fd6f53568f: Status 404 returned error can't find the container with id d492d8c682420915977e6429ea6e5211f60e0f156732fe481b4653fd6f53568f May 21 15:24:17.641646 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:17.641568 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-h7w7q" event={"ID":"ac139ef9-b591-41fa-8087-f4d28061a060","Type":"ContainerStarted","Data":"d492d8c682420915977e6429ea6e5211f60e0f156732fe481b4653fd6f53568f"} May 21 15:24:22.660426 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:22.660392 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-h7w7q" event={"ID":"ac139ef9-b591-41fa-8087-f4d28061a060","Type":"ContainerStarted","Data":"e065fbb20548b761b758afff321d7e36f5546b1a1f9a04f2c1d63efc0a6c0a6b"} May 21 15:24:22.660775 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:22.660513 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-h7w7q" May 21 15:24:22.678190 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:22.678144 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-h7w7q" podStartSLOduration=0.624183888 podStartE2EDuration="5.678129758s" podCreationTimestamp="2026-05-21 15:24:17 +0000 UTC" firstStartedPulling="2026-05-21 15:24:17.496607019 +0000 UTC m=+672.348049255" lastFinishedPulling="2026-05-21 15:24:22.550552887 +0000 UTC m=+677.401995125" observedRunningTime="2026-05-21 15:24:22.676461185 +0000 UTC m=+677.527903440" watchObservedRunningTime="2026-05-21 15:24:22.678129758 +0000 UTC m=+677.529572012" May 21 15:24:28.691096 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:28.691066 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-h7w7q" May 21 15:24:33.708352 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:33.708314 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-vrvqz"] May 21 15:24:33.820131 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:33.820100 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-vrvqz" May 21 15:24:33.822443 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:33.822420 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4gh9k\"" May 21 15:24:33.822570 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:33.822449 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 21 15:24:33.825290 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:33.825271 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-vrvqz"] May 21 15:24:33.845974 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:33.845948 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bf576fcc5-gx9cl"] May 21 15:24:33.866648 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:33.866565 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bf576fcc5-gx9cl"] May 21 15:24:33.866776 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:33.866662 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bf576fcc5-gx9cl" May 21 15:24:33.959475 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:33.959405 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmh64\" (UniqueName: \"kubernetes.io/projected/92ec8b81-54cb-4876-964f-63924ec3b4fb-kube-api-access-lmh64\") pod \"maas-controller-7bf576fcc5-gx9cl\" (UID: \"92ec8b81-54cb-4876-964f-63924ec3b4fb\") " pod="opendatahub/maas-controller-7bf576fcc5-gx9cl" May 21 15:24:33.959597 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:33.959477 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs49x\" (UniqueName: \"kubernetes.io/projected/9a7e62ad-693c-4971-9977-e11c7189ce51-kube-api-access-zs49x\") pod \"maas-controller-68fb5d86bc-vrvqz\" (UID: \"9a7e62ad-693c-4971-9977-e11c7189ce51\") " pod="opendatahub/maas-controller-68fb5d86bc-vrvqz" May 21 15:24:33.971141 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:33.971115 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-vrvqz"] May 21 15:24:33.971315 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:24:33.971297 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-zs49x], unattached volumes=[], failed to process volumes=[]: context canceled" pod="opendatahub/maas-controller-68fb5d86bc-vrvqz" podUID="9a7e62ad-693c-4971-9977-e11c7189ce51" May 21 15:24:33.999280 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:33.999252 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-585598586b-g428x"] May 21 15:24:34.032968 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:34.032940 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-585598586b-g428x"] May 21 15:24:34.033088 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:34.033047 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-585598586b-g428x" May 21 15:24:34.060823 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:34.060795 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lmh64\" (UniqueName: \"kubernetes.io/projected/92ec8b81-54cb-4876-964f-63924ec3b4fb-kube-api-access-lmh64\") pod \"maas-controller-7bf576fcc5-gx9cl\" (UID: \"92ec8b81-54cb-4876-964f-63924ec3b4fb\") " pod="opendatahub/maas-controller-7bf576fcc5-gx9cl" May 21 15:24:34.060928 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:34.060852 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zs49x\" (UniqueName: \"kubernetes.io/projected/9a7e62ad-693c-4971-9977-e11c7189ce51-kube-api-access-zs49x\") pod \"maas-controller-68fb5d86bc-vrvqz\" (UID: \"9a7e62ad-693c-4971-9977-e11c7189ce51\") " pod="opendatahub/maas-controller-68fb5d86bc-vrvqz" May 21 15:24:34.069051 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:34.069023 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmh64\" (UniqueName: \"kubernetes.io/projected/92ec8b81-54cb-4876-964f-63924ec3b4fb-kube-api-access-lmh64\") pod \"maas-controller-7bf576fcc5-gx9cl\" (UID: \"92ec8b81-54cb-4876-964f-63924ec3b4fb\") " pod="opendatahub/maas-controller-7bf576fcc5-gx9cl" May 21 15:24:34.069163 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:34.069099 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs49x\" (UniqueName: \"kubernetes.io/projected/9a7e62ad-693c-4971-9977-e11c7189ce51-kube-api-access-zs49x\") pod \"maas-controller-68fb5d86bc-vrvqz\" (UID: \"9a7e62ad-693c-4971-9977-e11c7189ce51\") " pod="opendatahub/maas-controller-68fb5d86bc-vrvqz" May 21 15:24:34.161470 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:34.161432 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5vdm\" (UniqueName: \"kubernetes.io/projected/5e80a178-a98b-4804-a5f3-ad975b37cf08-kube-api-access-l5vdm\") pod \"maas-controller-585598586b-g428x\" (UID: \"5e80a178-a98b-4804-a5f3-ad975b37cf08\") " pod="opendatahub/maas-controller-585598586b-g428x" May 21 15:24:34.179400 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:34.179377 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bf576fcc5-gx9cl" May 21 15:24:34.262869 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:34.262830 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5vdm\" (UniqueName: \"kubernetes.io/projected/5e80a178-a98b-4804-a5f3-ad975b37cf08-kube-api-access-l5vdm\") pod \"maas-controller-585598586b-g428x\" (UID: \"5e80a178-a98b-4804-a5f3-ad975b37cf08\") " pod="opendatahub/maas-controller-585598586b-g428x" May 21 15:24:34.270774 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:34.270749 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5vdm\" (UniqueName: \"kubernetes.io/projected/5e80a178-a98b-4804-a5f3-ad975b37cf08-kube-api-access-l5vdm\") pod \"maas-controller-585598586b-g428x\" (UID: \"5e80a178-a98b-4804-a5f3-ad975b37cf08\") " pod="opendatahub/maas-controller-585598586b-g428x" May 21 15:24:34.304761 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:34.304737 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bf576fcc5-gx9cl"] May 21 15:24:34.307894 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:24:34.307857 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92ec8b81_54cb_4876_964f_63924ec3b4fb.slice/crio-6c2972602ca4d8fadf752424591b5f73c115070a79e15aba256e909617ed2c9c WatchSource:0}: Error finding container 6c2972602ca4d8fadf752424591b5f73c115070a79e15aba256e909617ed2c9c: Status 404 returned error can't find the container with id 6c2972602ca4d8fadf752424591b5f73c115070a79e15aba256e909617ed2c9c May 21 15:24:34.342698 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:34.342681 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-585598586b-g428x" May 21 15:24:34.472039 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:34.472004 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-585598586b-g428x"] May 21 15:24:34.478758 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:24:34.478728 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e80a178_a98b_4804_a5f3_ad975b37cf08.slice/crio-e15512e6d538b8ae427f66df36125d1596455d5d2603989cf943ee858feb5f9c WatchSource:0}: Error finding container e15512e6d538b8ae427f66df36125d1596455d5d2603989cf943ee858feb5f9c: Status 404 returned error can't find the container with id e15512e6d538b8ae427f66df36125d1596455d5d2603989cf943ee858feb5f9c May 21 15:24:34.697484 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:34.697443 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-585598586b-g428x" event={"ID":"5e80a178-a98b-4804-a5f3-ad975b37cf08","Type":"ContainerStarted","Data":"e15512e6d538b8ae427f66df36125d1596455d5d2603989cf943ee858feb5f9c"} May 21 15:24:34.698453 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:34.698425 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bf576fcc5-gx9cl" event={"ID":"92ec8b81-54cb-4876-964f-63924ec3b4fb","Type":"ContainerStarted","Data":"6c2972602ca4d8fadf752424591b5f73c115070a79e15aba256e909617ed2c9c"} May 21 15:24:34.698453 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:34.698445 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-vrvqz" May 21 15:24:34.702925 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:34.702909 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-vrvqz" May 21 15:24:34.766908 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:34.766860 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zs49x\" (UniqueName: \"kubernetes.io/projected/9a7e62ad-693c-4971-9977-e11c7189ce51-kube-api-access-zs49x\") pod \"9a7e62ad-693c-4971-9977-e11c7189ce51\" (UID: \"9a7e62ad-693c-4971-9977-e11c7189ce51\") " May 21 15:24:34.768968 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:34.768947 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a7e62ad-693c-4971-9977-e11c7189ce51-kube-api-access-zs49x" (OuterVolumeSpecName: "kube-api-access-zs49x") pod "9a7e62ad-693c-4971-9977-e11c7189ce51" (UID: "9a7e62ad-693c-4971-9977-e11c7189ce51"). InnerVolumeSpecName "kube-api-access-zs49x". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:24:34.867466 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:34.867439 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zs49x\" (UniqueName: \"kubernetes.io/projected/9a7e62ad-693c-4971-9977-e11c7189ce51-kube-api-access-zs49x\") on node \"ip-10-0-142-73.ec2.internal\" DevicePath \"\"" May 21 15:24:35.703549 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:35.703516 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-vrvqz" May 21 15:24:35.775263 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:35.775024 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-vrvqz"] May 21 15:24:35.779290 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:35.779241 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-vrvqz"] May 21 15:24:37.711513 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:37.711481 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-585598586b-g428x" event={"ID":"5e80a178-a98b-4804-a5f3-ad975b37cf08","Type":"ContainerStarted","Data":"9a3aa360023dddb39591ca01fb398466212ffcc63dd2367ce3e60847e2b0e4c7"} May 21 15:24:37.711952 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:37.711718 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-585598586b-g428x" May 21 15:24:37.716010 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:37.715988 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a7e62ad-693c-4971-9977-e11c7189ce51" path="/var/lib/kubelet/pods/9a7e62ad-693c-4971-9977-e11c7189ce51/volumes" May 21 15:24:37.716158 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:37.716142 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bf576fcc5-gx9cl" event={"ID":"92ec8b81-54cb-4876-964f-63924ec3b4fb","Type":"ContainerStarted","Data":"e531e1a3e2c96ae1cd24e8c1d634e5a3a2dba904f08f7d61d31d35ed0a0b9809"} May 21 15:24:37.716226 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:37.716168 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bf576fcc5-gx9cl" May 21 15:24:37.729546 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:37.729511 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-585598586b-g428x" podStartSLOduration=2.010205945 podStartE2EDuration="4.7294997s" podCreationTimestamp="2026-05-21 15:24:33 +0000 UTC" firstStartedPulling="2026-05-21 15:24:34.480035772 +0000 UTC m=+689.331478005" lastFinishedPulling="2026-05-21 15:24:37.199329527 +0000 UTC m=+692.050771760" observedRunningTime="2026-05-21 15:24:37.727884362 +0000 UTC m=+692.579326601" watchObservedRunningTime="2026-05-21 15:24:37.7294997 +0000 UTC m=+692.580941955" May 21 15:24:37.744254 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:37.744221 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7bf576fcc5-gx9cl" podStartSLOduration=1.8597343450000001 podStartE2EDuration="4.744211658s" podCreationTimestamp="2026-05-21 15:24:33 +0000 UTC" firstStartedPulling="2026-05-21 15:24:34.30902393 +0000 UTC m=+689.160466163" lastFinishedPulling="2026-05-21 15:24:37.193501231 +0000 UTC m=+692.044943476" observedRunningTime="2026-05-21 15:24:37.742933367 +0000 UTC m=+692.594375623" watchObservedRunningTime="2026-05-21 15:24:37.744211658 +0000 UTC m=+692.595653913" May 21 15:24:39.454872 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:39.454840 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7689f6966b-2cpl6"] May 21 15:24:39.458832 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:39.458816 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7689f6966b-2cpl6" May 21 15:24:39.461404 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:39.461381 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" May 21 15:24:39.470405 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:39.470384 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7689f6966b-2cpl6"] May 21 15:24:39.613309 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:39.613274 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf6zd\" (UniqueName: \"kubernetes.io/projected/ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca-kube-api-access-pf6zd\") pod \"maas-api-7689f6966b-2cpl6\" (UID: \"ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca\") " pod="opendatahub/maas-api-7689f6966b-2cpl6" May 21 15:24:39.613482 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:39.613323 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca-maas-api-tls\") pod \"maas-api-7689f6966b-2cpl6\" (UID: \"ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca\") " pod="opendatahub/maas-api-7689f6966b-2cpl6" May 21 15:24:39.714745 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:39.714661 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pf6zd\" (UniqueName: \"kubernetes.io/projected/ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca-kube-api-access-pf6zd\") pod \"maas-api-7689f6966b-2cpl6\" (UID: \"ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca\") " pod="opendatahub/maas-api-7689f6966b-2cpl6" May 21 15:24:39.714745 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:39.714740 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca-maas-api-tls\") pod \"maas-api-7689f6966b-2cpl6\" (UID: \"ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca\") " pod="opendatahub/maas-api-7689f6966b-2cpl6" May 21 15:24:39.714969 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:24:39.714909 2563 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found May 21 15:24:39.715028 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:24:39.715019 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca-maas-api-tls podName:ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca nodeName:}" failed. No retries permitted until 2026-05-21 15:24:40.214994575 +0000 UTC m=+695.066436815 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca-maas-api-tls") pod "maas-api-7689f6966b-2cpl6" (UID: "ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca") : secret "maas-api-serving-cert" not found May 21 15:24:39.723589 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:39.723557 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf6zd\" (UniqueName: \"kubernetes.io/projected/ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca-kube-api-access-pf6zd\") pod \"maas-api-7689f6966b-2cpl6\" (UID: \"ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca\") " pod="opendatahub/maas-api-7689f6966b-2cpl6" May 21 15:24:39.809426 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:39.809397 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-sxrmm"] May 21 15:24:39.812470 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:39.812453 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-sxrmm" May 21 15:24:39.814559 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:39.814536 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" May 21 15:24:39.814684 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:39.814536 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-mbdrz\"" May 21 15:24:39.826660 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:39.826639 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-sxrmm"] May 21 15:24:39.916800 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:39.916767 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcdfv\" (UniqueName: \"kubernetes.io/projected/f24e9722-6841-40a6-9986-c38e77c95b6a-kube-api-access-mcdfv\") pod \"payload-processing-58b6c8fdc7-sxrmm\" (UID: \"f24e9722-6841-40a6-9986-c38e77c95b6a\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-sxrmm" May 21 15:24:40.018101 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:40.018065 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mcdfv\" (UniqueName: \"kubernetes.io/projected/f24e9722-6841-40a6-9986-c38e77c95b6a-kube-api-access-mcdfv\") pod \"payload-processing-58b6c8fdc7-sxrmm\" (UID: \"f24e9722-6841-40a6-9986-c38e77c95b6a\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-sxrmm" May 21 15:24:40.031539 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:40.031512 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcdfv\" (UniqueName: \"kubernetes.io/projected/f24e9722-6841-40a6-9986-c38e77c95b6a-kube-api-access-mcdfv\") pod \"payload-processing-58b6c8fdc7-sxrmm\" (UID: \"f24e9722-6841-40a6-9986-c38e77c95b6a\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-sxrmm" May 21 15:24:40.122691 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:40.122660 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-sxrmm" May 21 15:24:40.220228 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:40.220194 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca-maas-api-tls\") pod \"maas-api-7689f6966b-2cpl6\" (UID: \"ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca\") " pod="opendatahub/maas-api-7689f6966b-2cpl6" May 21 15:24:40.222857 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:40.222832 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca-maas-api-tls\") pod \"maas-api-7689f6966b-2cpl6\" (UID: \"ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca\") " pod="opendatahub/maas-api-7689f6966b-2cpl6" May 21 15:24:40.250153 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:40.250126 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-sxrmm"] May 21 15:24:40.252747 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:24:40.252726 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf24e9722_6841_40a6_9986_c38e77c95b6a.slice/crio-87bf6a5f3012ad492ebe3d5d46517bc033bbe83e6c43baccc73ba0e16defaf4f WatchSource:0}: Error finding container 87bf6a5f3012ad492ebe3d5d46517bc033bbe83e6c43baccc73ba0e16defaf4f: Status 404 returned error can't find the container with id 87bf6a5f3012ad492ebe3d5d46517bc033bbe83e6c43baccc73ba0e16defaf4f May 21 15:24:40.369655 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:40.369605 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7689f6966b-2cpl6" May 21 15:24:40.494135 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:40.494104 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7689f6966b-2cpl6"] May 21 15:24:40.497058 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:24:40.497030 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab2c8eb5_0828_4c4a_be7c_aa17e14fb5ca.slice/crio-bcc16871a619807df57b6d32b2bd88e73c96ecd44ca5453a9c3a34a4522aa85d WatchSource:0}: Error finding container bcc16871a619807df57b6d32b2bd88e73c96ecd44ca5453a9c3a34a4522aa85d: Status 404 returned error can't find the container with id bcc16871a619807df57b6d32b2bd88e73c96ecd44ca5453a9c3a34a4522aa85d May 21 15:24:40.724022 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:40.723992 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7689f6966b-2cpl6" event={"ID":"ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca","Type":"ContainerStarted","Data":"bcc16871a619807df57b6d32b2bd88e73c96ecd44ca5453a9c3a34a4522aa85d"} May 21 15:24:40.725114 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:40.725084 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-sxrmm" event={"ID":"f24e9722-6841-40a6-9986-c38e77c95b6a","Type":"ContainerStarted","Data":"87bf6a5f3012ad492ebe3d5d46517bc033bbe83e6c43baccc73ba0e16defaf4f"} May 21 15:24:43.736217 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:43.736183 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7689f6966b-2cpl6" event={"ID":"ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca","Type":"ContainerStarted","Data":"d55957776fc7e3b5826d7a873bb30d984b6afdd7ce8edfb3f151824c09c94f76"} May 21 15:24:43.736217 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:43.736221 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7689f6966b-2cpl6" May 21 15:24:43.737447 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:43.737420 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-sxrmm" event={"ID":"f24e9722-6841-40a6-9986-c38e77c95b6a","Type":"ContainerStarted","Data":"6c9cf60541c06988155f9ed5dd23ae84a448bbd6da1d56b3bfaf69ca83675624"} May 21 15:24:43.737570 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:43.737551 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-sxrmm" May 21 15:24:43.758960 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:43.758921 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-7689f6966b-2cpl6" podStartSLOduration=2.417684439 podStartE2EDuration="4.758908555s" podCreationTimestamp="2026-05-21 15:24:39 +0000 UTC" firstStartedPulling="2026-05-21 15:24:40.498268956 +0000 UTC m=+695.349711189" lastFinishedPulling="2026-05-21 15:24:42.839493068 +0000 UTC m=+697.690935305" observedRunningTime="2026-05-21 15:24:43.757563002 +0000 UTC m=+698.609005269" watchObservedRunningTime="2026-05-21 15:24:43.758908555 +0000 UTC m=+698.610350810" May 21 15:24:43.793680 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:43.793640 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-sxrmm" podStartSLOduration=2.256425923 podStartE2EDuration="4.793631128s" podCreationTimestamp="2026-05-21 15:24:39 +0000 UTC" firstStartedPulling="2026-05-21 15:24:40.254504971 +0000 UTC m=+695.105947207" lastFinishedPulling="2026-05-21 15:24:42.791710178 +0000 UTC m=+697.643152412" observedRunningTime="2026-05-21 15:24:43.791687408 +0000 UTC m=+698.643129660" watchObservedRunningTime="2026-05-21 15:24:43.793631128 +0000 UTC m=+698.645073383" May 21 15:24:48.720902 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:48.720871 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-585598586b-g428x" May 21 15:24:48.721595 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:48.721167 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bf576fcc5-gx9cl" May 21 15:24:48.781859 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:48.781834 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bf576fcc5-gx9cl"] May 21 15:24:48.782018 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:48.781997 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7bf576fcc5-gx9cl" podUID="92ec8b81-54cb-4876-964f-63924ec3b4fb" containerName="manager" containerID="cri-o://e531e1a3e2c96ae1cd24e8c1d634e5a3a2dba904f08f7d61d31d35ed0a0b9809" gracePeriod=30 May 21 15:24:48.973618 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:48.973527 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58c48f5cb5-rwq4t"] May 21 15:24:48.980169 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:48.980135 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58c48f5cb5-rwq4t" May 21 15:24:48.985001 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:48.984974 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58c48f5cb5-rwq4t"] May 21 15:24:49.023327 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:49.023308 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bf576fcc5-gx9cl" May 21 15:24:49.093375 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:49.093320 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnm94\" (UniqueName: \"kubernetes.io/projected/a9c5f5f3-71b2-4970-858b-c69ab1e2e50a-kube-api-access-hnm94\") pod \"maas-controller-58c48f5cb5-rwq4t\" (UID: \"a9c5f5f3-71b2-4970-858b-c69ab1e2e50a\") " pod="opendatahub/maas-controller-58c48f5cb5-rwq4t" May 21 15:24:49.194269 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:49.194238 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmh64\" (UniqueName: \"kubernetes.io/projected/92ec8b81-54cb-4876-964f-63924ec3b4fb-kube-api-access-lmh64\") pod \"92ec8b81-54cb-4876-964f-63924ec3b4fb\" (UID: \"92ec8b81-54cb-4876-964f-63924ec3b4fb\") " May 21 15:24:49.194425 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:49.194321 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hnm94\" (UniqueName: \"kubernetes.io/projected/a9c5f5f3-71b2-4970-858b-c69ab1e2e50a-kube-api-access-hnm94\") pod \"maas-controller-58c48f5cb5-rwq4t\" (UID: \"a9c5f5f3-71b2-4970-858b-c69ab1e2e50a\") " pod="opendatahub/maas-controller-58c48f5cb5-rwq4t" May 21 15:24:49.196362 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:49.196318 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92ec8b81-54cb-4876-964f-63924ec3b4fb-kube-api-access-lmh64" (OuterVolumeSpecName: "kube-api-access-lmh64") pod "92ec8b81-54cb-4876-964f-63924ec3b4fb" (UID: "92ec8b81-54cb-4876-964f-63924ec3b4fb"). InnerVolumeSpecName "kube-api-access-lmh64". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:24:49.203637 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:49.203614 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnm94\" (UniqueName: \"kubernetes.io/projected/a9c5f5f3-71b2-4970-858b-c69ab1e2e50a-kube-api-access-hnm94\") pod \"maas-controller-58c48f5cb5-rwq4t\" (UID: \"a9c5f5f3-71b2-4970-858b-c69ab1e2e50a\") " pod="opendatahub/maas-controller-58c48f5cb5-rwq4t" May 21 15:24:49.293124 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:49.293059 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58c48f5cb5-rwq4t" May 21 15:24:49.294928 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:49.294911 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmh64\" (UniqueName: \"kubernetes.io/projected/92ec8b81-54cb-4876-964f-63924ec3b4fb-kube-api-access-lmh64\") on node \"ip-10-0-142-73.ec2.internal\" DevicePath \"\"" May 21 15:24:49.414977 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:49.414952 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58c48f5cb5-rwq4t"] May 21 15:24:49.417517 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:24:49.417489 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9c5f5f3_71b2_4970_858b_c69ab1e2e50a.slice/crio-fd48f079a45ed29455580f1c0a20d3ec49f4027d3abd23fca7dc34530a5ce1fe WatchSource:0}: Error finding container fd48f079a45ed29455580f1c0a20d3ec49f4027d3abd23fca7dc34530a5ce1fe: Status 404 returned error can't find the container with id fd48f079a45ed29455580f1c0a20d3ec49f4027d3abd23fca7dc34530a5ce1fe May 21 15:24:49.746900 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:49.746875 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7689f6966b-2cpl6" May 21 15:24:49.757451 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:49.757427 2563 generic.go:358] "Generic (PLEG): container finished" podID="92ec8b81-54cb-4876-964f-63924ec3b4fb" containerID="e531e1a3e2c96ae1cd24e8c1d634e5a3a2dba904f08f7d61d31d35ed0a0b9809" exitCode=0 May 21 15:24:49.757586 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:49.757479 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bf576fcc5-gx9cl" May 21 15:24:49.757586 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:49.757521 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bf576fcc5-gx9cl" event={"ID":"92ec8b81-54cb-4876-964f-63924ec3b4fb","Type":"ContainerDied","Data":"e531e1a3e2c96ae1cd24e8c1d634e5a3a2dba904f08f7d61d31d35ed0a0b9809"} May 21 15:24:49.757586 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:49.757565 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bf576fcc5-gx9cl" event={"ID":"92ec8b81-54cb-4876-964f-63924ec3b4fb","Type":"ContainerDied","Data":"6c2972602ca4d8fadf752424591b5f73c115070a79e15aba256e909617ed2c9c"} May 21 15:24:49.757586 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:49.757586 2563 scope.go:117] "RemoveContainer" containerID="e531e1a3e2c96ae1cd24e8c1d634e5a3a2dba904f08f7d61d31d35ed0a0b9809" May 21 15:24:49.758609 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:49.758590 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58c48f5cb5-rwq4t" event={"ID":"a9c5f5f3-71b2-4970-858b-c69ab1e2e50a","Type":"ContainerStarted","Data":"fd48f079a45ed29455580f1c0a20d3ec49f4027d3abd23fca7dc34530a5ce1fe"} May 21 15:24:49.767634 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:49.767581 2563 scope.go:117] "RemoveContainer" containerID="e531e1a3e2c96ae1cd24e8c1d634e5a3a2dba904f08f7d61d31d35ed0a0b9809" May 21 15:24:49.767990 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:24:49.767971 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e531e1a3e2c96ae1cd24e8c1d634e5a3a2dba904f08f7d61d31d35ed0a0b9809\": container with ID starting with e531e1a3e2c96ae1cd24e8c1d634e5a3a2dba904f08f7d61d31d35ed0a0b9809 not found: ID does not exist" containerID="e531e1a3e2c96ae1cd24e8c1d634e5a3a2dba904f08f7d61d31d35ed0a0b9809" May 21 15:24:49.768094 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:49.767996 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e531e1a3e2c96ae1cd24e8c1d634e5a3a2dba904f08f7d61d31d35ed0a0b9809"} err="failed to get container status \"e531e1a3e2c96ae1cd24e8c1d634e5a3a2dba904f08f7d61d31d35ed0a0b9809\": rpc error: code = NotFound desc = could not find container \"e531e1a3e2c96ae1cd24e8c1d634e5a3a2dba904f08f7d61d31d35ed0a0b9809\": container with ID starting with e531e1a3e2c96ae1cd24e8c1d634e5a3a2dba904f08f7d61d31d35ed0a0b9809 not found: ID does not exist" May 21 15:24:49.778847 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:49.778825 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bf576fcc5-gx9cl"] May 21 15:24:49.785940 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:49.785920 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7bf576fcc5-gx9cl"] May 21 15:24:50.764438 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:50.764404 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58c48f5cb5-rwq4t" event={"ID":"a9c5f5f3-71b2-4970-858b-c69ab1e2e50a","Type":"ContainerStarted","Data":"38cc4296a881b95c6a2294b6f835e0617bb14c67374f085c72c32d87920491a6"} May 21 15:24:50.764817 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:50.764530 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58c48f5cb5-rwq4t" May 21 15:24:50.784092 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:50.784046 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-58c48f5cb5-rwq4t" podStartSLOduration=2.434264579 podStartE2EDuration="2.784033144s" podCreationTimestamp="2026-05-21 15:24:48 +0000 UTC" firstStartedPulling="2026-05-21 15:24:49.418743542 +0000 UTC m=+704.270185778" lastFinishedPulling="2026-05-21 15:24:49.768512095 +0000 UTC m=+704.619954343" observedRunningTime="2026-05-21 15:24:50.782186848 +0000 UTC m=+705.633629104" watchObservedRunningTime="2026-05-21 15:24:50.784033144 +0000 UTC m=+705.635475398" May 21 15:24:51.717810 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:51.717777 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92ec8b81-54cb-4876-964f-63924ec3b4fb" path="/var/lib/kubelet/pods/92ec8b81-54cb-4876-964f-63924ec3b4fb/volumes" May 21 15:24:54.743468 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:24:54.743435 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-sxrmm" May 21 15:25:01.772746 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:01.772715 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58c48f5cb5-rwq4t" May 21 15:25:01.810984 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:01.810948 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-585598586b-g428x"] May 21 15:25:01.811207 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:01.811183 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-585598586b-g428x" podUID="5e80a178-a98b-4804-a5f3-ad975b37cf08" containerName="manager" containerID="cri-o://9a3aa360023dddb39591ca01fb398466212ffcc63dd2367ce3e60847e2b0e4c7" gracePeriod=30 May 21 15:25:02.056540 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:02.056517 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-585598586b-g428x" May 21 15:25:02.093127 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:02.093096 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5vdm\" (UniqueName: \"kubernetes.io/projected/5e80a178-a98b-4804-a5f3-ad975b37cf08-kube-api-access-l5vdm\") pod \"5e80a178-a98b-4804-a5f3-ad975b37cf08\" (UID: \"5e80a178-a98b-4804-a5f3-ad975b37cf08\") " May 21 15:25:02.095184 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:02.095155 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e80a178-a98b-4804-a5f3-ad975b37cf08-kube-api-access-l5vdm" (OuterVolumeSpecName: "kube-api-access-l5vdm") pod "5e80a178-a98b-4804-a5f3-ad975b37cf08" (UID: "5e80a178-a98b-4804-a5f3-ad975b37cf08"). InnerVolumeSpecName "kube-api-access-l5vdm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:25:02.194393 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:02.194358 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5vdm\" (UniqueName: \"kubernetes.io/projected/5e80a178-a98b-4804-a5f3-ad975b37cf08-kube-api-access-l5vdm\") on node \"ip-10-0-142-73.ec2.internal\" DevicePath \"\"" May 21 15:25:02.803880 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:02.803831 2563 generic.go:358] "Generic (PLEG): container finished" podID="5e80a178-a98b-4804-a5f3-ad975b37cf08" containerID="9a3aa360023dddb39591ca01fb398466212ffcc63dd2367ce3e60847e2b0e4c7" exitCode=0 May 21 15:25:02.804305 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:02.803883 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-585598586b-g428x" event={"ID":"5e80a178-a98b-4804-a5f3-ad975b37cf08","Type":"ContainerDied","Data":"9a3aa360023dddb39591ca01fb398466212ffcc63dd2367ce3e60847e2b0e4c7"} May 21 15:25:02.804305 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:02.803907 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-585598586b-g428x" May 21 15:25:02.804305 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:02.803930 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-585598586b-g428x" event={"ID":"5e80a178-a98b-4804-a5f3-ad975b37cf08","Type":"ContainerDied","Data":"e15512e6d538b8ae427f66df36125d1596455d5d2603989cf943ee858feb5f9c"} May 21 15:25:02.804305 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:02.803950 2563 scope.go:117] "RemoveContainer" containerID="9a3aa360023dddb39591ca01fb398466212ffcc63dd2367ce3e60847e2b0e4c7" May 21 15:25:02.813104 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:02.813000 2563 scope.go:117] "RemoveContainer" containerID="9a3aa360023dddb39591ca01fb398466212ffcc63dd2367ce3e60847e2b0e4c7" May 21 15:25:02.813327 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:25:02.813304 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a3aa360023dddb39591ca01fb398466212ffcc63dd2367ce3e60847e2b0e4c7\": container with ID starting with 9a3aa360023dddb39591ca01fb398466212ffcc63dd2367ce3e60847e2b0e4c7 not found: ID does not exist" containerID="9a3aa360023dddb39591ca01fb398466212ffcc63dd2367ce3e60847e2b0e4c7" May 21 15:25:02.813419 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:02.813356 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a3aa360023dddb39591ca01fb398466212ffcc63dd2367ce3e60847e2b0e4c7"} err="failed to get container status \"9a3aa360023dddb39591ca01fb398466212ffcc63dd2367ce3e60847e2b0e4c7\": rpc error: code = NotFound desc = could not find container \"9a3aa360023dddb39591ca01fb398466212ffcc63dd2367ce3e60847e2b0e4c7\": container with ID starting with 9a3aa360023dddb39591ca01fb398466212ffcc63dd2367ce3e60847e2b0e4c7 not found: ID does not exist" May 21 15:25:02.825684 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:02.825651 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-585598586b-g428x"] May 21 15:25:02.828124 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:02.828098 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-585598586b-g428x"] May 21 15:25:03.716606 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:03.716570 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e80a178-a98b-4804-a5f3-ad975b37cf08" path="/var/lib/kubelet/pods/5e80a178-a98b-4804-a5f3-ad975b37cf08/volumes" May 21 15:25:22.446839 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:22.446804 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5756d8bc58-zwdrt"] May 21 15:25:22.447415 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:22.447318 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e80a178-a98b-4804-a5f3-ad975b37cf08" containerName="manager" May 21 15:25:22.447415 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:22.447360 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e80a178-a98b-4804-a5f3-ad975b37cf08" containerName="manager" May 21 15:25:22.447415 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:22.447374 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92ec8b81-54cb-4876-964f-63924ec3b4fb" containerName="manager" May 21 15:25:22.447415 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:22.447382 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="92ec8b81-54cb-4876-964f-63924ec3b4fb" containerName="manager" May 21 15:25:22.447765 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:22.447482 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="92ec8b81-54cb-4876-964f-63924ec3b4fb" containerName="manager" May 21 15:25:22.447765 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:22.447495 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="5e80a178-a98b-4804-a5f3-ad975b37cf08" containerName="manager" May 21 15:25:22.454620 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:22.454599 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5756d8bc58-zwdrt" May 21 15:25:22.456833 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:22.456788 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-5jhgb\"" May 21 15:25:22.458781 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:22.458760 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5756d8bc58-zwdrt"] May 21 15:25:22.556132 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:22.556086 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f5f6208-b0a8-49c1-96c9-745324fb47b6-maas-api-tls\") pod \"maas-api-5756d8bc58-zwdrt\" (UID: \"6f5f6208-b0a8-49c1-96c9-745324fb47b6\") " pod="opendatahub/maas-api-5756d8bc58-zwdrt" May 21 15:25:22.556303 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:22.556149 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pckx\" (UniqueName: \"kubernetes.io/projected/6f5f6208-b0a8-49c1-96c9-745324fb47b6-kube-api-access-2pckx\") pod \"maas-api-5756d8bc58-zwdrt\" (UID: \"6f5f6208-b0a8-49c1-96c9-745324fb47b6\") " pod="opendatahub/maas-api-5756d8bc58-zwdrt" May 21 15:25:22.657407 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:22.657374 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2pckx\" (UniqueName: \"kubernetes.io/projected/6f5f6208-b0a8-49c1-96c9-745324fb47b6-kube-api-access-2pckx\") pod \"maas-api-5756d8bc58-zwdrt\" (UID: \"6f5f6208-b0a8-49c1-96c9-745324fb47b6\") " pod="opendatahub/maas-api-5756d8bc58-zwdrt" May 21 15:25:22.657583 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:22.657457 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f5f6208-b0a8-49c1-96c9-745324fb47b6-maas-api-tls\") pod \"maas-api-5756d8bc58-zwdrt\" (UID: \"6f5f6208-b0a8-49c1-96c9-745324fb47b6\") " pod="opendatahub/maas-api-5756d8bc58-zwdrt" May 21 15:25:22.659894 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:22.659864 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f5f6208-b0a8-49c1-96c9-745324fb47b6-maas-api-tls\") pod \"maas-api-5756d8bc58-zwdrt\" (UID: \"6f5f6208-b0a8-49c1-96c9-745324fb47b6\") " pod="opendatahub/maas-api-5756d8bc58-zwdrt" May 21 15:25:22.668735 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:22.668701 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pckx\" (UniqueName: \"kubernetes.io/projected/6f5f6208-b0a8-49c1-96c9-745324fb47b6-kube-api-access-2pckx\") pod \"maas-api-5756d8bc58-zwdrt\" (UID: \"6f5f6208-b0a8-49c1-96c9-745324fb47b6\") " pod="opendatahub/maas-api-5756d8bc58-zwdrt" May 21 15:25:22.768374 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:22.768006 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5756d8bc58-zwdrt" May 21 15:25:22.903034 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:22.903006 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5756d8bc58-zwdrt"] May 21 15:25:22.906775 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:25:22.906746 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f5f6208_b0a8_49c1_96c9_745324fb47b6.slice/crio-0d71babf48a1e6b6308a5d78abb6972c998787bbe50ec14ace5ff183ed8c51f9 WatchSource:0}: Error finding container 0d71babf48a1e6b6308a5d78abb6972c998787bbe50ec14ace5ff183ed8c51f9: Status 404 returned error can't find the container with id 0d71babf48a1e6b6308a5d78abb6972c998787bbe50ec14ace5ff183ed8c51f9 May 21 15:25:23.878132 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:23.878090 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5756d8bc58-zwdrt" event={"ID":"6f5f6208-b0a8-49c1-96c9-745324fb47b6","Type":"ContainerStarted","Data":"0d71babf48a1e6b6308a5d78abb6972c998787bbe50ec14ace5ff183ed8c51f9"} May 21 15:25:24.883183 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:24.883082 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5756d8bc58-zwdrt" event={"ID":"6f5f6208-b0a8-49c1-96c9-745324fb47b6","Type":"ContainerStarted","Data":"e8f61820546c7262c766483461e1ff8bcf6d03a2e95578e10e85284052f28965"} May 21 15:25:24.883578 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:24.883237 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5756d8bc58-zwdrt" May 21 15:25:24.899654 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:24.899608 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-5756d8bc58-zwdrt" podStartSLOduration=1.208822625 podStartE2EDuration="2.89959517s" podCreationTimestamp="2026-05-21 15:25:22 +0000 UTC" firstStartedPulling="2026-05-21 15:25:22.907920064 +0000 UTC m=+737.759362297" lastFinishedPulling="2026-05-21 15:25:24.598692609 +0000 UTC m=+739.450134842" observedRunningTime="2026-05-21 15:25:24.898044685 +0000 UTC m=+739.749486952" watchObservedRunningTime="2026-05-21 15:25:24.89959517 +0000 UTC m=+739.751037425" May 21 15:25:30.891809 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:30.891779 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5756d8bc58-zwdrt" May 21 15:25:30.937442 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:30.937409 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-7689f6966b-2cpl6"] May 21 15:25:30.937850 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:30.937810 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-api-7689f6966b-2cpl6" podUID="ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca" containerName="maas-api" containerID="cri-o://d55957776fc7e3b5826d7a873bb30d984b6afdd7ce8edfb3f151824c09c94f76" gracePeriod=30 May 21 15:25:31.205650 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:31.205625 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7689f6966b-2cpl6" May 21 15:25:31.328678 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:31.328646 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca-maas-api-tls\") pod \"ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca\" (UID: \"ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca\") " May 21 15:25:31.328846 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:31.328717 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pf6zd\" (UniqueName: \"kubernetes.io/projected/ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca-kube-api-access-pf6zd\") pod \"ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca\" (UID: \"ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca\") " May 21 15:25:31.330806 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:31.330778 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca" (UID: "ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 15:25:31.330891 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:31.330849 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca-kube-api-access-pf6zd" (OuterVolumeSpecName: "kube-api-access-pf6zd") pod "ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca" (UID: "ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca"). InnerVolumeSpecName "kube-api-access-pf6zd". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:25:31.429222 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:31.429189 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pf6zd\" (UniqueName: \"kubernetes.io/projected/ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca-kube-api-access-pf6zd\") on node \"ip-10-0-142-73.ec2.internal\" DevicePath \"\"" May 21 15:25:31.429222 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:31.429217 2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca-maas-api-tls\") on node \"ip-10-0-142-73.ec2.internal\" DevicePath \"\"" May 21 15:25:31.905799 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:31.905767 2563 generic.go:358] "Generic (PLEG): container finished" podID="ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca" containerID="d55957776fc7e3b5826d7a873bb30d984b6afdd7ce8edfb3f151824c09c94f76" exitCode=0 May 21 15:25:31.906175 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:31.905824 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7689f6966b-2cpl6" May 21 15:25:31.906175 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:31.905823 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7689f6966b-2cpl6" event={"ID":"ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca","Type":"ContainerDied","Data":"d55957776fc7e3b5826d7a873bb30d984b6afdd7ce8edfb3f151824c09c94f76"} May 21 15:25:31.906175 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:31.905913 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7689f6966b-2cpl6" event={"ID":"ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca","Type":"ContainerDied","Data":"bcc16871a619807df57b6d32b2bd88e73c96ecd44ca5453a9c3a34a4522aa85d"} May 21 15:25:31.906175 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:31.905929 2563 scope.go:117] "RemoveContainer" containerID="d55957776fc7e3b5826d7a873bb30d984b6afdd7ce8edfb3f151824c09c94f76" May 21 15:25:31.913543 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:31.913532 2563 scope.go:117] "RemoveContainer" containerID="d55957776fc7e3b5826d7a873bb30d984b6afdd7ce8edfb3f151824c09c94f76" May 21 15:25:31.913794 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:25:31.913765 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d55957776fc7e3b5826d7a873bb30d984b6afdd7ce8edfb3f151824c09c94f76\": container with ID starting with d55957776fc7e3b5826d7a873bb30d984b6afdd7ce8edfb3f151824c09c94f76 not found: ID does not exist" containerID="d55957776fc7e3b5826d7a873bb30d984b6afdd7ce8edfb3f151824c09c94f76" May 21 15:25:31.913864 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:31.913796 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d55957776fc7e3b5826d7a873bb30d984b6afdd7ce8edfb3f151824c09c94f76"} err="failed to get container status \"d55957776fc7e3b5826d7a873bb30d984b6afdd7ce8edfb3f151824c09c94f76\": rpc error: code = NotFound desc = could not find container \"d55957776fc7e3b5826d7a873bb30d984b6afdd7ce8edfb3f151824c09c94f76\": container with ID starting with d55957776fc7e3b5826d7a873bb30d984b6afdd7ce8edfb3f151824c09c94f76 not found: ID does not exist" May 21 15:25:31.920390 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:31.920368 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-7689f6966b-2cpl6"] May 21 15:25:31.923539 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:31.923518 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-7689f6966b-2cpl6"] May 21 15:25:33.720902 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:33.720868 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca" path="/var/lib/kubelet/pods/ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca/volumes" May 21 15:25:40.702513 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:40.702477 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf"] May 21 15:25:40.702885 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:40.702807 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca" containerName="maas-api" May 21 15:25:40.702885 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:40.702818 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca" containerName="maas-api" May 21 15:25:40.702885 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:40.702883 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="ab2c8eb5-0828-4c4a-be7c-aa17e14fb5ca" containerName="maas-api" May 21 15:25:40.706110 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:40.706090 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf" May 21 15:25:40.708951 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:40.708926 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-44d92\"" May 21 15:25:40.709085 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:40.708928 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" May 21 15:25:40.709085 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:40.708971 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 15:25:40.709085 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:40.708933 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 15:25:40.715509 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:40.715488 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf"] May 21 15:25:40.801519 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:40.801491 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dccb0de-90aa-4122-8b32-718b912c3e72-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf\" (UID: \"6dccb0de-90aa-4122-8b32-718b912c3e72\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf" May 21 15:25:40.801696 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:40.801533 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6dccb0de-90aa-4122-8b32-718b912c3e72-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf\" (UID: \"6dccb0de-90aa-4122-8b32-718b912c3e72\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf" May 21 15:25:40.801696 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:40.801585 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dccb0de-90aa-4122-8b32-718b912c3e72-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf\" (UID: \"6dccb0de-90aa-4122-8b32-718b912c3e72\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf" May 21 15:25:40.801696 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:40.801606 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dccb0de-90aa-4122-8b32-718b912c3e72-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf\" (UID: \"6dccb0de-90aa-4122-8b32-718b912c3e72\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf" May 21 15:25:40.801696 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:40.801646 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r74vb\" (UniqueName: \"kubernetes.io/projected/6dccb0de-90aa-4122-8b32-718b912c3e72-kube-api-access-r74vb\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf\" (UID: \"6dccb0de-90aa-4122-8b32-718b912c3e72\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf" May 21 15:25:40.801843 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:40.801729 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dccb0de-90aa-4122-8b32-718b912c3e72-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf\" (UID: \"6dccb0de-90aa-4122-8b32-718b912c3e72\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf" May 21 15:25:40.902561 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:40.902527 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r74vb\" (UniqueName: \"kubernetes.io/projected/6dccb0de-90aa-4122-8b32-718b912c3e72-kube-api-access-r74vb\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf\" (UID: \"6dccb0de-90aa-4122-8b32-718b912c3e72\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf" May 21 15:25:40.902757 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:40.902603 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dccb0de-90aa-4122-8b32-718b912c3e72-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf\" (UID: \"6dccb0de-90aa-4122-8b32-718b912c3e72\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf" May 21 15:25:40.902757 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:40.902644 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dccb0de-90aa-4122-8b32-718b912c3e72-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf\" (UID: \"6dccb0de-90aa-4122-8b32-718b912c3e72\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf" May 21 15:25:40.902757 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:40.902688 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6dccb0de-90aa-4122-8b32-718b912c3e72-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf\" (UID: \"6dccb0de-90aa-4122-8b32-718b912c3e72\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf" May 21 15:25:40.902757 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:40.902735 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dccb0de-90aa-4122-8b32-718b912c3e72-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf\" (UID: \"6dccb0de-90aa-4122-8b32-718b912c3e72\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf" May 21 15:25:40.902965 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:40.902762 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dccb0de-90aa-4122-8b32-718b912c3e72-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf\" (UID: \"6dccb0de-90aa-4122-8b32-718b912c3e72\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf" May 21 15:25:40.903220 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:40.903197 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dccb0de-90aa-4122-8b32-718b912c3e72-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf\" (UID: \"6dccb0de-90aa-4122-8b32-718b912c3e72\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf" May 21 15:25:40.903300 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:40.903263 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dccb0de-90aa-4122-8b32-718b912c3e72-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf\" (UID: \"6dccb0de-90aa-4122-8b32-718b912c3e72\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf" May 21 15:25:40.903376 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:40.903314 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6dccb0de-90aa-4122-8b32-718b912c3e72-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf\" (UID: \"6dccb0de-90aa-4122-8b32-718b912c3e72\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf" May 21 15:25:40.905195 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:40.905165 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dccb0de-90aa-4122-8b32-718b912c3e72-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf\" (UID: \"6dccb0de-90aa-4122-8b32-718b912c3e72\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf" May 21 15:25:40.905457 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:40.905440 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dccb0de-90aa-4122-8b32-718b912c3e72-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf\" (UID: \"6dccb0de-90aa-4122-8b32-718b912c3e72\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf" May 21 15:25:40.910011 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:40.909985 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r74vb\" (UniqueName: \"kubernetes.io/projected/6dccb0de-90aa-4122-8b32-718b912c3e72-kube-api-access-r74vb\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf\" (UID: \"6dccb0de-90aa-4122-8b32-718b912c3e72\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf" May 21 15:25:41.016138 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:41.016104 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf" May 21 15:25:41.150296 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:41.150273 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf"] May 21 15:25:41.154596 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:25:41.154563 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dccb0de_90aa_4122_8b32_718b912c3e72.slice/crio-7f563508fc19ba4c7ccd9f0ef8fbb8e310159d3ddebbc7c769f2ce9dfcc894b3 WatchSource:0}: Error finding container 7f563508fc19ba4c7ccd9f0ef8fbb8e310159d3ddebbc7c769f2ce9dfcc894b3: Status 404 returned error can't find the container with id 7f563508fc19ba4c7ccd9f0ef8fbb8e310159d3ddebbc7c769f2ce9dfcc894b3 May 21 15:25:41.156852 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:41.156837 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 15:25:41.945168 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:41.945130 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf" event={"ID":"6dccb0de-90aa-4122-8b32-718b912c3e72","Type":"ContainerStarted","Data":"7f563508fc19ba4c7ccd9f0ef8fbb8e310159d3ddebbc7c769f2ce9dfcc894b3"} May 21 15:25:45.812862 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:45.812822 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82"] May 21 15:25:45.830932 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:45.830880 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82"] May 21 15:25:45.831076 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:45.831025 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82" May 21 15:25:45.833783 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:45.833702 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" May 21 15:25:45.948781 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:45.948743 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbfdaf86-70ed-4150-9c83-1cc24fe3441e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82\" (UID: \"dbfdaf86-70ed-4150-9c83-1cc24fe3441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82" May 21 15:25:45.948926 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:45.948793 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbfdaf86-70ed-4150-9c83-1cc24fe3441e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82\" (UID: \"dbfdaf86-70ed-4150-9c83-1cc24fe3441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82" May 21 15:25:45.948926 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:45.948823 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dbfdaf86-70ed-4150-9c83-1cc24fe3441e-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82\" (UID: \"dbfdaf86-70ed-4150-9c83-1cc24fe3441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82" May 21 15:25:45.948926 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:45.948885 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv85t\" (UniqueName: \"kubernetes.io/projected/dbfdaf86-70ed-4150-9c83-1cc24fe3441e-kube-api-access-vv85t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82\" (UID: \"dbfdaf86-70ed-4150-9c83-1cc24fe3441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82" May 21 15:25:45.949097 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:45.948953 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbfdaf86-70ed-4150-9c83-1cc24fe3441e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82\" (UID: \"dbfdaf86-70ed-4150-9c83-1cc24fe3441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82" May 21 15:25:45.949097 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:45.948978 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbfdaf86-70ed-4150-9c83-1cc24fe3441e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82\" (UID: \"dbfdaf86-70ed-4150-9c83-1cc24fe3441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82" May 21 15:25:46.050286 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:46.050246 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbfdaf86-70ed-4150-9c83-1cc24fe3441e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82\" (UID: \"dbfdaf86-70ed-4150-9c83-1cc24fe3441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82" May 21 15:25:46.050286 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:46.050286 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbfdaf86-70ed-4150-9c83-1cc24fe3441e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82\" (UID: \"dbfdaf86-70ed-4150-9c83-1cc24fe3441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82" May 21 15:25:46.050587 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:46.050350 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbfdaf86-70ed-4150-9c83-1cc24fe3441e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82\" (UID: \"dbfdaf86-70ed-4150-9c83-1cc24fe3441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82" May 21 15:25:46.050587 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:46.050382 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbfdaf86-70ed-4150-9c83-1cc24fe3441e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82\" (UID: \"dbfdaf86-70ed-4150-9c83-1cc24fe3441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82" May 21 15:25:46.050587 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:46.050409 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dbfdaf86-70ed-4150-9c83-1cc24fe3441e-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82\" (UID: \"dbfdaf86-70ed-4150-9c83-1cc24fe3441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82" May 21 15:25:46.050587 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:46.050447 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vv85t\" (UniqueName: \"kubernetes.io/projected/dbfdaf86-70ed-4150-9c83-1cc24fe3441e-kube-api-access-vv85t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82\" (UID: \"dbfdaf86-70ed-4150-9c83-1cc24fe3441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82" May 21 15:25:46.050826 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:46.050737 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbfdaf86-70ed-4150-9c83-1cc24fe3441e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82\" (UID: \"dbfdaf86-70ed-4150-9c83-1cc24fe3441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82" May 21 15:25:46.050898 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:46.050876 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbfdaf86-70ed-4150-9c83-1cc24fe3441e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82\" (UID: \"dbfdaf86-70ed-4150-9c83-1cc24fe3441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82" May 21 15:25:46.051047 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:46.051023 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dbfdaf86-70ed-4150-9c83-1cc24fe3441e-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82\" (UID: \"dbfdaf86-70ed-4150-9c83-1cc24fe3441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82" May 21 15:25:46.053373 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:46.053319 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbfdaf86-70ed-4150-9c83-1cc24fe3441e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82\" (UID: \"dbfdaf86-70ed-4150-9c83-1cc24fe3441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82" May 21 15:25:46.053621 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:46.053599 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbfdaf86-70ed-4150-9c83-1cc24fe3441e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82\" (UID: \"dbfdaf86-70ed-4150-9c83-1cc24fe3441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82" May 21 15:25:46.058156 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:46.058135 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv85t\" (UniqueName: \"kubernetes.io/projected/dbfdaf86-70ed-4150-9c83-1cc24fe3441e-kube-api-access-vv85t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82\" (UID: \"dbfdaf86-70ed-4150-9c83-1cc24fe3441e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82" May 21 15:25:46.144498 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:46.144421 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82" May 21 15:25:47.935216 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:47.935112 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82"] May 21 15:25:47.939752 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:25:47.939726 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbfdaf86_70ed_4150_9c83_1cc24fe3441e.slice/crio-ab0d560afca4a54f14895dd56011dc6919eb52752c9b5484cb7fbb7b20f27cad WatchSource:0}: Error finding container ab0d560afca4a54f14895dd56011dc6919eb52752c9b5484cb7fbb7b20f27cad: Status 404 returned error can't find the container with id ab0d560afca4a54f14895dd56011dc6919eb52752c9b5484cb7fbb7b20f27cad May 21 15:25:47.968422 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:47.967707 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf" event={"ID":"6dccb0de-90aa-4122-8b32-718b912c3e72","Type":"ContainerStarted","Data":"f649c74767de44346e5ade7276a5e2535a1b936590be97f09720a1d94c0bb19d"} May 21 15:25:47.971545 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:47.971160 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82" event={"ID":"dbfdaf86-70ed-4150-9c83-1cc24fe3441e","Type":"ContainerStarted","Data":"ab0d560afca4a54f14895dd56011dc6919eb52752c9b5484cb7fbb7b20f27cad"} May 21 15:25:48.976658 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:48.976613 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82" event={"ID":"dbfdaf86-70ed-4150-9c83-1cc24fe3441e","Type":"ContainerStarted","Data":"2f28e0c863fb5b84704876104beb6a19ff4b16c745f139d654e59f27e65953fb"} May 21 15:25:53.994806 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:53.994775 2563 generic.go:358] "Generic (PLEG): container finished" podID="dbfdaf86-70ed-4150-9c83-1cc24fe3441e" containerID="2f28e0c863fb5b84704876104beb6a19ff4b16c745f139d654e59f27e65953fb" exitCode=0 May 21 15:25:53.995189 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:53.994850 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82" event={"ID":"dbfdaf86-70ed-4150-9c83-1cc24fe3441e","Type":"ContainerDied","Data":"2f28e0c863fb5b84704876104beb6a19ff4b16c745f139d654e59f27e65953fb"} May 21 15:25:56.004498 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:56.004465 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82" event={"ID":"dbfdaf86-70ed-4150-9c83-1cc24fe3441e","Type":"ContainerStarted","Data":"d10d1e76f04a0f10ec2f90216848b7c32c5a8362e22d1e372821eb9c5a38096e"} May 21 15:25:56.004867 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:56.004684 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82" May 21 15:25:56.023050 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:56.023007 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82" podStartSLOduration=9.146887359 podStartE2EDuration="11.022995533s" podCreationTimestamp="2026-05-21 15:25:45 +0000 UTC" firstStartedPulling="2026-05-21 15:25:53.995459693 +0000 UTC m=+768.846901925" lastFinishedPulling="2026-05-21 15:25:55.87156785 +0000 UTC m=+770.723010099" observedRunningTime="2026-05-21 15:25:56.021258708 +0000 UTC m=+770.872700986" watchObservedRunningTime="2026-05-21 15:25:56.022995533 +0000 UTC m=+770.874437787" May 21 15:25:57.009412 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:57.009371 2563 generic.go:358] "Generic (PLEG): container finished" podID="6dccb0de-90aa-4122-8b32-718b912c3e72" containerID="f649c74767de44346e5ade7276a5e2535a1b936590be97f09720a1d94c0bb19d" exitCode=0 May 21 15:25:57.009846 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:57.009439 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf" event={"ID":"6dccb0de-90aa-4122-8b32-718b912c3e72","Type":"ContainerDied","Data":"f649c74767de44346e5ade7276a5e2535a1b936590be97f09720a1d94c0bb19d"} May 21 15:25:58.014975 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:58.014821 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf" event={"ID":"6dccb0de-90aa-4122-8b32-718b912c3e72","Type":"ContainerStarted","Data":"09f265145db56488c2a983782fddd7134d5ad849746f65d764d784f50165b7f7"} May 21 15:25:58.015386 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:58.015023 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf" May 21 15:25:58.033441 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:25:58.033392 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf" podStartSLOduration=1.2821752260000001 podStartE2EDuration="18.033377749s" podCreationTimestamp="2026-05-21 15:25:40 +0000 UTC" firstStartedPulling="2026-05-21 15:25:41.156967166 +0000 UTC m=+756.008409399" lastFinishedPulling="2026-05-21 15:25:57.908169689 +0000 UTC m=+772.759611922" observedRunningTime="2026-05-21 15:25:58.032702902 +0000 UTC m=+772.884145159" watchObservedRunningTime="2026-05-21 15:25:58.033377749 +0000 UTC m=+772.884820003" May 21 15:26:07.022396 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:07.022364 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82" May 21 15:26:09.031168 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:09.031133 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf" May 21 15:26:31.819002 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:31.818924 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2"] May 21 15:26:31.822110 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:31.822087 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2" May 21 15:26:31.824286 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:31.824264 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 21 15:26:31.833153 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:31.833130 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2"] May 21 15:26:31.938402 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:31.938360 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d75f26bb-ac5b-48a0-8733-c18129c905c7-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2\" (UID: \"d75f26bb-ac5b-48a0-8733-c18129c905c7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2" May 21 15:26:31.938597 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:31.938414 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6j2d\" (UniqueName: \"kubernetes.io/projected/d75f26bb-ac5b-48a0-8733-c18129c905c7-kube-api-access-p6j2d\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2\" (UID: \"d75f26bb-ac5b-48a0-8733-c18129c905c7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2" May 21 15:26:31.938597 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:31.938487 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d75f26bb-ac5b-48a0-8733-c18129c905c7-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2\" (UID: \"d75f26bb-ac5b-48a0-8733-c18129c905c7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2" May 21 15:26:31.938597 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:31.938516 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d75f26bb-ac5b-48a0-8733-c18129c905c7-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2\" (UID: \"d75f26bb-ac5b-48a0-8733-c18129c905c7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2" May 21 15:26:31.938597 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:31.938544 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d75f26bb-ac5b-48a0-8733-c18129c905c7-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2\" (UID: \"d75f26bb-ac5b-48a0-8733-c18129c905c7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2" May 21 15:26:31.938762 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:31.938607 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d75f26bb-ac5b-48a0-8733-c18129c905c7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2\" (UID: \"d75f26bb-ac5b-48a0-8733-c18129c905c7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2" May 21 15:26:32.039696 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:32.039666 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d75f26bb-ac5b-48a0-8733-c18129c905c7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2\" (UID: \"d75f26bb-ac5b-48a0-8733-c18129c905c7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2" May 21 15:26:32.039900 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:32.039713 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d75f26bb-ac5b-48a0-8733-c18129c905c7-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2\" (UID: \"d75f26bb-ac5b-48a0-8733-c18129c905c7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2" May 21 15:26:32.039900 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:32.039743 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p6j2d\" (UniqueName: \"kubernetes.io/projected/d75f26bb-ac5b-48a0-8733-c18129c905c7-kube-api-access-p6j2d\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2\" (UID: \"d75f26bb-ac5b-48a0-8733-c18129c905c7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2" May 21 15:26:32.039900 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:32.039819 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d75f26bb-ac5b-48a0-8733-c18129c905c7-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2\" (UID: \"d75f26bb-ac5b-48a0-8733-c18129c905c7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2" May 21 15:26:32.039900 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:32.039847 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d75f26bb-ac5b-48a0-8733-c18129c905c7-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2\" (UID: \"d75f26bb-ac5b-48a0-8733-c18129c905c7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2" May 21 15:26:32.039900 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:32.039877 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d75f26bb-ac5b-48a0-8733-c18129c905c7-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2\" (UID: \"d75f26bb-ac5b-48a0-8733-c18129c905c7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2" May 21 15:26:32.040175 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:32.040153 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d75f26bb-ac5b-48a0-8733-c18129c905c7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2\" (UID: \"d75f26bb-ac5b-48a0-8733-c18129c905c7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2" May 21 15:26:32.040347 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:32.040313 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d75f26bb-ac5b-48a0-8733-c18129c905c7-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2\" (UID: \"d75f26bb-ac5b-48a0-8733-c18129c905c7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2" May 21 15:26:32.040464 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:32.040412 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d75f26bb-ac5b-48a0-8733-c18129c905c7-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2\" (UID: \"d75f26bb-ac5b-48a0-8733-c18129c905c7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2" May 21 15:26:32.042051 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:32.042026 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d75f26bb-ac5b-48a0-8733-c18129c905c7-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2\" (UID: \"d75f26bb-ac5b-48a0-8733-c18129c905c7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2" May 21 15:26:32.042437 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:32.042418 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d75f26bb-ac5b-48a0-8733-c18129c905c7-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2\" (UID: \"d75f26bb-ac5b-48a0-8733-c18129c905c7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2" May 21 15:26:32.047294 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:32.047275 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6j2d\" (UniqueName: \"kubernetes.io/projected/d75f26bb-ac5b-48a0-8733-c18129c905c7-kube-api-access-p6j2d\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2\" (UID: \"d75f26bb-ac5b-48a0-8733-c18129c905c7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2" May 21 15:26:32.133254 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:32.133172 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2" May 21 15:26:32.270791 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:32.270761 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2"] May 21 15:26:32.274063 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:26:32.274031 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd75f26bb_ac5b_48a0_8733_c18129c905c7.slice/crio-5b2f43f3829af3f7fb84de83d8b30e57449afcdf77bdfb838b5d35013720804a WatchSource:0}: Error finding container 5b2f43f3829af3f7fb84de83d8b30e57449afcdf77bdfb838b5d35013720804a: Status 404 returned error can't find the container with id 5b2f43f3829af3f7fb84de83d8b30e57449afcdf77bdfb838b5d35013720804a May 21 15:26:33.129952 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:33.129918 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2" event={"ID":"d75f26bb-ac5b-48a0-8733-c18129c905c7","Type":"ContainerStarted","Data":"389fff3ec1e60b44b1d4f2a7271eaf357cf04cf1e4fcf60d360719d10f379682"} May 21 15:26:33.129952 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:33.129957 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2" event={"ID":"d75f26bb-ac5b-48a0-8733-c18129c905c7","Type":"ContainerStarted","Data":"5b2f43f3829af3f7fb84de83d8b30e57449afcdf77bdfb838b5d35013720804a"} May 21 15:26:38.146955 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:38.146874 2563 generic.go:358] "Generic (PLEG): container finished" podID="d75f26bb-ac5b-48a0-8733-c18129c905c7" containerID="389fff3ec1e60b44b1d4f2a7271eaf357cf04cf1e4fcf60d360719d10f379682" exitCode=0 May 21 15:26:38.146955 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:38.146911 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2" event={"ID":"d75f26bb-ac5b-48a0-8733-c18129c905c7","Type":"ContainerDied","Data":"389fff3ec1e60b44b1d4f2a7271eaf357cf04cf1e4fcf60d360719d10f379682"} May 21 15:26:39.151551 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:39.151513 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2" event={"ID":"d75f26bb-ac5b-48a0-8733-c18129c905c7","Type":"ContainerStarted","Data":"2a0d8551f7ae5bcb625d501b9a6e10d0dca25a5cc235997d9d555790058d9a1d"} May 21 15:26:39.151955 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:39.151752 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2" May 21 15:26:39.174544 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:39.174468 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2" podStartSLOduration=7.742113274 podStartE2EDuration="8.174455203s" podCreationTimestamp="2026-05-21 15:26:31 +0000 UTC" firstStartedPulling="2026-05-21 15:26:38.147473176 +0000 UTC m=+812.998915409" lastFinishedPulling="2026-05-21 15:26:38.5798151 +0000 UTC m=+813.431257338" observedRunningTime="2026-05-21 15:26:39.171839934 +0000 UTC m=+814.023282183" watchObservedRunningTime="2026-05-21 15:26:39.174455203 +0000 UTC m=+814.025897458" May 21 15:26:50.172662 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:26:50.172620 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2" May 21 15:28:08.497791 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:08.497755 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58c48f5cb5-rwq4t"] May 21 15:28:08.498244 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:08.497988 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-58c48f5cb5-rwq4t" podUID="a9c5f5f3-71b2-4970-858b-c69ab1e2e50a" containerName="manager" containerID="cri-o://38cc4296a881b95c6a2294b6f835e0617bb14c67374f085c72c32d87920491a6" gracePeriod=30 May 21 15:28:08.744396 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:08.744369 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58c48f5cb5-rwq4t" May 21 15:28:08.840371 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:08.840273 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hnm94\" (UniqueName: \"kubernetes.io/projected/a9c5f5f3-71b2-4970-858b-c69ab1e2e50a-kube-api-access-hnm94\") pod \"a9c5f5f3-71b2-4970-858b-c69ab1e2e50a\" (UID: \"a9c5f5f3-71b2-4970-858b-c69ab1e2e50a\") " May 21 15:28:08.842313 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:08.842283 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9c5f5f3-71b2-4970-858b-c69ab1e2e50a-kube-api-access-hnm94" (OuterVolumeSpecName: "kube-api-access-hnm94") pod "a9c5f5f3-71b2-4970-858b-c69ab1e2e50a" (UID: "a9c5f5f3-71b2-4970-858b-c69ab1e2e50a"). InnerVolumeSpecName "kube-api-access-hnm94". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:28:08.941839 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:08.941799 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnm94\" (UniqueName: \"kubernetes.io/projected/a9c5f5f3-71b2-4970-858b-c69ab1e2e50a-kube-api-access-hnm94\") on node \"ip-10-0-142-73.ec2.internal\" DevicePath \"\"" May 21 15:28:09.457697 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:09.457663 2563 generic.go:358] "Generic (PLEG): container finished" podID="a9c5f5f3-71b2-4970-858b-c69ab1e2e50a" containerID="38cc4296a881b95c6a2294b6f835e0617bb14c67374f085c72c32d87920491a6" exitCode=0 May 21 15:28:09.457897 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:09.457725 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58c48f5cb5-rwq4t" May 21 15:28:09.457897 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:09.457754 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58c48f5cb5-rwq4t" event={"ID":"a9c5f5f3-71b2-4970-858b-c69ab1e2e50a","Type":"ContainerDied","Data":"38cc4296a881b95c6a2294b6f835e0617bb14c67374f085c72c32d87920491a6"} May 21 15:28:09.457897 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:09.457800 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58c48f5cb5-rwq4t" event={"ID":"a9c5f5f3-71b2-4970-858b-c69ab1e2e50a","Type":"ContainerDied","Data":"fd48f079a45ed29455580f1c0a20d3ec49f4027d3abd23fca7dc34530a5ce1fe"} May 21 15:28:09.457897 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:09.457821 2563 scope.go:117] "RemoveContainer" containerID="38cc4296a881b95c6a2294b6f835e0617bb14c67374f085c72c32d87920491a6" May 21 15:28:09.466585 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:09.466567 2563 scope.go:117] "RemoveContainer" containerID="38cc4296a881b95c6a2294b6f835e0617bb14c67374f085c72c32d87920491a6" May 21 15:28:09.466859 ip-10-0-142-73 kubenswrapper[2563]: E0521 15:28:09.466841 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38cc4296a881b95c6a2294b6f835e0617bb14c67374f085c72c32d87920491a6\": container with ID starting with 38cc4296a881b95c6a2294b6f835e0617bb14c67374f085c72c32d87920491a6 not found: ID does not exist" containerID="38cc4296a881b95c6a2294b6f835e0617bb14c67374f085c72c32d87920491a6" May 21 15:28:09.466916 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:09.466869 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38cc4296a881b95c6a2294b6f835e0617bb14c67374f085c72c32d87920491a6"} err="failed to get container status \"38cc4296a881b95c6a2294b6f835e0617bb14c67374f085c72c32d87920491a6\": rpc error: code = NotFound desc = could not find container \"38cc4296a881b95c6a2294b6f835e0617bb14c67374f085c72c32d87920491a6\": container with ID starting with 38cc4296a881b95c6a2294b6f835e0617bb14c67374f085c72c32d87920491a6 not found: ID does not exist" May 21 15:28:09.481003 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:09.480976 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58c48f5cb5-rwq4t"] May 21 15:28:09.485016 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:09.484997 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-58c48f5cb5-rwq4t"] May 21 15:28:09.717182 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:09.717099 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9c5f5f3-71b2-4970-858b-c69ab1e2e50a" path="/var/lib/kubelet/pods/a9c5f5f3-71b2-4970-858b-c69ab1e2e50a/volumes" May 21 15:28:10.245675 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:10.245640 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58c48f5cb5-v8hf6"] May 21 15:28:10.246010 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:10.245996 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9c5f5f3-71b2-4970-858b-c69ab1e2e50a" containerName="manager" May 21 15:28:10.246073 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:10.246011 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9c5f5f3-71b2-4970-858b-c69ab1e2e50a" containerName="manager" May 21 15:28:10.246210 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:10.246187 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="a9c5f5f3-71b2-4970-858b-c69ab1e2e50a" containerName="manager" May 21 15:28:10.250539 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:10.250512 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58c48f5cb5-v8hf6" May 21 15:28:10.252472 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:10.252453 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4gh9k\"" May 21 15:28:10.258697 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:10.258678 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58c48f5cb5-v8hf6"] May 21 15:28:10.351179 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:10.351153 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwbgj\" (UniqueName: \"kubernetes.io/projected/fea45b3f-f064-4ce2-ae4a-3b720fc8e187-kube-api-access-kwbgj\") pod \"maas-controller-58c48f5cb5-v8hf6\" (UID: \"fea45b3f-f064-4ce2-ae4a-3b720fc8e187\") " pod="opendatahub/maas-controller-58c48f5cb5-v8hf6" May 21 15:28:10.452530 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:10.452498 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwbgj\" (UniqueName: \"kubernetes.io/projected/fea45b3f-f064-4ce2-ae4a-3b720fc8e187-kube-api-access-kwbgj\") pod \"maas-controller-58c48f5cb5-v8hf6\" (UID: \"fea45b3f-f064-4ce2-ae4a-3b720fc8e187\") " pod="opendatahub/maas-controller-58c48f5cb5-v8hf6" May 21 15:28:10.460959 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:10.460929 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwbgj\" (UniqueName: \"kubernetes.io/projected/fea45b3f-f064-4ce2-ae4a-3b720fc8e187-kube-api-access-kwbgj\") pod \"maas-controller-58c48f5cb5-v8hf6\" (UID: \"fea45b3f-f064-4ce2-ae4a-3b720fc8e187\") " pod="opendatahub/maas-controller-58c48f5cb5-v8hf6" May 21 15:28:10.561126 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:10.561054 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58c48f5cb5-v8hf6" May 21 15:28:10.690040 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:10.690014 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58c48f5cb5-v8hf6"] May 21 15:28:10.692430 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:28:10.692398 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfea45b3f_f064_4ce2_ae4a_3b720fc8e187.slice/crio-cc401c1446d7586de58e643bcf3397fad4982ffbe57ed786a407a3c5a1ed88cf WatchSource:0}: Error finding container cc401c1446d7586de58e643bcf3397fad4982ffbe57ed786a407a3c5a1ed88cf: Status 404 returned error can't find the container with id cc401c1446d7586de58e643bcf3397fad4982ffbe57ed786a407a3c5a1ed88cf May 21 15:28:11.472486 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:11.472457 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58c48f5cb5-v8hf6" event={"ID":"fea45b3f-f064-4ce2-ae4a-3b720fc8e187","Type":"ContainerStarted","Data":"eb314f4d16715b05e2bc4054a902cba52d7e39a5cf42e468033d79f17f0fdac7"} May 21 15:28:11.472486 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:11.472488 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58c48f5cb5-v8hf6" event={"ID":"fea45b3f-f064-4ce2-ae4a-3b720fc8e187","Type":"ContainerStarted","Data":"cc401c1446d7586de58e643bcf3397fad4982ffbe57ed786a407a3c5a1ed88cf"} May 21 15:28:11.472880 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:11.472575 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58c48f5cb5-v8hf6" May 21 15:28:11.489219 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:11.489179 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-58c48f5cb5-v8hf6" podStartSLOduration=1.064182558 podStartE2EDuration="1.489165017s" podCreationTimestamp="2026-05-21 15:28:10 +0000 UTC" firstStartedPulling="2026-05-21 15:28:10.693631411 +0000 UTC m=+905.545073648" lastFinishedPulling="2026-05-21 15:28:11.118613859 +0000 UTC m=+905.970056107" observedRunningTime="2026-05-21 15:28:11.48774446 +0000 UTC m=+906.339186741" watchObservedRunningTime="2026-05-21 15:28:11.489165017 +0000 UTC m=+906.340607271" May 21 15:28:22.481044 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:28:22.481007 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58c48f5cb5-v8hf6" May 21 15:38:27.039034 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:38:27.038950 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pg4hj"] May 21 15:38:27.041485 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:38:27.039187 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pg4hj" podUID="65996b8a-7720-4fb5-9191-d666c9e34131" containerName="manager" containerID="cri-o://2cab18f9cf9fcfaaab36abafa8740e199ae82bc7407f59b8b0207a588bbb5ef9" gracePeriod=10 May 21 15:38:27.537643 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:38:27.537606 2563 generic.go:358] "Generic (PLEG): container finished" podID="65996b8a-7720-4fb5-9191-d666c9e34131" containerID="2cab18f9cf9fcfaaab36abafa8740e199ae82bc7407f59b8b0207a588bbb5ef9" exitCode=0 May 21 15:38:27.537792 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:38:27.537650 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pg4hj" event={"ID":"65996b8a-7720-4fb5-9191-d666c9e34131","Type":"ContainerDied","Data":"2cab18f9cf9fcfaaab36abafa8740e199ae82bc7407f59b8b0207a588bbb5ef9"} May 21 15:38:27.879520 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:38:27.879497 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pg4hj" May 21 15:38:27.924889 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:38:27.924864 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2d58\" (UniqueName: \"kubernetes.io/projected/65996b8a-7720-4fb5-9191-d666c9e34131-kube-api-access-c2d58\") pod \"65996b8a-7720-4fb5-9191-d666c9e34131\" (UID: \"65996b8a-7720-4fb5-9191-d666c9e34131\") " May 21 15:38:27.925039 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:38:27.924928 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65996b8a-7720-4fb5-9191-d666c9e34131-extensions-socket-volume\") pod \"65996b8a-7720-4fb5-9191-d666c9e34131\" (UID: \"65996b8a-7720-4fb5-9191-d666c9e34131\") " May 21 15:38:27.925350 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:38:27.925313 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65996b8a-7720-4fb5-9191-d666c9e34131-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "65996b8a-7720-4fb5-9191-d666c9e34131" (UID: "65996b8a-7720-4fb5-9191-d666c9e34131"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 15:38:27.926938 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:38:27.926908 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65996b8a-7720-4fb5-9191-d666c9e34131-kube-api-access-c2d58" (OuterVolumeSpecName: "kube-api-access-c2d58") pod "65996b8a-7720-4fb5-9191-d666c9e34131" (UID: "65996b8a-7720-4fb5-9191-d666c9e34131"). InnerVolumeSpecName "kube-api-access-c2d58". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:38:28.025515 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:38:28.025479 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2d58\" (UniqueName: \"kubernetes.io/projected/65996b8a-7720-4fb5-9191-d666c9e34131-kube-api-access-c2d58\") on node \"ip-10-0-142-73.ec2.internal\" DevicePath \"\"" May 21 15:38:28.025515 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:38:28.025509 2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/65996b8a-7720-4fb5-9191-d666c9e34131-extensions-socket-volume\") on node \"ip-10-0-142-73.ec2.internal\" DevicePath \"\"" May 21 15:38:28.543062 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:38:28.543029 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pg4hj" event={"ID":"65996b8a-7720-4fb5-9191-d666c9e34131","Type":"ContainerDied","Data":"83247a179893f2c6a9ede62ef77a2bddb294ac861575c1b5baf75c1ce3bbbab2"} May 21 15:38:28.543505 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:38:28.543074 2563 scope.go:117] "RemoveContainer" containerID="2cab18f9cf9fcfaaab36abafa8740e199ae82bc7407f59b8b0207a588bbb5ef9" May 21 15:38:28.543505 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:38:28.543084 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pg4hj" May 21 15:38:28.563913 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:38:28.563891 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pg4hj"] May 21 15:38:28.567139 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:38:28.567117 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-pg4hj"] May 21 15:38:29.716548 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:38:29.716515 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65996b8a-7720-4fb5-9191-d666c9e34131" path="/var/lib/kubelet/pods/65996b8a-7720-4fb5-9191-d666c9e34131/volumes" May 21 15:39:33.134896 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:39:33.134860 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-b7cw7"] May 21 15:39:33.135325 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:39:33.135232 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65996b8a-7720-4fb5-9191-d666c9e34131" containerName="manager" May 21 15:39:33.135325 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:39:33.135244 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="65996b8a-7720-4fb5-9191-d666c9e34131" containerName="manager" May 21 15:39:33.135325 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:39:33.135297 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="65996b8a-7720-4fb5-9191-d666c9e34131" containerName="manager" May 21 15:39:33.138167 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:39:33.138149 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-b7cw7" May 21 15:39:33.141133 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:39:33.141115 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-89s62\"" May 21 15:39:33.156190 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:39:33.156166 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-b7cw7"] May 21 15:39:33.284805 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:39:33.284778 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/be541c8c-28bc-4104-a850-3ecee06ad18b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-b7cw7\" (UID: \"be541c8c-28bc-4104-a850-3ecee06ad18b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-b7cw7" May 21 15:39:33.284944 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:39:33.284828 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxcnb\" (UniqueName: \"kubernetes.io/projected/be541c8c-28bc-4104-a850-3ecee06ad18b-kube-api-access-gxcnb\") pod \"kuadrant-operator-controller-manager-55c7f4c975-b7cw7\" (UID: \"be541c8c-28bc-4104-a850-3ecee06ad18b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-b7cw7" May 21 15:39:33.385688 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:39:33.385609 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gxcnb\" (UniqueName: \"kubernetes.io/projected/be541c8c-28bc-4104-a850-3ecee06ad18b-kube-api-access-gxcnb\") pod \"kuadrant-operator-controller-manager-55c7f4c975-b7cw7\" (UID: \"be541c8c-28bc-4104-a850-3ecee06ad18b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-b7cw7" May 21 15:39:33.385688 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:39:33.385673 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/be541c8c-28bc-4104-a850-3ecee06ad18b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-b7cw7\" (UID: \"be541c8c-28bc-4104-a850-3ecee06ad18b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-b7cw7" May 21 15:39:33.385994 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:39:33.385977 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/be541c8c-28bc-4104-a850-3ecee06ad18b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-b7cw7\" (UID: \"be541c8c-28bc-4104-a850-3ecee06ad18b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-b7cw7" May 21 15:39:33.393564 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:39:33.393546 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxcnb\" (UniqueName: \"kubernetes.io/projected/be541c8c-28bc-4104-a850-3ecee06ad18b-kube-api-access-gxcnb\") pod \"kuadrant-operator-controller-manager-55c7f4c975-b7cw7\" (UID: \"be541c8c-28bc-4104-a850-3ecee06ad18b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-b7cw7" May 21 15:39:33.447602 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:39:33.447576 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-b7cw7" May 21 15:39:33.595558 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:39:33.595526 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-b7cw7"] May 21 15:39:33.599360 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:39:33.599308 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe541c8c_28bc_4104_a850_3ecee06ad18b.slice/crio-c6489cd6a19aa43b8d4f76c55ca366311586b48dbd90d13296420782a5265819 WatchSource:0}: Error finding container c6489cd6a19aa43b8d4f76c55ca366311586b48dbd90d13296420782a5265819: Status 404 returned error can't find the container with id c6489cd6a19aa43b8d4f76c55ca366311586b48dbd90d13296420782a5265819 May 21 15:39:33.601681 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:39:33.601665 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 15:39:33.756859 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:39:33.756820 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-b7cw7" event={"ID":"be541c8c-28bc-4104-a850-3ecee06ad18b","Type":"ContainerStarted","Data":"e0aec688a6be3640504e1d84bc95114479e4c2427e8b5473ddb4a15ce6dea421"} May 21 15:39:33.756859 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:39:33.756861 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-b7cw7" event={"ID":"be541c8c-28bc-4104-a850-3ecee06ad18b","Type":"ContainerStarted","Data":"c6489cd6a19aa43b8d4f76c55ca366311586b48dbd90d13296420782a5265819"} May 21 15:39:33.757094 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:39:33.756892 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-b7cw7" May 21 15:39:33.798968 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:39:33.798923 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-b7cw7" podStartSLOduration=0.7989091 podStartE2EDuration="798.9091ms" podCreationTimestamp="2026-05-21 15:39:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:39:33.795476903 +0000 UTC m=+1588.646919159" watchObservedRunningTime="2026-05-21 15:39:33.7989091 +0000 UTC m=+1588.650351355" May 21 15:39:44.762660 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:39:44.762629 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-b7cw7" May 21 15:51:22.717495 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:22.717468 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-bs7vb_47a4a252-0e8a-4d0a-90a5-907ca863a16b/manager/0.log" May 21 15:51:22.842622 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:22.842593 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5756d8bc58-zwdrt_6f5f6208-b0a8-49c1-96c9-745324fb47b6/maas-api/0.log" May 21 15:51:23.197699 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:23.197627 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-58c48f5cb5-v8hf6_fea45b3f-f064-4ce2-ae4a-3b720fc8e187/manager/0.log" May 21 15:51:23.315639 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:23.315614 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-tdd2v_5f482fb0-9b22-4d74-817a-72ad541fdc1c/manager/1.log" May 21 15:51:23.556695 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:23.556665 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-594496b99d-8r75t_db7da750-b43b-498e-8bbb-3f105aed9011/manager/0.log" May 21 15:51:23.798103 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:23.798072 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-h7w7q_ac139ef9-b591-41fa-8087-f4d28061a060/postgres/0.log" May 21 15:51:25.461482 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:25.461445 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-tffqk_4f912091-324e-4b2b-bf5a-f2b4187e766b/manager/0.log" May 21 15:51:25.818969 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:25.818939 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-b7cw7_be541c8c-28bc-4104-a850-3ecee06ad18b/manager/0.log" May 21 15:51:26.513209 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:26.513175 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-95nfp_f80b0fff-1cf0-4553-b04e-e5579518aae7/discovery/0.log" May 21 15:51:26.735578 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:26.735553 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bd665b65-d9rxp_ed6ce027-c496-4e6e-adb8-6c60f21166f3/kube-auth-proxy/0.log" May 21 15:51:26.966955 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:26.966879 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-sxrmm_f24e9722-6841-40a6-9986-c38e77c95b6a/payload-processing/0.log" May 21 15:51:27.541463 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:27.541432 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2_d75f26bb-ac5b-48a0-8733-c18129c905c7/storage-initializer/0.log" May 21 15:51:27.549734 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:27.549704 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-tjdx2_d75f26bb-ac5b-48a0-8733-c18129c905c7/main/0.log" May 21 15:51:27.781508 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:27.781474 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82_dbfdaf86-70ed-4150-9c83-1cc24fe3441e/storage-initializer/0.log" May 21 15:51:27.790238 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:27.790212 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc9qd82_dbfdaf86-70ed-4150-9c83-1cc24fe3441e/main/0.log" May 21 15:51:28.025671 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:28.025645 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf_6dccb0de-90aa-4122-8b32-718b912c3e72/storage-initializer/0.log" May 21 15:51:28.033555 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:28.033533 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-v2xrf_6dccb0de-90aa-4122-8b32-718b912c3e72/main/0.log" May 21 15:51:34.902824 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:34.902790 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-q54fh_8da4a19d-0e83-46b4-9d33-9192394ad102/global-pull-secret-syncer/0.log" May 21 15:51:35.039020 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:35.038993 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-75xw9_fbb8ef5a-6ec7-4038-9753-819b2a74b5d2/konnectivity-agent/0.log" May 21 15:51:35.154944 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:35.154874 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-73.ec2.internal_8ed101524a28eb48a53f5654af1a1159/haproxy/0.log" May 21 15:51:39.530615 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:39.530582 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-tffqk_4f912091-324e-4b2b-bf5a-f2b4187e766b/manager/0.log" May 21 15:51:39.663431 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:39.663397 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-b7cw7_be541c8c-28bc-4104-a850-3ecee06ad18b/manager/0.log" May 21 15:51:41.568076 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:41.568044 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9lrrt_b55dee17-3278-4adf-9074-f41d8bec58af/node-exporter/0.log" May 21 15:51:41.589120 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:41.589082 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9lrrt_b55dee17-3278-4adf-9074-f41d8bec58af/kube-rbac-proxy/0.log" May 21 15:51:41.607622 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:41.607607 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9lrrt_b55dee17-3278-4adf-9074-f41d8bec58af/init-textfile/0.log" May 21 15:51:43.249010 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:43.248979 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x8bl7/perf-node-gather-daemonset-flj8b"] May 21 15:51:43.252273 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:43.252253 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-flj8b" May 21 15:51:43.254390 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:43.254318 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x8bl7\"/\"kube-root-ca.crt\"" May 21 15:51:43.254390 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:43.254320 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x8bl7\"/\"openshift-service-ca.crt\"" May 21 15:51:43.254832 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:43.254811 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-x8bl7\"/\"default-dockercfg-8fvt8\"" May 21 15:51:43.262524 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:43.262504 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x8bl7/perf-node-gather-daemonset-flj8b"] May 21 15:51:43.322243 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:43.322208 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/91beb900-da15-422a-adf7-88c47f1a7424-lib-modules\") pod \"perf-node-gather-daemonset-flj8b\" (UID: \"91beb900-da15-422a-adf7-88c47f1a7424\") " pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-flj8b" May 21 15:51:43.322397 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:43.322248 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91beb900-da15-422a-adf7-88c47f1a7424-sys\") pod \"perf-node-gather-daemonset-flj8b\" (UID: \"91beb900-da15-422a-adf7-88c47f1a7424\") " pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-flj8b" May 21 15:51:43.322397 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:43.322298 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/91beb900-da15-422a-adf7-88c47f1a7424-podres\") pod \"perf-node-gather-daemonset-flj8b\" (UID: \"91beb900-da15-422a-adf7-88c47f1a7424\") " pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-flj8b" May 21 15:51:43.322490 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:43.322399 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/91beb900-da15-422a-adf7-88c47f1a7424-proc\") pod \"perf-node-gather-daemonset-flj8b\" (UID: \"91beb900-da15-422a-adf7-88c47f1a7424\") " pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-flj8b" May 21 15:51:43.322490 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:43.322447 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zfmt\" (UniqueName: \"kubernetes.io/projected/91beb900-da15-422a-adf7-88c47f1a7424-kube-api-access-2zfmt\") pod \"perf-node-gather-daemonset-flj8b\" (UID: \"91beb900-da15-422a-adf7-88c47f1a7424\") " pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-flj8b" May 21 15:51:43.325466 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:43.325450 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-flsp4_9e166c77-8d3b-43e3-ae04-132de04f2d6b/networking-console-plugin/0.log" May 21 15:51:43.423588 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:43.423562 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2zfmt\" (UniqueName: \"kubernetes.io/projected/91beb900-da15-422a-adf7-88c47f1a7424-kube-api-access-2zfmt\") pod \"perf-node-gather-daemonset-flj8b\" (UID: \"91beb900-da15-422a-adf7-88c47f1a7424\") " pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-flj8b" May 21 15:51:43.423698 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:43.423600 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/91beb900-da15-422a-adf7-88c47f1a7424-lib-modules\") pod \"perf-node-gather-daemonset-flj8b\" (UID: \"91beb900-da15-422a-adf7-88c47f1a7424\") " pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-flj8b" May 21 15:51:43.423698 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:43.423620 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91beb900-da15-422a-adf7-88c47f1a7424-sys\") pod \"perf-node-gather-daemonset-flj8b\" (UID: \"91beb900-da15-422a-adf7-88c47f1a7424\") " pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-flj8b" May 21 15:51:43.423698 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:43.423675 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/91beb900-da15-422a-adf7-88c47f1a7424-podres\") pod \"perf-node-gather-daemonset-flj8b\" (UID: \"91beb900-da15-422a-adf7-88c47f1a7424\") " pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-flj8b" May 21 15:51:43.423871 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:43.423767 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/91beb900-da15-422a-adf7-88c47f1a7424-lib-modules\") pod \"perf-node-gather-daemonset-flj8b\" (UID: \"91beb900-da15-422a-adf7-88c47f1a7424\") " pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-flj8b" May 21 15:51:43.423871 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:43.423790 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/91beb900-da15-422a-adf7-88c47f1a7424-proc\") pod \"perf-node-gather-daemonset-flj8b\" (UID: \"91beb900-da15-422a-adf7-88c47f1a7424\") " pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-flj8b" May 21 15:51:43.423871 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:43.423804 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/91beb900-da15-422a-adf7-88c47f1a7424-podres\") pod \"perf-node-gather-daemonset-flj8b\" (UID: \"91beb900-da15-422a-adf7-88c47f1a7424\") " pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-flj8b" May 21 15:51:43.423871 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:43.423773 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91beb900-da15-422a-adf7-88c47f1a7424-sys\") pod \"perf-node-gather-daemonset-flj8b\" (UID: \"91beb900-da15-422a-adf7-88c47f1a7424\") " pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-flj8b" May 21 15:51:43.424015 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:43.423882 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/91beb900-da15-422a-adf7-88c47f1a7424-proc\") pod \"perf-node-gather-daemonset-flj8b\" (UID: \"91beb900-da15-422a-adf7-88c47f1a7424\") " pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-flj8b" May 21 15:51:43.431453 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:43.431429 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zfmt\" (UniqueName: \"kubernetes.io/projected/91beb900-da15-422a-adf7-88c47f1a7424-kube-api-access-2zfmt\") pod \"perf-node-gather-daemonset-flj8b\" (UID: \"91beb900-da15-422a-adf7-88c47f1a7424\") " pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-flj8b" May 21 15:51:43.563263 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:43.563192 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-flj8b" May 21 15:51:43.692851 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:43.692812 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x8bl7/perf-node-gather-daemonset-flj8b"] May 21 15:51:43.695841 ip-10-0-142-73 kubenswrapper[2563]: W0521 15:51:43.695816 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod91beb900_da15_422a_adf7_88c47f1a7424.slice/crio-9b3c0eaade163da62020b8fe8b9920a322ef1a1bf764d60cd78f627969d011ab WatchSource:0}: Error finding container 9b3c0eaade163da62020b8fe8b9920a322ef1a1bf764d60cd78f627969d011ab: Status 404 returned error can't find the container with id 9b3c0eaade163da62020b8fe8b9920a322ef1a1bf764d60cd78f627969d011ab May 21 15:51:43.697538 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:43.697521 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 15:51:44.224025 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:44.223988 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-flj8b" event={"ID":"91beb900-da15-422a-adf7-88c47f1a7424","Type":"ContainerStarted","Data":"bcd311f413a2526b5fe1e0a199e4ec0b899488415aed16b1b8e014a47cfd3154"} May 21 15:51:44.224025 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:44.224028 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-flj8b" event={"ID":"91beb900-da15-422a-adf7-88c47f1a7424","Type":"ContainerStarted","Data":"9b3c0eaade163da62020b8fe8b9920a322ef1a1bf764d60cd78f627969d011ab"} May 21 15:51:44.224219 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:44.224118 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-flj8b" May 21 15:51:44.241575 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:44.241527 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-flj8b" podStartSLOduration=1.241511563 podStartE2EDuration="1.241511563s" podCreationTimestamp="2026-05-21 15:51:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:51:44.239206894 +0000 UTC m=+2319.090649160" watchObservedRunningTime="2026-05-21 15:51:44.241511563 +0000 UTC m=+2319.092953822" May 21 15:51:45.656591 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:45.656558 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l4hfq_92953616-a22e-45da-bab9-689855f9f01d/dns/0.log" May 21 15:51:45.674798 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:45.674774 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l4hfq_92953616-a22e-45da-bab9-689855f9f01d/kube-rbac-proxy/0.log" May 21 15:51:45.721378 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:45.721349 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qk6gn_fee7957c-3284-486f-ab40-ba1ce992878a/dns-node-resolver/0.log" May 21 15:51:46.203040 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:46.203013 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kvk52_867c5016-c412-463c-b76f-abddcdbfae50/node-ca/0.log" May 21 15:51:47.108276 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:47.108247 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-95nfp_f80b0fff-1cf0-4553-b04e-e5579518aae7/discovery/0.log" May 21 15:51:47.153801 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:47.153774 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bd665b65-d9rxp_ed6ce027-c496-4e6e-adb8-6c60f21166f3/kube-auth-proxy/0.log" May 21 15:51:47.274426 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:47.274393 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-sxrmm_f24e9722-6841-40a6-9986-c38e77c95b6a/payload-processing/0.log" May 21 15:51:47.853068 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:47.853029 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5xx2h_cddef031-be16-4fae-94e0-3e4bb6fcf669/serve-healthcheck-canary/0.log" May 21 15:51:48.404502 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:48.404476 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k9vq7_af0d51b3-553a-4ef3-a892-d17bb34dbaf7/kube-rbac-proxy/0.log" May 21 15:51:48.422650 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:48.422617 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k9vq7_af0d51b3-553a-4ef3-a892-d17bb34dbaf7/exporter/0.log" May 21 15:51:48.442626 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:48.442606 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k9vq7_af0d51b3-553a-4ef3-a892-d17bb34dbaf7/extractor/0.log" May 21 15:51:50.236781 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:50.236753 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-x8bl7/perf-node-gather-daemonset-flj8b" May 21 15:51:50.329761 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:50.329721 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-bs7vb_47a4a252-0e8a-4d0a-90a5-907ca863a16b/manager/0.log" May 21 15:51:50.367662 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:50.367637 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5756d8bc58-zwdrt_6f5f6208-b0a8-49c1-96c9-745324fb47b6/maas-api/0.log" May 21 15:51:50.463943 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:50.463912 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-58c48f5cb5-v8hf6_fea45b3f-f064-4ce2-ae4a-3b720fc8e187/manager/0.log" May 21 15:51:50.483444 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:50.483418 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-tdd2v_5f482fb0-9b22-4d74-817a-72ad541fdc1c/manager/0.log" May 21 15:51:50.495040 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:50.494946 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-tdd2v_5f482fb0-9b22-4d74-817a-72ad541fdc1c/manager/1.log" May 21 15:51:50.563502 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:50.563474 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-594496b99d-8r75t_db7da750-b43b-498e-8bbb-3f105aed9011/manager/0.log" May 21 15:51:50.611736 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:50.611708 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-h7w7q_ac139ef9-b591-41fa-8087-f4d28061a060/postgres/0.log" May 21 15:51:57.573939 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:57.573858 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-57tbw_1f245a8f-9cf0-4b38-a9cf-73bd4cb432da/kube-multus-additional-cni-plugins/0.log" May 21 15:51:57.593660 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:57.593631 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-57tbw_1f245a8f-9cf0-4b38-a9cf-73bd4cb432da/egress-router-binary-copy/0.log" May 21 15:51:57.613720 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:57.613694 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-57tbw_1f245a8f-9cf0-4b38-a9cf-73bd4cb432da/cni-plugins/0.log" May 21 15:51:57.633431 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:57.633413 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-57tbw_1f245a8f-9cf0-4b38-a9cf-73bd4cb432da/bond-cni-plugin/0.log" May 21 15:51:57.652470 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:57.652451 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-57tbw_1f245a8f-9cf0-4b38-a9cf-73bd4cb432da/routeoverride-cni/0.log" May 21 15:51:57.671788 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:57.671768 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-57tbw_1f245a8f-9cf0-4b38-a9cf-73bd4cb432da/whereabouts-cni-bincopy/0.log" May 21 15:51:57.689604 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:57.689575 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-57tbw_1f245a8f-9cf0-4b38-a9cf-73bd4cb432da/whereabouts-cni/0.log" May 21 15:51:58.017591 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:58.017565 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bd4zt_33521081-e967-4d23-8420-512dc3b0ca01/kube-multus/0.log" May 21 15:51:58.077215 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:58.077190 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rm6dz_a3f19b43-b2b6-47dc-a66e-e447f95fa680/network-metrics-daemon/0.log" May 21 15:51:58.094087 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:58.094067 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rm6dz_a3f19b43-b2b6-47dc-a66e-e447f95fa680/kube-rbac-proxy/0.log" May 21 15:51:59.249634 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:59.249537 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kvwxg_a4c28d96-338d-4eb5-a40d-0febf25e8d7c/ovn-controller/0.log" May 21 15:51:59.279496 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:59.279458 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kvwxg_a4c28d96-338d-4eb5-a40d-0febf25e8d7c/ovn-acl-logging/0.log" May 21 15:51:59.296956 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:59.296927 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kvwxg_a4c28d96-338d-4eb5-a40d-0febf25e8d7c/kube-rbac-proxy-node/0.log" May 21 15:51:59.315790 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:59.315754 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kvwxg_a4c28d96-338d-4eb5-a40d-0febf25e8d7c/kube-rbac-proxy-ovn-metrics/0.log" May 21 15:51:59.333578 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:59.333538 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kvwxg_a4c28d96-338d-4eb5-a40d-0febf25e8d7c/northd/0.log" May 21 15:51:59.354286 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:59.354242 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kvwxg_a4c28d96-338d-4eb5-a40d-0febf25e8d7c/nbdb/0.log" May 21 15:51:59.373350 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:59.373323 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kvwxg_a4c28d96-338d-4eb5-a40d-0febf25e8d7c/sbdb/0.log" May 21 15:51:59.460426 ip-10-0-142-73 kubenswrapper[2563]: I0521 15:51:59.460401 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kvwxg_a4c28d96-338d-4eb5-a40d-0febf25e8d7c/ovnkube-controller/0.log"