May 21 13:02:17.031827 ip-10-0-143-142 systemd[1]: Starting Kubernetes Kubelet... May 21 13:02:17.455682 ip-10-0-143-142 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 13:02:17.455682 ip-10-0-143-142 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 13:02:17.455682 ip-10-0-143-142 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 13:02:17.455682 ip-10-0-143-142 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 13:02:17.455682 ip-10-0-143-142 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 13:02:17.457231 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.457118 2561 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 13:02:17.463287 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463262 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 13:02:17.463287 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463283 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 13:02:17.463287 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463291 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 13:02:17.463442 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463296 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 13:02:17.463442 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463299 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 13:02:17.463442 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463303 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 13:02:17.463442 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463309 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 13:02:17.463442 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463312 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 13:02:17.463442 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463315 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 13:02:17.463442 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463318 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 13:02:17.463442 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463320 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 13:02:17.463442 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463323 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 13:02:17.463442 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463326 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 13:02:17.463442 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463328 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 13:02:17.463442 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463333 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 13:02:17.463442 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463336 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 13:02:17.463442 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463339 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 13:02:17.463442 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463341 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 13:02:17.463442 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463345 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 13:02:17.463442 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463349 2561 feature_gate.go:328] unrecognized feature gate: Example2 May 21 13:02:17.463442 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463352 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 13:02:17.463442 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463355 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 13:02:17.463442 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463358 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 13:02:17.463932 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463361 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 13:02:17.463932 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463363 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 13:02:17.463932 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463367 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 13:02:17.463932 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463372 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 13:02:17.463932 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463375 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 13:02:17.463932 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463378 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 13:02:17.463932 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463380 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 13:02:17.463932 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463383 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 13:02:17.463932 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463386 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 13:02:17.463932 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463388 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 13:02:17.463932 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463391 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 13:02:17.463932 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463394 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 13:02:17.463932 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463396 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 13:02:17.463932 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463401 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 13:02:17.463932 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463404 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 13:02:17.463932 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463407 2561 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 13:02:17.463932 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463413 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 13:02:17.463932 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463416 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 13:02:17.463932 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463419 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 13:02:17.463932 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463421 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 13:02:17.464396 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463424 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 13:02:17.464396 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463426 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 13:02:17.464396 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463429 2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 13:02:17.464396 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463432 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 13:02:17.464396 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463434 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 13:02:17.464396 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463437 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 13:02:17.464396 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463440 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 13:02:17.464396 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463444 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 13:02:17.464396 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463449 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 13:02:17.464396 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463453 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 13:02:17.464396 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463456 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 13:02:17.464396 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463458 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 13:02:17.464396 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463461 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 13:02:17.464396 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463464 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 13:02:17.464396 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463467 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 13:02:17.464396 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463469 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 13:02:17.464396 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463472 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 13:02:17.464396 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463474 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 13:02:17.464396 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463477 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 13:02:17.464396 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463480 2561 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 13:02:17.464937 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463482 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 13:02:17.464937 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463487 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 13:02:17.464937 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463490 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 13:02:17.464937 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463493 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 13:02:17.464937 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463495 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 13:02:17.464937 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463498 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 13:02:17.464937 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463501 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 13:02:17.464937 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463504 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 13:02:17.464937 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463506 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 13:02:17.464937 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463509 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 13:02:17.464937 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463512 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 13:02:17.464937 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463515 2561 feature_gate.go:328] unrecognized feature gate: Example May 21 13:02:17.464937 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463517 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 13:02:17.464937 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463519 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 13:02:17.464937 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463524 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 13:02:17.464937 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463528 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 13:02:17.464937 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463530 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 13:02:17.464937 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463533 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 13:02:17.464937 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463535 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 13:02:17.464937 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463538 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 13:02:17.465433 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463540 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 13:02:17.465433 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463543 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 13:02:17.465433 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.463546 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 13:02:17.465433 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464520 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 13:02:17.465433 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464525 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 13:02:17.465433 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464528 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 13:02:17.465433 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464531 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 13:02:17.465433 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464534 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 13:02:17.465433 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464537 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 13:02:17.465433 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464543 2561 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 13:02:17.465433 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464546 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 13:02:17.465433 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464549 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 13:02:17.465433 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464551 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 13:02:17.465433 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464554 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 13:02:17.465433 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464557 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 13:02:17.465433 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464560 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 13:02:17.465433 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464563 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 13:02:17.465433 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464579 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 13:02:17.465433 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464584 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 13:02:17.465433 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464589 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 13:02:17.466005 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464592 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 13:02:17.466005 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464598 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 13:02:17.466005 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464600 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 13:02:17.466005 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464603 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 13:02:17.466005 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464606 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 13:02:17.466005 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464608 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 13:02:17.466005 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464611 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 13:02:17.466005 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464613 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 13:02:17.466005 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464616 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 13:02:17.466005 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464618 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 13:02:17.466005 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464621 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 13:02:17.466005 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464624 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 13:02:17.466005 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464626 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 13:02:17.466005 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464629 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 13:02:17.466005 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464636 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 13:02:17.466005 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464641 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 13:02:17.466005 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464645 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 13:02:17.466005 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464649 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 13:02:17.466005 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464652 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 13:02:17.466511 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464655 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 13:02:17.466511 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464657 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 13:02:17.466511 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464660 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 13:02:17.466511 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464663 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 13:02:17.466511 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464666 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 13:02:17.466511 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464669 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 13:02:17.466511 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464671 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 13:02:17.466511 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464676 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 13:02:17.466511 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464679 2561 feature_gate.go:328] unrecognized feature gate: Example May 21 13:02:17.466511 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464682 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 13:02:17.466511 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464684 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 13:02:17.466511 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464687 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 13:02:17.466511 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464689 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 13:02:17.466511 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464692 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 13:02:17.466511 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464694 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 13:02:17.466511 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464697 2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 13:02:17.466511 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464700 2561 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 13:02:17.466511 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464703 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 13:02:17.466511 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464706 2561 feature_gate.go:328] unrecognized feature gate: Example2 May 21 13:02:17.466511 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464708 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 13:02:17.467045 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464713 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 13:02:17.467045 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464716 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 13:02:17.467045 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464718 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 13:02:17.467045 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464721 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 13:02:17.467045 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464723 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 13:02:17.467045 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464726 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 13:02:17.467045 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464729 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 13:02:17.467045 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464732 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 13:02:17.467045 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464734 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 13:02:17.467045 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464737 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 13:02:17.467045 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464739 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 13:02:17.467045 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464742 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 13:02:17.467045 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464747 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 13:02:17.467045 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464749 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 13:02:17.467045 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464751 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 13:02:17.467045 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464754 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 13:02:17.467045 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464757 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 13:02:17.467045 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464759 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 13:02:17.467045 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464762 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 13:02:17.467045 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464764 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 13:02:17.467526 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464768 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 13:02:17.467526 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464771 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 13:02:17.467526 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464773 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 13:02:17.467526 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464776 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 13:02:17.467526 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464778 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 13:02:17.467526 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464784 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 13:02:17.467526 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464787 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 13:02:17.467526 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464789 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 13:02:17.467526 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464792 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 13:02:17.467526 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.464795 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 13:02:17.467526 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466577 2561 flags.go:64] FLAG: --address="0.0.0.0" May 21 13:02:17.467526 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466591 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 13:02:17.467526 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466599 2561 flags.go:64] FLAG: --anonymous-auth="true" May 21 13:02:17.467526 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466603 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 13:02:17.467526 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466608 2561 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 13:02:17.467526 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466611 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 13:02:17.467526 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466616 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 13:02:17.467526 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466620 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 13:02:17.467526 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466623 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 13:02:17.467526 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466626 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 13:02:17.467526 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466629 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 13:02:17.467526 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466632 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 13:02:17.468059 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466635 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 13:02:17.468059 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466638 2561 flags.go:64] FLAG: --cgroup-root="" May 21 13:02:17.468059 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466641 2561 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 13:02:17.468059 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466644 2561 flags.go:64] FLAG: --client-ca-file="" May 21 13:02:17.468059 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466647 2561 flags.go:64] FLAG: --cloud-config="" May 21 13:02:17.468059 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466649 2561 flags.go:64] FLAG: --cloud-provider="external" May 21 13:02:17.468059 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466652 2561 flags.go:64] FLAG: --cluster-dns="[]" May 21 13:02:17.468059 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466657 2561 flags.go:64] FLAG: --cluster-domain="" May 21 13:02:17.468059 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466660 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 13:02:17.468059 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466663 2561 flags.go:64] FLAG: --config-dir="" May 21 13:02:17.468059 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466666 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 13:02:17.468059 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466670 2561 flags.go:64] FLAG: --container-log-max-files="5" May 21 13:02:17.468059 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466674 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 13:02:17.468059 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466676 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 13:02:17.468059 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466681 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 13:02:17.468059 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466684 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 13:02:17.468059 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466687 2561 flags.go:64] FLAG: --contention-profiling="false" May 21 13:02:17.468059 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466690 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 13:02:17.468059 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466693 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 13:02:17.468059 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466696 2561 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 13:02:17.468059 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466699 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 13:02:17.468059 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466703 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 13:02:17.468059 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466706 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 13:02:17.468059 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466709 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 13:02:17.468059 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466711 2561 flags.go:64] FLAG: --enable-load-reader="false" May 21 13:02:17.468664 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466714 2561 flags.go:64] FLAG: --enable-server="true" May 21 13:02:17.468664 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466717 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 13:02:17.468664 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466721 2561 flags.go:64] FLAG: --event-burst="100" May 21 13:02:17.468664 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466724 2561 flags.go:64] FLAG: --event-qps="50" May 21 13:02:17.468664 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466727 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 13:02:17.468664 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466730 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 13:02:17.468664 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466733 2561 flags.go:64] FLAG: --eviction-hard="" May 21 13:02:17.468664 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466737 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 13:02:17.468664 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466740 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 13:02:17.468664 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466743 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 13:02:17.468664 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466746 2561 flags.go:64] FLAG: --eviction-soft="" May 21 13:02:17.468664 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466748 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 13:02:17.468664 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466751 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 13:02:17.468664 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466754 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 13:02:17.468664 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466756 2561 flags.go:64] FLAG: --experimental-mounter-path="" May 21 13:02:17.468664 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466759 2561 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 13:02:17.468664 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466762 2561 flags.go:64] FLAG: --fail-swap-on="true" May 21 13:02:17.468664 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466765 2561 flags.go:64] FLAG: --feature-gates="" May 21 13:02:17.468664 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466769 2561 flags.go:64] FLAG: --file-check-frequency="20s" May 21 13:02:17.468664 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466772 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 13:02:17.468664 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466776 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 13:02:17.468664 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466779 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 13:02:17.468664 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466782 2561 flags.go:64] FLAG: --healthz-port="10248" May 21 13:02:17.468664 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466785 2561 flags.go:64] FLAG: --help="false" May 21 13:02:17.468664 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466787 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-143-142.ec2.internal" May 21 13:02:17.469270 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466790 2561 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 13:02:17.469270 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466793 2561 flags.go:64] FLAG: --http-check-frequency="20s" May 21 13:02:17.469270 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466796 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 13:02:17.469270 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466800 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 13:02:17.469270 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466804 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 13:02:17.469270 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466807 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 13:02:17.469270 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466810 2561 flags.go:64] FLAG: --image-service-endpoint="" May 21 13:02:17.469270 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466813 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 13:02:17.469270 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466816 2561 flags.go:64] FLAG: --kube-api-burst="100" May 21 13:02:17.469270 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466819 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 13:02:17.469270 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466822 2561 flags.go:64] FLAG: --kube-api-qps="50" May 21 13:02:17.469270 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466825 2561 flags.go:64] FLAG: --kube-reserved="" May 21 13:02:17.469270 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466828 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 13:02:17.469270 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466831 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 13:02:17.469270 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466834 2561 flags.go:64] FLAG: --kubelet-cgroups="" May 21 13:02:17.469270 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466836 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 13:02:17.469270 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466839 2561 flags.go:64] FLAG: --lock-file="" May 21 13:02:17.469270 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466842 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 13:02:17.469270 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466845 2561 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 13:02:17.469270 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466848 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 13:02:17.469270 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466858 2561 flags.go:64] FLAG: --log-json-split-stream="false" May 21 13:02:17.469270 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466861 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 13:02:17.469270 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466865 2561 flags.go:64] FLAG: --log-text-split-stream="false" May 21 13:02:17.469270 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466869 2561 flags.go:64] FLAG: --logging-format="text" May 21 13:02:17.470888 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466872 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 13:02:17.470888 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466875 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 13:02:17.470888 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466878 2561 flags.go:64] FLAG: --manifest-url="" May 21 13:02:17.470888 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466880 2561 flags.go:64] FLAG: --manifest-url-header="" May 21 13:02:17.470888 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466887 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 13:02:17.470888 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466890 2561 flags.go:64] FLAG: --max-open-files="1000000" May 21 13:02:17.470888 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466894 2561 flags.go:64] FLAG: --max-pods="110" May 21 13:02:17.470888 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466897 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 13:02:17.470888 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466900 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 13:02:17.470888 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466903 2561 flags.go:64] FLAG: --memory-manager-policy="None" May 21 13:02:17.470888 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466906 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 13:02:17.470888 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466909 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 13:02:17.470888 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466911 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 13:02:17.470888 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466914 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 13:02:17.470888 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466923 2561 flags.go:64] FLAG: --node-status-max-images="50" May 21 13:02:17.470888 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466926 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 13:02:17.470888 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466931 2561 flags.go:64] FLAG: --oom-score-adj="-999" May 21 13:02:17.470888 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466935 2561 flags.go:64] FLAG: --pod-cidr="" May 21 13:02:17.470888 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466939 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 13:02:17.470888 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466944 2561 flags.go:64] FLAG: --pod-manifest-path="" May 21 13:02:17.470888 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466947 2561 flags.go:64] FLAG: --pod-max-pids="-1" May 21 13:02:17.470888 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466950 2561 flags.go:64] FLAG: --pods-per-core="0" May 21 13:02:17.470888 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466952 2561 flags.go:64] FLAG: --port="10250" May 21 13:02:17.470888 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466955 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 13:02:17.471481 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466958 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bb81ed750235ae46" May 21 13:02:17.471481 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466961 2561 flags.go:64] FLAG: --qos-reserved="" May 21 13:02:17.471481 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466964 2561 flags.go:64] FLAG: --read-only-port="10255" May 21 13:02:17.471481 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466967 2561 flags.go:64] FLAG: --register-node="true" May 21 13:02:17.471481 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466969 2561 flags.go:64] FLAG: --register-schedulable="true" May 21 13:02:17.471481 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466972 2561 flags.go:64] FLAG: --register-with-taints="" May 21 13:02:17.471481 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466976 2561 flags.go:64] FLAG: --registry-burst="10" May 21 13:02:17.471481 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466979 2561 flags.go:64] FLAG: --registry-qps="5" May 21 13:02:17.471481 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466982 2561 flags.go:64] FLAG: --reserved-cpus="" May 21 13:02:17.471481 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466984 2561 flags.go:64] FLAG: --reserved-memory="" May 21 13:02:17.471481 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466988 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 13:02:17.471481 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466990 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 13:02:17.471481 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466993 2561 flags.go:64] FLAG: --rotate-certificates="false" May 21 13:02:17.471481 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466996 2561 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 13:02:17.471481 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.466999 2561 flags.go:64] FLAG: --runonce="false" May 21 13:02:17.471481 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.467001 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 13:02:17.471481 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.467004 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 13:02:17.471481 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.467007 2561 flags.go:64] FLAG: --seccomp-default="false" May 21 13:02:17.471481 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.467009 2561 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 13:02:17.471481 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.467012 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 13:02:17.471481 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.467015 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 13:02:17.471481 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.467018 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 13:02:17.471481 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.467020 2561 flags.go:64] FLAG: --storage-driver-password="root" May 21 13:02:17.471481 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.467023 2561 flags.go:64] FLAG: --storage-driver-secure="false" May 21 13:02:17.471481 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.467028 2561 flags.go:64] FLAG: --storage-driver-table="stats" May 21 13:02:17.471481 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.467030 2561 flags.go:64] FLAG: --storage-driver-user="root" May 21 13:02:17.472107 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.467034 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 13:02:17.472107 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.467037 2561 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 13:02:17.472107 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.467039 2561 flags.go:64] FLAG: --system-cgroups="" May 21 13:02:17.472107 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.467042 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 13:02:17.472107 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.467048 2561 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 13:02:17.472107 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.467051 2561 flags.go:64] FLAG: --tls-cert-file="" May 21 13:02:17.472107 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.467053 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 13:02:17.472107 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.467058 2561 flags.go:64] FLAG: --tls-min-version="" May 21 13:02:17.472107 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.467061 2561 flags.go:64] FLAG: --tls-private-key-file="" May 21 13:02:17.472107 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.467064 2561 flags.go:64] FLAG: --topology-manager-policy="none" May 21 13:02:17.472107 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.467066 2561 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 13:02:17.472107 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.467069 2561 flags.go:64] FLAG: --topology-manager-scope="container" May 21 13:02:17.472107 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.467072 2561 flags.go:64] FLAG: --v="2" May 21 13:02:17.472107 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.467076 2561 flags.go:64] FLAG: --version="false" May 21 13:02:17.472107 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.467080 2561 flags.go:64] FLAG: --vmodule="" May 21 13:02:17.472107 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.467085 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 13:02:17.472107 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.467088 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 13:02:17.472107 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467182 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 13:02:17.472107 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467185 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 13:02:17.472107 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467188 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 13:02:17.472107 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467190 2561 feature_gate.go:328] unrecognized feature gate: Example May 21 13:02:17.472107 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467193 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 13:02:17.472107 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467195 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 13:02:17.472107 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467198 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 13:02:17.472696 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467201 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 13:02:17.472696 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467203 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 13:02:17.472696 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467206 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 13:02:17.472696 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467208 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 13:02:17.472696 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467211 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 13:02:17.472696 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467213 2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 13:02:17.472696 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467217 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 13:02:17.472696 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467219 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 13:02:17.472696 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467223 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 13:02:17.472696 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467226 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 13:02:17.472696 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467229 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 13:02:17.472696 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467231 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 13:02:17.472696 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467234 2561 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 13:02:17.472696 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467236 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 13:02:17.472696 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467240 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 13:02:17.472696 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467243 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 13:02:17.472696 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467246 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 13:02:17.472696 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467248 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 13:02:17.472696 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467251 2561 feature_gate.go:328] unrecognized feature gate: Example2 May 21 13:02:17.473239 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467253 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 13:02:17.473239 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467256 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 13:02:17.473239 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467260 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 13:02:17.473239 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467263 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 13:02:17.473239 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467266 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 13:02:17.473239 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467269 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 13:02:17.473239 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467272 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 13:02:17.473239 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467274 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 13:02:17.473239 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467277 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 13:02:17.473239 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467279 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 13:02:17.473239 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467282 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 13:02:17.473239 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467284 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 13:02:17.473239 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467287 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 13:02:17.473239 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467290 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 13:02:17.473239 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467292 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 13:02:17.473239 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467295 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 13:02:17.473239 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467297 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 13:02:17.473239 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467299 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 13:02:17.473239 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467302 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 13:02:17.473734 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467304 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 13:02:17.473734 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467307 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 13:02:17.473734 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467309 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 13:02:17.473734 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467311 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 13:02:17.473734 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467314 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 13:02:17.473734 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467317 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 13:02:17.473734 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467319 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 13:02:17.473734 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467322 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 13:02:17.473734 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467324 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 13:02:17.473734 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467326 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 13:02:17.473734 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467329 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 13:02:17.473734 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467331 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 13:02:17.473734 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467334 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 13:02:17.473734 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467336 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 13:02:17.473734 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467339 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 13:02:17.473734 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467341 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 13:02:17.473734 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467344 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 13:02:17.473734 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467346 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 13:02:17.473734 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467349 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 13:02:17.473734 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467351 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 13:02:17.474308 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467354 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 13:02:17.474308 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467356 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 13:02:17.474308 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467359 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 13:02:17.474308 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467361 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 13:02:17.474308 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467363 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 13:02:17.474308 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467366 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 13:02:17.474308 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467368 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 13:02:17.474308 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467371 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 13:02:17.474308 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467373 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 13:02:17.474308 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467376 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 13:02:17.474308 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467378 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 13:02:17.474308 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467380 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 13:02:17.474308 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467383 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 13:02:17.474308 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467385 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 13:02:17.474308 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467388 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 13:02:17.474308 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467390 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 13:02:17.474308 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467392 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 13:02:17.474308 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467395 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 13:02:17.474308 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467398 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 13:02:17.474788 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467400 2561 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 13:02:17.474788 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.467402 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 13:02:17.474788 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.468028 2561 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 13:02:17.474788 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.474457 2561 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 13:02:17.474788 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.474473 2561 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 13:02:17.474788 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474521 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 13:02:17.474788 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474527 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 13:02:17.474788 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474530 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 13:02:17.474788 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474533 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 13:02:17.474788 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474538 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 13:02:17.474788 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474543 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 13:02:17.474788 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474546 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 13:02:17.474788 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474549 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 13:02:17.474788 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474552 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 13:02:17.474788 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474555 2561 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 13:02:17.474788 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474558 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 13:02:17.475180 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474561 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 13:02:17.475180 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474579 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 13:02:17.475180 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474583 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 13:02:17.475180 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474586 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 13:02:17.475180 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474589 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 13:02:17.475180 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474592 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 13:02:17.475180 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474594 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 13:02:17.475180 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474597 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 13:02:17.475180 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474600 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 13:02:17.475180 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474604 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 13:02:17.475180 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474607 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 13:02:17.475180 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474610 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 13:02:17.475180 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474613 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 13:02:17.475180 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474616 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 13:02:17.475180 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474620 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 13:02:17.475180 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474623 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 13:02:17.475180 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474626 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 13:02:17.475180 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474629 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 13:02:17.475180 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474631 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 13:02:17.475650 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474634 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 13:02:17.475650 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474638 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 13:02:17.475650 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474641 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 13:02:17.475650 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474643 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 13:02:17.475650 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474646 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 13:02:17.475650 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474648 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 13:02:17.475650 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474651 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 13:02:17.475650 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474653 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 13:02:17.475650 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474656 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 13:02:17.475650 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474658 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 13:02:17.475650 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474661 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 13:02:17.475650 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474664 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 13:02:17.475650 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474666 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 13:02:17.475650 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474668 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 13:02:17.475650 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474671 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 13:02:17.475650 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474673 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 13:02:17.475650 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474676 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 13:02:17.475650 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474679 2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 13:02:17.475650 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474681 2561 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 13:02:17.475650 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474683 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 13:02:17.476131 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474686 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 13:02:17.476131 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474688 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 13:02:17.476131 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474691 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 13:02:17.476131 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474693 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 13:02:17.476131 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474696 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 13:02:17.476131 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474698 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 13:02:17.476131 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474700 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 13:02:17.476131 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474703 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 13:02:17.476131 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474706 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 13:02:17.476131 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474708 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 13:02:17.476131 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474711 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 13:02:17.476131 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474714 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 13:02:17.476131 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474716 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 13:02:17.476131 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474719 2561 feature_gate.go:328] unrecognized feature gate: Example2 May 21 13:02:17.476131 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474721 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 13:02:17.476131 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474723 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 13:02:17.476131 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474726 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 13:02:17.476131 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474728 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 13:02:17.476131 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474731 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 13:02:17.476131 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474733 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 13:02:17.476615 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474736 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 13:02:17.476615 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474738 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 13:02:17.476615 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474741 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 13:02:17.476615 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474743 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 13:02:17.476615 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474745 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 13:02:17.476615 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474748 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 13:02:17.476615 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474750 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 13:02:17.476615 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474753 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 13:02:17.476615 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474755 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 13:02:17.476615 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474758 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 13:02:17.476615 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474760 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 13:02:17.476615 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474763 2561 feature_gate.go:328] unrecognized feature gate: Example May 21 13:02:17.476615 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474765 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 13:02:17.476615 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474768 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 13:02:17.476615 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474770 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 13:02:17.476615 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474773 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 13:02:17.476992 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.474778 2561 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 13:02:17.476992 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474879 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 13:02:17.476992 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474883 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 13:02:17.476992 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474886 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 13:02:17.476992 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474889 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 13:02:17.476992 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474895 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 13:02:17.476992 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474898 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 13:02:17.476992 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474901 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 13:02:17.476992 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474903 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 13:02:17.476992 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474906 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 13:02:17.476992 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474908 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 13:02:17.476992 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474911 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 13:02:17.476992 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474913 2561 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 13:02:17.476992 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474916 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 13:02:17.476992 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474918 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 13:02:17.476992 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474921 2561 feature_gate.go:328] unrecognized feature gate: Example2 May 21 13:02:17.477411 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474923 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 13:02:17.477411 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474926 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 13:02:17.477411 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474928 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 13:02:17.477411 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474930 2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 13:02:17.477411 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474933 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 13:02:17.477411 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474935 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 13:02:17.477411 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474937 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 13:02:17.477411 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474940 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 13:02:17.477411 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474943 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 13:02:17.477411 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474945 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 13:02:17.477411 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474947 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 13:02:17.477411 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474950 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 13:02:17.477411 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474952 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 13:02:17.477411 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474955 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 13:02:17.477411 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474957 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 13:02:17.477411 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474960 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 13:02:17.477411 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474962 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 13:02:17.477411 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474965 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 13:02:17.477411 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474967 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 13:02:17.477411 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474969 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 13:02:17.477920 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474971 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 13:02:17.477920 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474974 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 13:02:17.477920 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474978 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 13:02:17.477920 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474980 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 13:02:17.477920 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474983 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 13:02:17.477920 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474985 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 13:02:17.477920 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474988 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 13:02:17.477920 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474990 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 13:02:17.477920 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474993 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 13:02:17.477920 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474995 2561 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 13:02:17.477920 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.474997 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 13:02:17.477920 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475000 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 13:02:17.477920 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475002 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 13:02:17.477920 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475004 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 13:02:17.477920 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475007 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 13:02:17.477920 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475009 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 13:02:17.477920 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475012 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 13:02:17.477920 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475014 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 13:02:17.477920 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475017 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 13:02:17.477920 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475019 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 13:02:17.478417 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475022 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 13:02:17.478417 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475025 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 13:02:17.478417 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475027 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 13:02:17.478417 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475030 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 13:02:17.478417 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475034 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 13:02:17.478417 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475036 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 13:02:17.478417 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475039 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 13:02:17.478417 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475041 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 13:02:17.478417 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475044 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 13:02:17.478417 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475046 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 13:02:17.478417 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475048 2561 feature_gate.go:328] unrecognized feature gate: Example May 21 13:02:17.478417 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475051 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 13:02:17.478417 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475053 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 13:02:17.478417 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475056 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 13:02:17.478417 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475058 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 13:02:17.478417 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475064 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 13:02:17.478417 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475067 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 13:02:17.478417 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475070 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 13:02:17.478417 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475072 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 13:02:17.478417 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475075 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 13:02:17.478896 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475077 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 13:02:17.478896 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475080 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 13:02:17.478896 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475082 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 13:02:17.478896 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475084 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 13:02:17.478896 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475087 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 13:02:17.478896 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475089 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 13:02:17.478896 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475092 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 13:02:17.478896 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475096 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 13:02:17.478896 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475099 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 13:02:17.478896 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475101 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 13:02:17.478896 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:17.475104 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 13:02:17.478896 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.475109 2561 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 13:02:17.478896 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.475777 2561 server.go:962] "Client rotation is on, will bootstrap in background" May 21 13:02:17.478896 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.477651 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 13:02:17.479236 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.479163 2561 server.go:1019] "Starting client certificate rotation" May 21 13:02:17.479271 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.479257 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 13:02:17.479305 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.479292 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 13:02:17.501532 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.501514 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 13:02:17.504434 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.504418 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 13:02:17.516645 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.516626 2561 log.go:25] "Validated CRI v1 runtime API" May 21 13:02:17.521603 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.521587 2561 log.go:25] "Validated CRI v1 image API" May 21 13:02:17.524228 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.524214 2561 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 13:02:17.526391 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.526361 2561 fs.go:135] Filesystem UUIDs: map[1aa6e8db-e86f-4fd8-b7ba-a02aed2d70ad:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d9de5518-e8cf-4d40-8aee-27a8ad25a83e:/dev/nvme0n1p3] May 21 13:02:17.526491 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.526389 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 13:02:17.531550 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.531387 2561 manager.go:217] Machine: {Timestamp:2026-05-21 13:02:17.530862803 +0000 UTC m=+0.385574284 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3172871 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec289b3b12600274c2bed8aeb2d8c38a SystemUUID:ec289b3b-1260-0274-c2be-d8aeb2d8c38a BootID:5338d5f1-f9bd-4f3d-9841-b0319cab2e36 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:86:db:f8:1d:37 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:86:db:f8:1d:37 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:7b:7d:c2:34:45 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 13:02:17.531550 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.531542 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 13:02:17.531687 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.531639 2561 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 13:02:17.532904 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.532879 2561 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 13:02:17.533031 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.532906 2561 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-142.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 13:02:17.533072 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.533040 2561 topology_manager.go:138] "Creating topology manager with none policy" May 21 13:02:17.533072 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.533048 2561 container_manager_linux.go:306] "Creating device plugin manager" May 21 13:02:17.533072 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.533056 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 13:02:17.533158 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.533072 2561 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 13:02:17.534460 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.534438 2561 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 13:02:17.534838 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.534825 2561 state_mem.go:36] "Initialized new in-memory state store" May 21 13:02:17.534950 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.534941 2561 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 13:02:17.538027 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.538017 2561 kubelet.go:491] "Attempting to sync node with API server" May 21 13:02:17.538072 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.538030 2561 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 13:02:17.538641 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.538632 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 13:02:17.538699 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.538644 2561 kubelet.go:397] "Adding apiserver pod source" May 21 13:02:17.538699 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.538653 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 13:02:17.539643 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.539632 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 13:02:17.539684 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.539651 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 13:02:17.542403 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.542389 2561 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 13:02:17.543962 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.543942 2561 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 13:02:17.545156 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.545144 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 13:02:17.545206 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.545161 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 13:02:17.545206 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.545167 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 13:02:17.545206 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.545172 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 13:02:17.545206 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.545187 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 13:02:17.545206 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.545193 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 13:02:17.545206 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.545200 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 13:02:17.545206 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.545205 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 13:02:17.545395 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.545212 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 13:02:17.545395 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.545217 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 13:02:17.545395 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.545244 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 13:02:17.545468 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.545446 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 13:02:17.546239 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.546229 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 13:02:17.546271 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.546239 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 13:02:17.549327 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.549314 2561 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 13:02:17.549373 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.549352 2561 server.go:1295] "Started kubelet" May 21 13:02:17.549428 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.549402 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 13:02:17.550019 ip-10-0-143-142 systemd[1]: Started Kubernetes Kubelet. May 21 13:02:17.550398 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.550119 2561 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 13:02:17.550398 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.550185 2561 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 13:02:17.550514 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.550419 2561 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-142.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 21 13:02:17.551376 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:17.551356 2561 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-142.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 13:02:17.551421 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:17.551359 2561 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 13:02:17.551664 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.551648 2561 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 13:02:17.552266 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.552251 2561 server.go:317] "Adding debug handlers to kubelet server" May 21 13:02:17.554860 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:17.553909 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-142.ec2.internal.18b19641e5224d25 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-142.ec2.internal,UID:ip-10-0-143-142.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-142.ec2.internal,},FirstTimestamp:2026-05-21 13:02:17.549327653 +0000 UTC m=+0.404039134,LastTimestamp:2026-05-21 13:02:17.549327653 +0000 UTC m=+0.404039134,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-142.ec2.internal,}" May 21 13:02:17.555810 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.555791 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 13:02:17.555878 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.555810 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 13:02:17.555989 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.555967 2561 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 13:02:17.555989 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.555986 2561 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 13:02:17.556129 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.556074 2561 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 13:02:17.556129 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.556114 2561 reconstruct.go:97] "Volume reconstruction finished" May 21 13:02:17.556129 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.556121 2561 reconciler.go:26] "Reconciler: start to sync state" May 21 13:02:17.556635 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:17.556618 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-142.ec2.internal\" not found" May 21 13:02:17.559759 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.559741 2561 factory.go:55] Registering systemd factory May 21 13:02:17.559853 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.559799 2561 factory.go:223] Registration of the systemd container factory successfully May 21 13:02:17.560460 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.560173 2561 factory.go:153] Registering CRI-O factory May 21 13:02:17.560460 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.560191 2561 factory.go:223] Registration of the crio container factory successfully May 21 13:02:17.560460 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:17.560234 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-142.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 21 13:02:17.560460 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.560246 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 13:02:17.560460 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.560268 2561 factory.go:103] Registering Raw factory May 21 13:02:17.560460 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.560284 2561 manager.go:1196] Started watching for new ooms in manager May 21 13:02:17.560460 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:17.560289 2561 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 21 13:02:17.560946 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.560917 2561 manager.go:319] Starting recovery of all containers May 21 13:02:17.562422 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:17.562397 2561 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 13:02:17.572483 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.572343 2561 manager.go:324] Recovery completed May 21 13:02:17.573708 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:17.573685 2561 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory May 21 13:02:17.576526 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.576515 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 13:02:17.578539 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.578521 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasSufficientMemory" May 21 13:02:17.578616 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.578601 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasNoDiskPressure" May 21 13:02:17.578671 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.578628 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasSufficientPID" May 21 13:02:17.579286 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.579271 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 13:02:17.579286 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.579286 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 13:02:17.579377 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.579318 2561 state_mem.go:36] "Initialized new in-memory state store" May 21 13:02:17.580478 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:17.580416 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-142.ec2.internal.18b19641e6e01526 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-142.ec2.internal,UID:ip-10-0-143-142.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-142.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-142.ec2.internal,},FirstTimestamp:2026-05-21 13:02:17.578542374 +0000 UTC m=+0.433253861,LastTimestamp:2026-05-21 13:02:17.578542374 +0000 UTC m=+0.433253861,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-142.ec2.internal,}" May 21 13:02:17.581677 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.581663 2561 policy_none.go:49] "None policy: Start" May 21 13:02:17.581677 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.581679 2561 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 13:02:17.581769 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.581690 2561 state_mem.go:35] "Initializing new in-memory state store" May 21 13:02:17.587385 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.587368 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8f4d6" May 21 13:02:17.590088 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:17.590018 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-142.ec2.internal.18b19641e6e1230e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-142.ec2.internal,UID:ip-10-0-143-142.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-142.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-142.ec2.internal,},FirstTimestamp:2026-05-21 13:02:17.57861147 +0000 UTC m=+0.433322953,LastTimestamp:2026-05-21 13:02:17.57861147 +0000 UTC m=+0.433322953,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-142.ec2.internal,}" May 21 13:02:17.597310 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.597290 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8f4d6" May 21 13:02:17.598896 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:17.598836 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-142.ec2.internal.18b19641e6e1802b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-142.ec2.internal,UID:ip-10-0-143-142.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-142.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-142.ec2.internal,},FirstTimestamp:2026-05-21 13:02:17.578635307 +0000 UTC m=+0.433346790,LastTimestamp:2026-05-21 13:02:17.578635307 +0000 UTC m=+0.433346790,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-142.ec2.internal,}" May 21 13:02:17.620749 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.617750 2561 manager.go:341] "Starting Device Plugin manager" May 21 13:02:17.620749 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:17.617776 2561 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 13:02:17.620749 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.617786 2561 server.go:85] "Starting device plugin registration server" May 21 13:02:17.620749 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.618022 2561 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 13:02:17.620749 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.618033 2561 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 13:02:17.620749 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.618122 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 13:02:17.620749 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.618201 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 13:02:17.620749 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.618209 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 13:02:17.620749 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:17.619039 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 13:02:17.620749 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:17.619069 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-142.ec2.internal\" not found" May 21 13:02:17.685620 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.685588 2561 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 13:02:17.686790 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.686774 2561 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 13:02:17.686862 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.686803 2561 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 13:02:17.686862 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.686821 2561 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 13:02:17.686862 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.686827 2561 kubelet.go:2451] "Starting kubelet main sync loop" May 21 13:02:17.686984 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:17.686866 2561 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 13:02:17.689728 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.689712 2561 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 13:02:17.718735 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.718666 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 13:02:17.719797 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.719775 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasSufficientMemory" May 21 13:02:17.719899 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.719809 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasNoDiskPressure" May 21 13:02:17.719899 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.719824 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasSufficientPID" May 21 13:02:17.719899 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.719856 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-142.ec2.internal" May 21 13:02:17.732917 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.732895 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-142.ec2.internal" May 21 13:02:17.732993 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:17.732921 2561 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-142.ec2.internal\": node \"ip-10-0-143-142.ec2.internal\" not found" May 21 13:02:17.752724 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:17.751713 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-142.ec2.internal\" not found" May 21 13:02:17.787136 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.787091 2561 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-142.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal"] May 21 13:02:17.787287 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.787167 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 13:02:17.789879 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.789863 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasSufficientMemory" May 21 13:02:17.789970 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.789888 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasNoDiskPressure" May 21 13:02:17.789970 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.789898 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasSufficientPID" May 21 13:02:17.791093 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.791082 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 13:02:17.791241 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.791225 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-142.ec2.internal" May 21 13:02:17.791290 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.791254 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 13:02:17.792195 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.792180 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasSufficientMemory" May 21 13:02:17.792278 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.792206 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasNoDiskPressure" May 21 13:02:17.792278 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.792219 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasSufficientPID" May 21 13:02:17.792278 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.792220 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasSufficientMemory" May 21 13:02:17.792278 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.792238 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasNoDiskPressure" May 21 13:02:17.792278 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.792247 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasSufficientPID" May 21 13:02:17.793355 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.793340 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal" May 21 13:02:17.793439 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.793363 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 13:02:17.794086 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.794072 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasSufficientMemory" May 21 13:02:17.794174 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.794103 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasNoDiskPressure" May 21 13:02:17.794174 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.794118 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeHasSufficientPID" May 21 13:02:17.819286 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:17.819261 2561 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-142.ec2.internal\" not found" node="ip-10-0-143-142.ec2.internal" May 21 13:02:17.823814 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:17.823798 2561 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-142.ec2.internal\" not found" node="ip-10-0-143-142.ec2.internal" May 21 13:02:17.852722 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:17.852699 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-142.ec2.internal\" not found" May 21 13:02:17.952847 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:17.952815 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-142.ec2.internal\" not found" May 21 13:02:17.957940 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.957922 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a38ea9a58019d421754c06e634aaf4f8-config\") pod \"kube-apiserver-proxy-ip-10-0-143-142.ec2.internal\" (UID: \"a38ea9a58019d421754c06e634aaf4f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-142.ec2.internal" May 21 13:02:17.957995 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.957950 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9c2f61b69c4ebcd1af01e7a032d7d756-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal\" (UID: \"9c2f61b69c4ebcd1af01e7a032d7d756\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal" May 21 13:02:17.957995 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:17.957973 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c2f61b69c4ebcd1af01e7a032d7d756-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal\" (UID: \"9c2f61b69c4ebcd1af01e7a032d7d756\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal" May 21 13:02:18.053853 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:18.053792 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-142.ec2.internal\" not found" May 21 13:02:18.059104 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:18.059086 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a38ea9a58019d421754c06e634aaf4f8-config\") pod \"kube-apiserver-proxy-ip-10-0-143-142.ec2.internal\" (UID: \"a38ea9a58019d421754c06e634aaf4f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-142.ec2.internal" May 21 13:02:18.059150 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:18.059113 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9c2f61b69c4ebcd1af01e7a032d7d756-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal\" (UID: \"9c2f61b69c4ebcd1af01e7a032d7d756\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal" May 21 13:02:18.059150 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:18.059132 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c2f61b69c4ebcd1af01e7a032d7d756-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal\" (UID: \"9c2f61b69c4ebcd1af01e7a032d7d756\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal" May 21 13:02:18.059223 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:18.059188 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c2f61b69c4ebcd1af01e7a032d7d756-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal\" (UID: \"9c2f61b69c4ebcd1af01e7a032d7d756\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal" May 21 13:02:18.059223 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:18.059191 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a38ea9a58019d421754c06e634aaf4f8-config\") pod \"kube-apiserver-proxy-ip-10-0-143-142.ec2.internal\" (UID: \"a38ea9a58019d421754c06e634aaf4f8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-142.ec2.internal" May 21 13:02:18.059223 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:18.059194 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9c2f61b69c4ebcd1af01e7a032d7d756-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal\" (UID: \"9c2f61b69c4ebcd1af01e7a032d7d756\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal" May 21 13:02:18.122271 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:18.122234 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-142.ec2.internal" May 21 13:02:18.125989 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:18.125970 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal" May 21 13:02:18.154799 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:18.154765 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-142.ec2.internal\" not found" May 21 13:02:18.255317 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:18.255267 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-142.ec2.internal\" not found" May 21 13:02:18.355701 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:18.355676 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-142.ec2.internal\" not found" May 21 13:02:18.456143 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:18.456110 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-142.ec2.internal\" not found" May 21 13:02:18.479423 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:18.479402 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 13:02:18.479582 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:18.479556 2561 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 13:02:18.556184 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:18.556154 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 13:02:18.556184 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:18.556161 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-142.ec2.internal\" not found" May 21 13:02:18.573585 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:18.573548 2561 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 13:02:18.598915 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:18.598863 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 12:57:17 +0000 UTC" deadline="2027-12-13 22:34:08.252928365 +0000 UTC" May 21 13:02:18.598915 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:18.598909 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13713h31m49.654022332s" May 21 13:02:18.602093 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:18.602067 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jn9fh" May 21 13:02:18.611910 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:18.611856 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jn9fh" May 21 13:02:18.656553 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:18.656531 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-142.ec2.internal\" not found" May 21 13:02:18.667257 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:18.667227 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c2f61b69c4ebcd1af01e7a032d7d756.slice/crio-1ba31373ab67e6c67dc9a8eed8da2bfd1aadbcc5a7a9591799055337437c2459 WatchSource:0}: Error finding container 1ba31373ab67e6c67dc9a8eed8da2bfd1aadbcc5a7a9591799055337437c2459: Status 404 returned error can't find the container with id 1ba31373ab67e6c67dc9a8eed8da2bfd1aadbcc5a7a9591799055337437c2459 May 21 13:02:18.667467 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:18.667448 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda38ea9a58019d421754c06e634aaf4f8.slice/crio-f8f3cd92de8afadc60f992d21bbc04bbe046983b2482433235cdf9695cd73c9e WatchSource:0}: Error finding container f8f3cd92de8afadc60f992d21bbc04bbe046983b2482433235cdf9695cd73c9e: Status 404 returned error can't find the container with id f8f3cd92de8afadc60f992d21bbc04bbe046983b2482433235cdf9695cd73c9e May 21 13:02:18.670415 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:18.670391 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 13:02:18.689400 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:18.689360 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-142.ec2.internal" event={"ID":"a38ea9a58019d421754c06e634aaf4f8","Type":"ContainerStarted","Data":"f8f3cd92de8afadc60f992d21bbc04bbe046983b2482433235cdf9695cd73c9e"} May 21 13:02:18.690432 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:18.690408 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal" event={"ID":"9c2f61b69c4ebcd1af01e7a032d7d756","Type":"ContainerStarted","Data":"1ba31373ab67e6c67dc9a8eed8da2bfd1aadbcc5a7a9591799055337437c2459"} May 21 13:02:18.756647 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:18.756612 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-142.ec2.internal\" not found" May 21 13:02:18.779458 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:18.779434 2561 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 13:02:18.857080 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:18.857045 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-142.ec2.internal\" not found" May 21 13:02:18.957553 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:18.957474 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-142.ec2.internal\" not found" May 21 13:02:19.040893 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.040864 2561 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 13:02:19.056321 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.056285 2561 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal" May 21 13:02:19.070465 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.070444 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 13:02:19.071479 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.071466 2561 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-142.ec2.internal" May 21 13:02:19.081494 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.081478 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 13:02:19.107218 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.107199 2561 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 13:02:19.540721 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.540685 2561 apiserver.go:52] "Watching apiserver" May 21 13:02:19.550959 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.550934 2561 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 13:02:19.553992 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.553963 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-sjgk9","openshift-image-registry/node-ca-hts48","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal","openshift-multus/multus-5l8fb","openshift-ovn-kubernetes/ovnkube-node-hxtvm","kube-system/konnectivity-agent-z99cs","openshift-multus/multus-additional-cni-plugins-pf45t","openshift-multus/network-metrics-daemon-5xxmv","openshift-network-diagnostics/network-check-target-jpd9b","openshift-network-operator/iptables-alerter-fr9ps","kube-system/kube-apiserver-proxy-ip-10-0-143-142.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vknxk"] May 21 13:02:19.557690 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.557668 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hts48" May 21 13:02:19.559284 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.559227 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5l8fb" May 21 13:02:19.560665 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.560643 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-z99cs" May 21 13:02:19.562041 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.561869 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pf45t" May 21 13:02:19.563220 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.563189 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fr9ps" May 21 13:02:19.565548 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.564702 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vknxk" May 21 13:02:19.565548 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.564839 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.566256 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.566235 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.566687 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.566663 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d6095d2c-d51f-42aa-9514-91273a5b74a7-host\") pod \"node-ca-hts48\" (UID: \"d6095d2c-d51f-42aa-9514-91273a5b74a7\") " pod="openshift-image-registry/node-ca-hts48" May 21 13:02:19.566782 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.566701 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-multus-cni-dir\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.566782 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.566728 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-cnibin\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.566782 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.566753 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/28d596d9-39b6-420f-bdae-5238e6bb5ff7-cni-binary-copy\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.566782 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.566777 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-host-run-k8s-cni-cncf-io\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.566975 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.566801 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-host-var-lib-kubelet\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.566975 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.566860 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/28d596d9-39b6-420f-bdae-5238e6bb5ff7-multus-daemon-config\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.566975 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.566928 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-os-release\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.567137 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.566978 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-host-run-netns\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.567137 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.567017 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d6095d2c-d51f-42aa-9514-91273a5b74a7-serviceca\") pod \"node-ca-hts48\" (UID: \"d6095d2c-d51f-42aa-9514-91273a5b74a7\") " pod="openshift-image-registry/node-ca-hts48" May 21 13:02:19.567137 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.567043 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnmdr\" (UniqueName: \"kubernetes.io/projected/d6095d2c-d51f-42aa-9514-91273a5b74a7-kube-api-access-wnmdr\") pod \"node-ca-hts48\" (UID: \"d6095d2c-d51f-42aa-9514-91273a5b74a7\") " pod="openshift-image-registry/node-ca-hts48" May 21 13:02:19.567137 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.567070 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-host-var-lib-cni-bin\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.567137 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.567097 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-host-var-lib-cni-multus\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.567137 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.567120 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-multus-conf-dir\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.567424 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.567140 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-host-run-multus-certs\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.567424 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.567162 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-system-cni-dir\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.567424 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.567185 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-multus-socket-dir-parent\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.567424 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.567208 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-hostroot\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.567424 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.567233 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-etc-kubernetes\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.567424 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.567246 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 13:02:19.567424 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.567256 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2dgh\" (UniqueName: \"kubernetes.io/projected/28d596d9-39b6-420f-bdae-5238e6bb5ff7-kube-api-access-b2dgh\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.567424 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.567285 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 13:02:19.567424 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.567355 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 13:02:19.567424 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.567419 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 13:02:19.568019 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.567441 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rhzqh\"" May 21 13:02:19.568019 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.567516 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jx7zt\"" May 21 13:02:19.568019 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.567984 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 13:02:19.569129 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.569113 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:02:19.569236 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:19.569193 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xxmv" podUID="1457bd6e-e261-401d-a957-cf50ed787bf8" May 21 13:02:19.570539 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.570521 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jpd9b" May 21 13:02:19.570636 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:19.570597 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jpd9b" podUID="ea47420b-798b-4626-8614-a2fb41be4ba0" May 21 13:02:19.574190 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.574169 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 13:02:19.574305 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.574280 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 13:02:19.574791 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.574774 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 13:02:19.574858 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.574809 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 13:02:19.574985 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.574969 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 13:02:19.575040 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.575005 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 13:02:19.575040 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.575033 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nktl2\"" May 21 13:02:19.575371 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.575351 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 13:02:19.576046 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.575982 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 13:02:19.576147 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.576113 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 13:02:19.576203 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.576154 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 13:02:19.576392 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.576371 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 13:02:19.576552 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.576540 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 13:02:19.576682 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.576665 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 13:02:19.576743 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.576701 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 13:02:19.576969 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.576952 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 13:02:19.577145 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.577130 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 13:02:19.585958 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.585929 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 13:02:19.586055 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.586021 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6x8b5\"" May 21 13:02:19.586199 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.586180 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vtn72\"" May 21 13:02:19.586250 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.585934 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 13:02:19.586352 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.586336 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-s75zv\"" May 21 13:02:19.586679 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.586660 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 13:02:19.588611 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.587042 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 13:02:19.588611 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.587101 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qp4n7\"" May 21 13:02:19.588611 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.587223 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xhf6v\"" May 21 13:02:19.597756 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.597730 2561 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 13:02:19.612443 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.612418 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 12:57:18 +0000 UTC" deadline="2027-12-19 06:41:22.261664703 +0000 UTC" May 21 13:02:19.612443 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.612439 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13841h39m2.649227392s" May 21 13:02:19.657478 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.657453 2561 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 13:02:19.667663 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.667552 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/90df9cf5-af9f-4ced-a8b9-bc37cb33c819-cnibin\") pod \"multus-additional-cni-plugins-pf45t\" (UID: \"90df9cf5-af9f-4ced-a8b9-bc37cb33c819\") " pod="openshift-multus/multus-additional-cni-plugins-pf45t" May 21 13:02:19.667663 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.667607 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5fcca11f-a823-4785-a382-abeb26b0264b-host-slash\") pod \"iptables-alerter-fr9ps\" (UID: \"5fcca11f-a823-4785-a382-abeb26b0264b\") " pod="openshift-network-operator/iptables-alerter-fr9ps" May 21 13:02:19.667663 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.667632 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-host\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.667663 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.667657 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-host-cni-netd\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.667967 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.667684 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d6095d2c-d51f-42aa-9514-91273a5b74a7-serviceca\") pod \"node-ca-hts48\" (UID: \"d6095d2c-d51f-42aa-9514-91273a5b74a7\") " pod="openshift-image-registry/node-ca-hts48" May 21 13:02:19.667967 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.667706 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d810a2f9-8ddb-40bb-aedb-fcac7542fb8b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vknxk\" (UID: \"d810a2f9-8ddb-40bb-aedb-fcac7542fb8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vknxk" May 21 13:02:19.667967 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.667801 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-etc-sysctl-d\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.667967 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.667840 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-hostroot\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.667967 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.667878 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-host-run-ovn-kubernetes\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.667967 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.667900 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-hostroot\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.667967 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.667951 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c90f9ff1-662a-4aeb-8c12-ec54ec6c9eb0-konnectivity-ca\") pod \"konnectivity-agent-z99cs\" (UID: \"c90f9ff1-662a-4aeb-8c12-ec54ec6c9eb0\") " pod="kube-system/konnectivity-agent-z99cs" May 21 13:02:19.668252 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.667981 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90df9cf5-af9f-4ced-a8b9-bc37cb33c819-system-cni-dir\") pod \"multus-additional-cni-plugins-pf45t\" (UID: \"90df9cf5-af9f-4ced-a8b9-bc37cb33c819\") " pod="openshift-multus/multus-additional-cni-plugins-pf45t" May 21 13:02:19.668252 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668006 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rc5p\" (UniqueName: \"kubernetes.io/projected/90df9cf5-af9f-4ced-a8b9-bc37cb33c819-kube-api-access-5rc5p\") pod \"multus-additional-cni-plugins-pf45t\" (UID: \"90df9cf5-af9f-4ced-a8b9-bc37cb33c819\") " pod="openshift-multus/multus-additional-cni-plugins-pf45t" May 21 13:02:19.668252 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668031 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-log-socket\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.668252 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668057 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1457bd6e-e261-401d-a957-cf50ed787bf8-metrics-certs\") pod \"network-metrics-daemon-5xxmv\" (UID: \"1457bd6e-e261-401d-a957-cf50ed787bf8\") " pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:02:19.668252 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668084 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d810a2f9-8ddb-40bb-aedb-fcac7542fb8b-device-dir\") pod \"aws-ebs-csi-driver-node-vknxk\" (UID: \"d810a2f9-8ddb-40bb-aedb-fcac7542fb8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vknxk" May 21 13:02:19.668252 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668106 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-run\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.668252 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668127 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-var-lib-kubelet\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.668252 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668150 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d6095d2c-d51f-42aa-9514-91273a5b74a7-serviceca\") pod \"node-ca-hts48\" (UID: \"d6095d2c-d51f-42aa-9514-91273a5b74a7\") " pod="openshift-image-registry/node-ca-hts48" May 21 13:02:19.668252 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668213 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c580f711-baaf-45c0-b480-5cee528524ed-tmp\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.668252 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668244 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-host-slash\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.668694 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668267 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-host-var-lib-cni-bin\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.668694 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668285 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/90df9cf5-af9f-4ced-a8b9-bc37cb33c819-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pf45t\" (UID: \"90df9cf5-af9f-4ced-a8b9-bc37cb33c819\") " pod="openshift-multus/multus-additional-cni-plugins-pf45t" May 21 13:02:19.668694 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668309 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-etc-sysconfig\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.668694 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668335 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/95243429-9417-4afa-ab0b-01596ab17da7-ovn-node-metrics-cert\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.668694 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668355 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-host-var-lib-cni-bin\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.668694 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668361 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-system-cni-dir\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.668694 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668407 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-system-cni-dir\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.668694 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668414 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-etc-kubernetes\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.668694 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668445 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/90df9cf5-af9f-4ced-a8b9-bc37cb33c819-os-release\") pod \"multus-additional-cni-plugins-pf45t\" (UID: \"90df9cf5-af9f-4ced-a8b9-bc37cb33c819\") " pod="openshift-multus/multus-additional-cni-plugins-pf45t" May 21 13:02:19.668694 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668472 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss9r7\" (UniqueName: \"kubernetes.io/projected/5fcca11f-a823-4785-a382-abeb26b0264b-kube-api-access-ss9r7\") pod \"iptables-alerter-fr9ps\" (UID: \"5fcca11f-a823-4785-a382-abeb26b0264b\") " pod="openshift-network-operator/iptables-alerter-fr9ps" May 21 13:02:19.668694 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668492 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d810a2f9-8ddb-40bb-aedb-fcac7542fb8b-registration-dir\") pod \"aws-ebs-csi-driver-node-vknxk\" (UID: \"d810a2f9-8ddb-40bb-aedb-fcac7542fb8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vknxk" May 21 13:02:19.668694 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668516 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-etc-systemd\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.668694 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668524 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-etc-kubernetes\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.668694 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668545 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-sys\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.668694 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668583 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn94f\" (UniqueName: \"kubernetes.io/projected/c580f711-baaf-45c0-b480-5cee528524ed-kube-api-access-sn94f\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.668694 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668610 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-host-run-k8s-cni-cncf-io\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.668694 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668656 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-host-run-k8s-cni-cncf-io\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.669470 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668676 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-host-var-lib-kubelet\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.669470 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668701 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d810a2f9-8ddb-40bb-aedb-fcac7542fb8b-sys-fs\") pod \"aws-ebs-csi-driver-node-vknxk\" (UID: \"d810a2f9-8ddb-40bb-aedb-fcac7542fb8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vknxk" May 21 13:02:19.669470 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668717 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c580f711-baaf-45c0-b480-5cee528524ed-etc-tuned\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.669470 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668736 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-node-log\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.669470 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668754 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-host-var-lib-kubelet\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.669470 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668758 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/95243429-9417-4afa-ab0b-01596ab17da7-ovnkube-script-lib\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.669470 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668800 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jh7w\" (UniqueName: \"kubernetes.io/projected/ea47420b-798b-4626-8614-a2fb41be4ba0-kube-api-access-6jh7w\") pod \"network-check-target-jpd9b\" (UID: \"ea47420b-798b-4626-8614-a2fb41be4ba0\") " pod="openshift-network-diagnostics/network-check-target-jpd9b" May 21 13:02:19.669470 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668839 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-os-release\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.669470 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668864 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c90f9ff1-662a-4aeb-8c12-ec54ec6c9eb0-agent-certs\") pod \"konnectivity-agent-z99cs\" (UID: \"c90f9ff1-662a-4aeb-8c12-ec54ec6c9eb0\") " pod="kube-system/konnectivity-agent-z99cs" May 21 13:02:19.669470 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668886 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5fcca11f-a823-4785-a382-abeb26b0264b-iptables-alerter-script\") pod \"iptables-alerter-fr9ps\" (UID: \"5fcca11f-a823-4785-a382-abeb26b0264b\") " pod="openshift-network-operator/iptables-alerter-fr9ps" May 21 13:02:19.669470 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668889 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-os-release\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.669470 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668923 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-etc-kubernetes\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.669470 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668948 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/90df9cf5-af9f-4ced-a8b9-bc37cb33c819-cni-binary-copy\") pod \"multus-additional-cni-plugins-pf45t\" (UID: \"90df9cf5-af9f-4ced-a8b9-bc37cb33c819\") " pod="openshift-multus/multus-additional-cni-plugins-pf45t" May 21 13:02:19.669470 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668964 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq4qz\" (UniqueName: \"kubernetes.io/projected/95243429-9417-4afa-ab0b-01596ab17da7-kube-api-access-rq4qz\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.669470 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.668982 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b2dgh\" (UniqueName: \"kubernetes.io/projected/28d596d9-39b6-420f-bdae-5238e6bb5ff7-kube-api-access-b2dgh\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.669470 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669000 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d6095d2c-d51f-42aa-9514-91273a5b74a7-host\") pod \"node-ca-hts48\" (UID: \"d6095d2c-d51f-42aa-9514-91273a5b74a7\") " pod="openshift-image-registry/node-ca-hts48" May 21 13:02:19.669470 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669034 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-multus-cni-dir\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.670227 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669044 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d6095d2c-d51f-42aa-9514-91273a5b74a7-host\") pod \"node-ca-hts48\" (UID: \"d6095d2c-d51f-42aa-9514-91273a5b74a7\") " pod="openshift-image-registry/node-ca-hts48" May 21 13:02:19.670227 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669061 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-cnibin\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.670227 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669098 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-multus-cni-dir\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.670227 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669097 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/90df9cf5-af9f-4ced-a8b9-bc37cb33c819-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pf45t\" (UID: \"90df9cf5-af9f-4ced-a8b9-bc37cb33c819\") " pod="openshift-multus/multus-additional-cni-plugins-pf45t" May 21 13:02:19.670227 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669133 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d810a2f9-8ddb-40bb-aedb-fcac7542fb8b-etc-selinux\") pod \"aws-ebs-csi-driver-node-vknxk\" (UID: \"d810a2f9-8ddb-40bb-aedb-fcac7542fb8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vknxk" May 21 13:02:19.670227 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669152 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-cnibin\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.670227 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669176 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-host-run-netns\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.670227 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669201 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-var-lib-openvswitch\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.670227 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669224 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-host-cni-bin\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.670227 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669258 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d810a2f9-8ddb-40bb-aedb-fcac7542fb8b-socket-dir\") pod \"aws-ebs-csi-driver-node-vknxk\" (UID: \"d810a2f9-8ddb-40bb-aedb-fcac7542fb8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vknxk" May 21 13:02:19.670227 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669298 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-etc-modprobe-d\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.670227 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669318 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/95243429-9417-4afa-ab0b-01596ab17da7-ovnkube-config\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.670227 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669337 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-lib-modules\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.670227 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669353 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wnmdr\" (UniqueName: \"kubernetes.io/projected/d6095d2c-d51f-42aa-9514-91273a5b74a7-kube-api-access-wnmdr\") pod \"node-ca-hts48\" (UID: \"d6095d2c-d51f-42aa-9514-91273a5b74a7\") " pod="openshift-image-registry/node-ca-hts48" May 21 13:02:19.670227 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669379 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-host-var-lib-cni-multus\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.670227 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669401 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-multus-conf-dir\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.670227 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669429 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-host-run-multus-certs\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.670915 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669461 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-host-var-lib-cni-multus\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.670915 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669510 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62llc\" (UniqueName: \"kubernetes.io/projected/d810a2f9-8ddb-40bb-aedb-fcac7542fb8b-kube-api-access-62llc\") pod \"aws-ebs-csi-driver-node-vknxk\" (UID: \"d810a2f9-8ddb-40bb-aedb-fcac7542fb8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vknxk" May 21 13:02:19.670915 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669506 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-host-run-multus-certs\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.670915 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669556 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-run-ovn\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.670915 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669561 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-multus-conf-dir\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.670915 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669603 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.670915 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669631 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-multus-socket-dir-parent\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.670915 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669657 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-host-kubelet\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.670915 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669681 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-run-systemd\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.670915 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669704 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-run-openvswitch\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.670915 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669708 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-multus-socket-dir-parent\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.670915 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669726 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/95243429-9417-4afa-ab0b-01596ab17da7-env-overrides\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.670915 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669765 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x6n2\" (UniqueName: \"kubernetes.io/projected/1457bd6e-e261-401d-a957-cf50ed787bf8-kube-api-access-6x6n2\") pod \"network-metrics-daemon-5xxmv\" (UID: \"1457bd6e-e261-401d-a957-cf50ed787bf8\") " pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:02:19.670915 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669802 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/28d596d9-39b6-420f-bdae-5238e6bb5ff7-cni-binary-copy\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.670915 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669834 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/28d596d9-39b6-420f-bdae-5238e6bb5ff7-multus-daemon-config\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.670915 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669867 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/90df9cf5-af9f-4ced-a8b9-bc37cb33c819-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pf45t\" (UID: \"90df9cf5-af9f-4ced-a8b9-bc37cb33c819\") " pod="openshift-multus/multus-additional-cni-plugins-pf45t" May 21 13:02:19.670915 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669890 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-etc-sysctl-conf\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.671541 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669915 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-systemd-units\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.671541 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669935 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-etc-openvswitch\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.671541 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.669959 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-host-run-netns\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.671541 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.670035 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/28d596d9-39b6-420f-bdae-5238e6bb5ff7-host-run-netns\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.671541 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.670313 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/28d596d9-39b6-420f-bdae-5238e6bb5ff7-cni-binary-copy\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.671541 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.670432 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/28d596d9-39b6-420f-bdae-5238e6bb5ff7-multus-daemon-config\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.681022 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.680996 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 13:02:19.684584 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.684548 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2dgh\" (UniqueName: \"kubernetes.io/projected/28d596d9-39b6-420f-bdae-5238e6bb5ff7-kube-api-access-b2dgh\") pod \"multus-5l8fb\" (UID: \"28d596d9-39b6-420f-bdae-5238e6bb5ff7\") " pod="openshift-multus/multus-5l8fb" May 21 13:02:19.689779 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.689692 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnmdr\" (UniqueName: \"kubernetes.io/projected/d6095d2c-d51f-42aa-9514-91273a5b74a7-kube-api-access-wnmdr\") pod \"node-ca-hts48\" (UID: \"d6095d2c-d51f-42aa-9514-91273a5b74a7\") " pod="openshift-image-registry/node-ca-hts48" May 21 13:02:19.770325 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.770291 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1457bd6e-e261-401d-a957-cf50ed787bf8-metrics-certs\") pod \"network-metrics-daemon-5xxmv\" (UID: \"1457bd6e-e261-401d-a957-cf50ed787bf8\") " pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:02:19.770496 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.770336 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d810a2f9-8ddb-40bb-aedb-fcac7542fb8b-device-dir\") pod \"aws-ebs-csi-driver-node-vknxk\" (UID: \"d810a2f9-8ddb-40bb-aedb-fcac7542fb8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vknxk" May 21 13:02:19.770496 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.770362 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-run\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.770496 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.770409 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-var-lib-kubelet\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.770496 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.770434 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c580f711-baaf-45c0-b480-5cee528524ed-tmp\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.770496 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.770460 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-host-slash\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.770752 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.770512 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/90df9cf5-af9f-4ced-a8b9-bc37cb33c819-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pf45t\" (UID: \"90df9cf5-af9f-4ced-a8b9-bc37cb33c819\") " pod="openshift-multus/multus-additional-cni-plugins-pf45t" May 21 13:02:19.770752 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.770511 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-run\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.770752 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:19.770460 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 13:02:19.770752 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.770533 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-var-lib-kubelet\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.770752 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.770555 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-host-slash\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.770752 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.770583 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d810a2f9-8ddb-40bb-aedb-fcac7542fb8b-device-dir\") pod \"aws-ebs-csi-driver-node-vknxk\" (UID: \"d810a2f9-8ddb-40bb-aedb-fcac7542fb8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vknxk" May 21 13:02:19.770752 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.770594 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-etc-sysconfig\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.770752 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:19.770623 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1457bd6e-e261-401d-a957-cf50ed787bf8-metrics-certs podName:1457bd6e-e261-401d-a957-cf50ed787bf8 nodeName:}" failed. No retries permitted until 2026-05-21 13:02:20.270586586 +0000 UTC m=+3.125298068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1457bd6e-e261-401d-a957-cf50ed787bf8-metrics-certs") pod "network-metrics-daemon-5xxmv" (UID: "1457bd6e-e261-401d-a957-cf50ed787bf8") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 13:02:19.770752 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.770641 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-etc-sysconfig\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.770752 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.770685 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/95243429-9417-4afa-ab0b-01596ab17da7-ovn-node-metrics-cert\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.770752 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.770715 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/90df9cf5-af9f-4ced-a8b9-bc37cb33c819-os-release\") pod \"multus-additional-cni-plugins-pf45t\" (UID: \"90df9cf5-af9f-4ced-a8b9-bc37cb33c819\") " pod="openshift-multus/multus-additional-cni-plugins-pf45t" May 21 13:02:19.770752 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.770740 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ss9r7\" (UniqueName: \"kubernetes.io/projected/5fcca11f-a823-4785-a382-abeb26b0264b-kube-api-access-ss9r7\") pod \"iptables-alerter-fr9ps\" (UID: \"5fcca11f-a823-4785-a382-abeb26b0264b\") " pod="openshift-network-operator/iptables-alerter-fr9ps" May 21 13:02:19.771297 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.770801 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/90df9cf5-af9f-4ced-a8b9-bc37cb33c819-os-release\") pod \"multus-additional-cni-plugins-pf45t\" (UID: \"90df9cf5-af9f-4ced-a8b9-bc37cb33c819\") " pod="openshift-multus/multus-additional-cni-plugins-pf45t" May 21 13:02:19.771297 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.770858 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d810a2f9-8ddb-40bb-aedb-fcac7542fb8b-registration-dir\") pod \"aws-ebs-csi-driver-node-vknxk\" (UID: \"d810a2f9-8ddb-40bb-aedb-fcac7542fb8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vknxk" May 21 13:02:19.771297 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.770893 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-etc-systemd\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.771297 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.770918 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-sys\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.771297 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.770942 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sn94f\" (UniqueName: \"kubernetes.io/projected/c580f711-baaf-45c0-b480-5cee528524ed-kube-api-access-sn94f\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.771297 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.770969 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d810a2f9-8ddb-40bb-aedb-fcac7542fb8b-sys-fs\") pod \"aws-ebs-csi-driver-node-vknxk\" (UID: \"d810a2f9-8ddb-40bb-aedb-fcac7542fb8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vknxk" May 21 13:02:19.771297 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.770994 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c580f711-baaf-45c0-b480-5cee528524ed-etc-tuned\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.771297 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.771017 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-node-log\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.771297 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.771041 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/95243429-9417-4afa-ab0b-01596ab17da7-ovnkube-script-lib\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.771297 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.771066 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6jh7w\" (UniqueName: \"kubernetes.io/projected/ea47420b-798b-4626-8614-a2fb41be4ba0-kube-api-access-6jh7w\") pod \"network-check-target-jpd9b\" (UID: \"ea47420b-798b-4626-8614-a2fb41be4ba0\") " pod="openshift-network-diagnostics/network-check-target-jpd9b" May 21 13:02:19.771297 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.771140 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/90df9cf5-af9f-4ced-a8b9-bc37cb33c819-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pf45t\" (UID: \"90df9cf5-af9f-4ced-a8b9-bc37cb33c819\") " pod="openshift-multus/multus-additional-cni-plugins-pf45t" May 21 13:02:19.771297 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.771171 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-etc-systemd\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.771297 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.771237 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-sys\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.771297 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.771278 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d810a2f9-8ddb-40bb-aedb-fcac7542fb8b-registration-dir\") pod \"aws-ebs-csi-driver-node-vknxk\" (UID: \"d810a2f9-8ddb-40bb-aedb-fcac7542fb8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vknxk" May 21 13:02:19.771929 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.771328 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d810a2f9-8ddb-40bb-aedb-fcac7542fb8b-sys-fs\") pod \"aws-ebs-csi-driver-node-vknxk\" (UID: \"d810a2f9-8ddb-40bb-aedb-fcac7542fb8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vknxk" May 21 13:02:19.771929 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.771372 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-node-log\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.771929 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.771580 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c90f9ff1-662a-4aeb-8c12-ec54ec6c9eb0-agent-certs\") pod \"konnectivity-agent-z99cs\" (UID: \"c90f9ff1-662a-4aeb-8c12-ec54ec6c9eb0\") " pod="kube-system/konnectivity-agent-z99cs" May 21 13:02:19.771929 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.771609 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5fcca11f-a823-4785-a382-abeb26b0264b-iptables-alerter-script\") pod \"iptables-alerter-fr9ps\" (UID: \"5fcca11f-a823-4785-a382-abeb26b0264b\") " pod="openshift-network-operator/iptables-alerter-fr9ps" May 21 13:02:19.771929 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.771675 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-etc-kubernetes\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.771929 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.771720 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/90df9cf5-af9f-4ced-a8b9-bc37cb33c819-cni-binary-copy\") pod \"multus-additional-cni-plugins-pf45t\" (UID: \"90df9cf5-af9f-4ced-a8b9-bc37cb33c819\") " pod="openshift-multus/multus-additional-cni-plugins-pf45t" May 21 13:02:19.771929 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.771753 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rq4qz\" (UniqueName: \"kubernetes.io/projected/95243429-9417-4afa-ab0b-01596ab17da7-kube-api-access-rq4qz\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.771929 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.771780 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/90df9cf5-af9f-4ced-a8b9-bc37cb33c819-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pf45t\" (UID: \"90df9cf5-af9f-4ced-a8b9-bc37cb33c819\") " pod="openshift-multus/multus-additional-cni-plugins-pf45t" May 21 13:02:19.771929 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.771802 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d810a2f9-8ddb-40bb-aedb-fcac7542fb8b-etc-selinux\") pod \"aws-ebs-csi-driver-node-vknxk\" (UID: \"d810a2f9-8ddb-40bb-aedb-fcac7542fb8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vknxk" May 21 13:02:19.771929 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.771824 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-host-run-netns\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.771929 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.771847 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-var-lib-openvswitch\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.771929 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.771888 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-var-lib-openvswitch\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.771929 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.771899 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-host-cni-bin\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.771929 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.771938 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-etc-kubernetes\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.772544 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.771933 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d810a2f9-8ddb-40bb-aedb-fcac7542fb8b-socket-dir\") pod \"aws-ebs-csi-driver-node-vknxk\" (UID: \"d810a2f9-8ddb-40bb-aedb-fcac7542fb8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vknxk" May 21 13:02:19.772544 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.771946 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/95243429-9417-4afa-ab0b-01596ab17da7-ovnkube-script-lib\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.775054 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.772825 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5fcca11f-a823-4785-a382-abeb26b0264b-iptables-alerter-script\") pod \"iptables-alerter-fr9ps\" (UID: \"5fcca11f-a823-4785-a382-abeb26b0264b\") " pod="openshift-network-operator/iptables-alerter-fr9ps" May 21 13:02:19.775054 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.772940 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-host-cni-bin\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.775054 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.773078 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/90df9cf5-af9f-4ced-a8b9-bc37cb33c819-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pf45t\" (UID: \"90df9cf5-af9f-4ced-a8b9-bc37cb33c819\") " pod="openshift-multus/multus-additional-cni-plugins-pf45t" May 21 13:02:19.775054 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.773101 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/90df9cf5-af9f-4ced-a8b9-bc37cb33c819-cni-binary-copy\") pod \"multus-additional-cni-plugins-pf45t\" (UID: \"90df9cf5-af9f-4ced-a8b9-bc37cb33c819\") " pod="openshift-multus/multus-additional-cni-plugins-pf45t" May 21 13:02:19.775054 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.773125 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-etc-modprobe-d\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.775054 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.773165 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/95243429-9417-4afa-ab0b-01596ab17da7-ovnkube-config\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.775054 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.773201 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-lib-modules\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.775054 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.773216 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d810a2f9-8ddb-40bb-aedb-fcac7542fb8b-socket-dir\") pod \"aws-ebs-csi-driver-node-vknxk\" (UID: \"d810a2f9-8ddb-40bb-aedb-fcac7542fb8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vknxk" May 21 13:02:19.775054 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.773252 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62llc\" (UniqueName: \"kubernetes.io/projected/d810a2f9-8ddb-40bb-aedb-fcac7542fb8b-kube-api-access-62llc\") pod \"aws-ebs-csi-driver-node-vknxk\" (UID: \"d810a2f9-8ddb-40bb-aedb-fcac7542fb8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vknxk" May 21 13:02:19.775054 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.773305 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-run-ovn\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.775054 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.773352 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.775054 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.773407 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-host-kubelet\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.775054 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.773422 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.775054 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.773446 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-run-systemd\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.775054 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.773478 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-run-openvswitch\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.775054 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.773513 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/95243429-9417-4afa-ab0b-01596ab17da7-env-overrides\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.775054 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.773539 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6x6n2\" (UniqueName: \"kubernetes.io/projected/1457bd6e-e261-401d-a957-cf50ed787bf8-kube-api-access-6x6n2\") pod \"network-metrics-daemon-5xxmv\" (UID: \"1457bd6e-e261-401d-a957-cf50ed787bf8\") " pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:02:19.775906 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.773597 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/90df9cf5-af9f-4ced-a8b9-bc37cb33c819-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pf45t\" (UID: \"90df9cf5-af9f-4ced-a8b9-bc37cb33c819\") " pod="openshift-multus/multus-additional-cni-plugins-pf45t" May 21 13:02:19.775906 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.773689 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-host-kubelet\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.775906 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.773633 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-etc-sysctl-conf\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.775906 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.773786 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-systemd-units\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.775906 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.773818 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-etc-openvswitch\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.775906 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.773850 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/90df9cf5-af9f-4ced-a8b9-bc37cb33c819-cnibin\") pod \"multus-additional-cni-plugins-pf45t\" (UID: \"90df9cf5-af9f-4ced-a8b9-bc37cb33c819\") " pod="openshift-multus/multus-additional-cni-plugins-pf45t" May 21 13:02:19.775906 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.773882 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5fcca11f-a823-4785-a382-abeb26b0264b-host-slash\") pod \"iptables-alerter-fr9ps\" (UID: \"5fcca11f-a823-4785-a382-abeb26b0264b\") " pod="openshift-network-operator/iptables-alerter-fr9ps" May 21 13:02:19.775906 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.773911 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-host\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.775906 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.773937 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d810a2f9-8ddb-40bb-aedb-fcac7542fb8b-etc-selinux\") pod \"aws-ebs-csi-driver-node-vknxk\" (UID: \"d810a2f9-8ddb-40bb-aedb-fcac7542fb8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vknxk" May 21 13:02:19.775906 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.773943 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-host-cni-netd\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.775906 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.773990 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d810a2f9-8ddb-40bb-aedb-fcac7542fb8b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vknxk\" (UID: \"d810a2f9-8ddb-40bb-aedb-fcac7542fb8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vknxk" May 21 13:02:19.775906 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.774012 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-run-systemd\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.775906 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.774023 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-etc-sysctl-d\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.775906 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.774046 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/95243429-9417-4afa-ab0b-01596ab17da7-ovnkube-config\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.775906 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.774108 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/95243429-9417-4afa-ab0b-01596ab17da7-env-overrides\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.775906 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.774150 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-etc-sysctl-d\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.775906 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.774175 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-host-run-netns\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.776609 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.774188 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-host-run-ovn-kubernetes\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.776609 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.774225 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c90f9ff1-662a-4aeb-8c12-ec54ec6c9eb0-konnectivity-ca\") pod \"konnectivity-agent-z99cs\" (UID: \"c90f9ff1-662a-4aeb-8c12-ec54ec6c9eb0\") " pod="kube-system/konnectivity-agent-z99cs" May 21 13:02:19.776609 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.774229 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-run-ovn\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.776609 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.774257 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90df9cf5-af9f-4ced-a8b9-bc37cb33c819-system-cni-dir\") pod \"multus-additional-cni-plugins-pf45t\" (UID: \"90df9cf5-af9f-4ced-a8b9-bc37cb33c819\") " pod="openshift-multus/multus-additional-cni-plugins-pf45t" May 21 13:02:19.776609 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.774292 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5rc5p\" (UniqueName: \"kubernetes.io/projected/90df9cf5-af9f-4ced-a8b9-bc37cb33c819-kube-api-access-5rc5p\") pod \"multus-additional-cni-plugins-pf45t\" (UID: \"90df9cf5-af9f-4ced-a8b9-bc37cb33c819\") " pod="openshift-multus/multus-additional-cni-plugins-pf45t" May 21 13:02:19.776609 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.774324 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-log-socket\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.776609 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.774339 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/90df9cf5-af9f-4ced-a8b9-bc37cb33c819-cnibin\") pod \"multus-additional-cni-plugins-pf45t\" (UID: \"90df9cf5-af9f-4ced-a8b9-bc37cb33c819\") " pod="openshift-multus/multus-additional-cni-plugins-pf45t" May 21 13:02:19.776609 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.774362 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-etc-modprobe-d\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.776609 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.774407 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-run-openvswitch\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.776609 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.773851 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-lib-modules\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.776609 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.774625 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/90df9cf5-af9f-4ced-a8b9-bc37cb33c819-system-cni-dir\") pod \"multus-additional-cni-plugins-pf45t\" (UID: \"90df9cf5-af9f-4ced-a8b9-bc37cb33c819\") " pod="openshift-multus/multus-additional-cni-plugins-pf45t" May 21 13:02:19.776609 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.774682 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-host-run-ovn-kubernetes\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.776609 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.774746 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/90df9cf5-af9f-4ced-a8b9-bc37cb33c819-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pf45t\" (UID: \"90df9cf5-af9f-4ced-a8b9-bc37cb33c819\") " pod="openshift-multus/multus-additional-cni-plugins-pf45t" May 21 13:02:19.776609 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.774748 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-log-socket\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.776609 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.774785 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5fcca11f-a823-4785-a382-abeb26b0264b-host-slash\") pod \"iptables-alerter-fr9ps\" (UID: \"5fcca11f-a823-4785-a382-abeb26b0264b\") " pod="openshift-network-operator/iptables-alerter-fr9ps" May 21 13:02:19.776609 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.774751 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-systemd-units\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.776609 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.774798 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-host\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.777313 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.774825 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-host-cni-netd\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.777313 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.774934 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c580f711-baaf-45c0-b480-5cee528524ed-tmp\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.777313 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.774957 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c580f711-baaf-45c0-b480-5cee528524ed-etc-sysctl-conf\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.777313 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.775007 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/95243429-9417-4afa-ab0b-01596ab17da7-etc-openvswitch\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.777313 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.775177 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c90f9ff1-662a-4aeb-8c12-ec54ec6c9eb0-konnectivity-ca\") pod \"konnectivity-agent-z99cs\" (UID: \"c90f9ff1-662a-4aeb-8c12-ec54ec6c9eb0\") " pod="kube-system/konnectivity-agent-z99cs" May 21 13:02:19.777313 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.775181 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d810a2f9-8ddb-40bb-aedb-fcac7542fb8b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vknxk\" (UID: \"d810a2f9-8ddb-40bb-aedb-fcac7542fb8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vknxk" May 21 13:02:19.777313 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.776502 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c580f711-baaf-45c0-b480-5cee528524ed-etc-tuned\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.778329 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.778246 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/95243429-9417-4afa-ab0b-01596ab17da7-ovn-node-metrics-cert\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.779342 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:19.779038 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 13:02:19.779342 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:19.779063 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 13:02:19.779342 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:19.779077 2561 projected.go:194] Error preparing data for projected volume kube-api-access-6jh7w for pod openshift-network-diagnostics/network-check-target-jpd9b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 13:02:19.779342 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:19.779137 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea47420b-798b-4626-8614-a2fb41be4ba0-kube-api-access-6jh7w podName:ea47420b-798b-4626-8614-a2fb41be4ba0 nodeName:}" failed. No retries permitted until 2026-05-21 13:02:20.279118877 +0000 UTC m=+3.133830368 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6jh7w" (UniqueName: "kubernetes.io/projected/ea47420b-798b-4626-8614-a2fb41be4ba0-kube-api-access-6jh7w") pod "network-check-target-jpd9b" (UID: "ea47420b-798b-4626-8614-a2fb41be4ba0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 13:02:19.780124 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.780102 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c90f9ff1-662a-4aeb-8c12-ec54ec6c9eb0-agent-certs\") pod \"konnectivity-agent-z99cs\" (UID: \"c90f9ff1-662a-4aeb-8c12-ec54ec6c9eb0\") " pod="kube-system/konnectivity-agent-z99cs" May 21 13:02:19.782224 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.782202 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq4qz\" (UniqueName: \"kubernetes.io/projected/95243429-9417-4afa-ab0b-01596ab17da7-kube-api-access-rq4qz\") pod \"ovnkube-node-hxtvm\" (UID: \"95243429-9417-4afa-ab0b-01596ab17da7\") " pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:19.783538 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.783517 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss9r7\" (UniqueName: \"kubernetes.io/projected/5fcca11f-a823-4785-a382-abeb26b0264b-kube-api-access-ss9r7\") pod \"iptables-alerter-fr9ps\" (UID: \"5fcca11f-a823-4785-a382-abeb26b0264b\") " pod="openshift-network-operator/iptables-alerter-fr9ps" May 21 13:02:19.785641 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.785616 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62llc\" (UniqueName: \"kubernetes.io/projected/d810a2f9-8ddb-40bb-aedb-fcac7542fb8b-kube-api-access-62llc\") pod \"aws-ebs-csi-driver-node-vknxk\" (UID: \"d810a2f9-8ddb-40bb-aedb-fcac7542fb8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vknxk" May 21 13:02:19.787549 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.787487 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn94f\" (UniqueName: \"kubernetes.io/projected/c580f711-baaf-45c0-b480-5cee528524ed-kube-api-access-sn94f\") pod \"tuned-sjgk9\" (UID: \"c580f711-baaf-45c0-b480-5cee528524ed\") " pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.787859 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.787701 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rc5p\" (UniqueName: \"kubernetes.io/projected/90df9cf5-af9f-4ced-a8b9-bc37cb33c819-kube-api-access-5rc5p\") pod \"multus-additional-cni-plugins-pf45t\" (UID: \"90df9cf5-af9f-4ced-a8b9-bc37cb33c819\") " pod="openshift-multus/multus-additional-cni-plugins-pf45t" May 21 13:02:19.788037 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.788016 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x6n2\" (UniqueName: \"kubernetes.io/projected/1457bd6e-e261-401d-a957-cf50ed787bf8-kube-api-access-6x6n2\") pod \"network-metrics-daemon-5xxmv\" (UID: \"1457bd6e-e261-401d-a957-cf50ed787bf8\") " pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:02:19.869283 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.869239 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hts48" May 21 13:02:19.875672 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.875645 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5l8fb" May 21 13:02:19.887240 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.887211 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-z99cs" May 21 13:02:19.895522 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.895498 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pf45t" May 21 13:02:19.904773 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.904755 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fr9ps" May 21 13:02:19.910523 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.910502 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" May 21 13:02:19.918343 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.918324 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vknxk" May 21 13:02:19.923866 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:19.923848 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:20.278270 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:20.278177 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1457bd6e-e261-401d-a957-cf50ed787bf8-metrics-certs\") pod \"network-metrics-daemon-5xxmv\" (UID: \"1457bd6e-e261-401d-a957-cf50ed787bf8\") " pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:02:20.278402 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:20.278316 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 13:02:20.278402 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:20.278385 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1457bd6e-e261-401d-a957-cf50ed787bf8-metrics-certs podName:1457bd6e-e261-401d-a957-cf50ed787bf8 nodeName:}" failed. No retries permitted until 2026-05-21 13:02:21.27836638 +0000 UTC m=+4.133077849 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1457bd6e-e261-401d-a957-cf50ed787bf8-metrics-certs") pod "network-metrics-daemon-5xxmv" (UID: "1457bd6e-e261-401d-a957-cf50ed787bf8") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 13:02:20.379268 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:20.379231 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6jh7w\" (UniqueName: \"kubernetes.io/projected/ea47420b-798b-4626-8614-a2fb41be4ba0-kube-api-access-6jh7w\") pod \"network-check-target-jpd9b\" (UID: \"ea47420b-798b-4626-8614-a2fb41be4ba0\") " pod="openshift-network-diagnostics/network-check-target-jpd9b" May 21 13:02:20.379413 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:20.379349 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 13:02:20.379413 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:20.379361 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 13:02:20.379413 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:20.379370 2561 projected.go:194] Error preparing data for projected volume kube-api-access-6jh7w for pod openshift-network-diagnostics/network-check-target-jpd9b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 13:02:20.379522 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:20.379416 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea47420b-798b-4626-8614-a2fb41be4ba0-kube-api-access-6jh7w podName:ea47420b-798b-4626-8614-a2fb41be4ba0 nodeName:}" failed. No retries permitted until 2026-05-21 13:02:21.379403693 +0000 UTC m=+4.234115160 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6jh7w" (UniqueName: "kubernetes.io/projected/ea47420b-798b-4626-8614-a2fb41be4ba0-kube-api-access-6jh7w") pod "network-check-target-jpd9b" (UID: "ea47420b-798b-4626-8614-a2fb41be4ba0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 13:02:20.417582 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:20.417530 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fcca11f_a823_4785_a382_abeb26b0264b.slice/crio-b016bf6ec4e43f42b9295a7b4fd78014f6a3014f45f9d4e985c11cb5a77d1295 WatchSource:0}: Error finding container b016bf6ec4e43f42b9295a7b4fd78014f6a3014f45f9d4e985c11cb5a77d1295: Status 404 returned error can't find the container with id b016bf6ec4e43f42b9295a7b4fd78014f6a3014f45f9d4e985c11cb5a77d1295 May 21 13:02:20.420986 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:20.420902 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90df9cf5_af9f_4ced_a8b9_bc37cb33c819.slice/crio-29ffc283bfbda3005602ede991504eee6885c61564c140d913c66ad0284ead2e WatchSource:0}: Error finding container 29ffc283bfbda3005602ede991504eee6885c61564c140d913c66ad0284ead2e: Status 404 returned error can't find the container with id 29ffc283bfbda3005602ede991504eee6885c61564c140d913c66ad0284ead2e May 21 13:02:20.422470 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:20.422388 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd810a2f9_8ddb_40bb_aedb_fcac7542fb8b.slice/crio-7949d999bba2042ad252fedb784020f9b1279781d2d1c0cbed92acd1b7f20623 WatchSource:0}: Error finding container 7949d999bba2042ad252fedb784020f9b1279781d2d1c0cbed92acd1b7f20623: Status 404 returned error can't find the container with id 7949d999bba2042ad252fedb784020f9b1279781d2d1c0cbed92acd1b7f20623 May 21 13:02:20.423031 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:20.423009 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95243429_9417_4afa_ab0b_01596ab17da7.slice/crio-853e283817c20e3a649fd6b6e2ab7581fd840c76678906fa1a0704646e5a86e5 WatchSource:0}: Error finding container 853e283817c20e3a649fd6b6e2ab7581fd840c76678906fa1a0704646e5a86e5: Status 404 returned error can't find the container with id 853e283817c20e3a649fd6b6e2ab7581fd840c76678906fa1a0704646e5a86e5 May 21 13:02:20.424490 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:20.424399 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc90f9ff1_662a_4aeb_8c12_ec54ec6c9eb0.slice/crio-ccb7809859b38024ea7a70d560dcb252f68927ec245fd7473779eefe427fdcac WatchSource:0}: Error finding container ccb7809859b38024ea7a70d560dcb252f68927ec245fd7473779eefe427fdcac: Status 404 returned error can't find the container with id ccb7809859b38024ea7a70d560dcb252f68927ec245fd7473779eefe427fdcac May 21 13:02:20.425141 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:20.425115 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6095d2c_d51f_42aa_9514_91273a5b74a7.slice/crio-75aa75791aa8f9e84dad18710930be75c25d8777c94cf79e2cae1bc20f79f8c4 WatchSource:0}: Error finding container 75aa75791aa8f9e84dad18710930be75c25d8777c94cf79e2cae1bc20f79f8c4: Status 404 returned error can't find the container with id 75aa75791aa8f9e84dad18710930be75c25d8777c94cf79e2cae1bc20f79f8c4 May 21 13:02:20.426161 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:20.425936 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc580f711_baaf_45c0_b480_5cee528524ed.slice/crio-ad6daeeecd81a35f9cbb18a8fd074318cbd2067bac8ebf19bed936c29071be10 WatchSource:0}: Error finding container ad6daeeecd81a35f9cbb18a8fd074318cbd2067bac8ebf19bed936c29071be10: Status 404 returned error can't find the container with id ad6daeeecd81a35f9cbb18a8fd074318cbd2067bac8ebf19bed936c29071be10 May 21 13:02:20.427199 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:20.427097 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28d596d9_39b6_420f_bdae_5238e6bb5ff7.slice/crio-84d4f7a80f793d09cea38c10230fc97eac5cd2b8173fe61dd3ea361ab1ebd711 WatchSource:0}: Error finding container 84d4f7a80f793d09cea38c10230fc97eac5cd2b8173fe61dd3ea361ab1ebd711: Status 404 returned error can't find the container with id 84d4f7a80f793d09cea38c10230fc97eac5cd2b8173fe61dd3ea361ab1ebd711 May 21 13:02:20.612833 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:20.612653 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 12:57:18 +0000 UTC" deadline="2027-11-20 01:49:44.838357589 +0000 UTC" May 21 13:02:20.612833 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:20.612827 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13140h47m24.22553375s" May 21 13:02:20.687672 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:20.687651 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:02:20.687783 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:20.687749 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xxmv" podUID="1457bd6e-e261-401d-a957-cf50ed787bf8" May 21 13:02:20.694456 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:20.694426 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-142.ec2.internal" event={"ID":"a38ea9a58019d421754c06e634aaf4f8","Type":"ContainerStarted","Data":"f0126885194639af9e1269cc6b1dacc04c894d85102f839e67b3e3ffa0d25c2e"} May 21 13:02:20.695523 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:20.695495 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5l8fb" event={"ID":"28d596d9-39b6-420f-bdae-5238e6bb5ff7","Type":"ContainerStarted","Data":"84d4f7a80f793d09cea38c10230fc97eac5cd2b8173fe61dd3ea361ab1ebd711"} May 21 13:02:20.696550 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:20.696525 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" event={"ID":"c580f711-baaf-45c0-b480-5cee528524ed","Type":"ContainerStarted","Data":"ad6daeeecd81a35f9cbb18a8fd074318cbd2067bac8ebf19bed936c29071be10"} May 21 13:02:20.697495 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:20.697477 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hts48" event={"ID":"d6095d2c-d51f-42aa-9514-91273a5b74a7","Type":"ContainerStarted","Data":"75aa75791aa8f9e84dad18710930be75c25d8777c94cf79e2cae1bc20f79f8c4"} May 21 13:02:20.698496 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:20.698464 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vknxk" event={"ID":"d810a2f9-8ddb-40bb-aedb-fcac7542fb8b","Type":"ContainerStarted","Data":"7949d999bba2042ad252fedb784020f9b1279781d2d1c0cbed92acd1b7f20623"} May 21 13:02:20.699505 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:20.699488 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pf45t" event={"ID":"90df9cf5-af9f-4ced-a8b9-bc37cb33c819","Type":"ContainerStarted","Data":"29ffc283bfbda3005602ede991504eee6885c61564c140d913c66ad0284ead2e"} May 21 13:02:20.701500 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:20.701478 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-z99cs" event={"ID":"c90f9ff1-662a-4aeb-8c12-ec54ec6c9eb0","Type":"ContainerStarted","Data":"ccb7809859b38024ea7a70d560dcb252f68927ec245fd7473779eefe427fdcac"} May 21 13:02:20.702429 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:20.702409 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" event={"ID":"95243429-9417-4afa-ab0b-01596ab17da7","Type":"ContainerStarted","Data":"853e283817c20e3a649fd6b6e2ab7581fd840c76678906fa1a0704646e5a86e5"} May 21 13:02:20.703466 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:20.703449 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fr9ps" event={"ID":"5fcca11f-a823-4785-a382-abeb26b0264b","Type":"ContainerStarted","Data":"b016bf6ec4e43f42b9295a7b4fd78014f6a3014f45f9d4e985c11cb5a77d1295"} May 21 13:02:20.709168 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:20.709122 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-142.ec2.internal" podStartSLOduration=1.70911107 podStartE2EDuration="1.70911107s" podCreationTimestamp="2026-05-21 13:02:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 13:02:20.708506506 +0000 UTC m=+3.563217996" watchObservedRunningTime="2026-05-21 13:02:20.70911107 +0000 UTC m=+3.563822556" May 21 13:02:21.287888 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:21.287305 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1457bd6e-e261-401d-a957-cf50ed787bf8-metrics-certs\") pod \"network-metrics-daemon-5xxmv\" (UID: \"1457bd6e-e261-401d-a957-cf50ed787bf8\") " pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:02:21.287888 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:21.287446 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 13:02:21.287888 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:21.287512 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1457bd6e-e261-401d-a957-cf50ed787bf8-metrics-certs podName:1457bd6e-e261-401d-a957-cf50ed787bf8 nodeName:}" failed. No retries permitted until 2026-05-21 13:02:23.2874938 +0000 UTC m=+6.142205274 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1457bd6e-e261-401d-a957-cf50ed787bf8-metrics-certs") pod "network-metrics-daemon-5xxmv" (UID: "1457bd6e-e261-401d-a957-cf50ed787bf8") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 13:02:21.388625 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:21.388050 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6jh7w\" (UniqueName: \"kubernetes.io/projected/ea47420b-798b-4626-8614-a2fb41be4ba0-kube-api-access-6jh7w\") pod \"network-check-target-jpd9b\" (UID: \"ea47420b-798b-4626-8614-a2fb41be4ba0\") " pod="openshift-network-diagnostics/network-check-target-jpd9b" May 21 13:02:21.388625 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:21.388256 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 13:02:21.388625 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:21.388279 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 13:02:21.388625 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:21.388292 2561 projected.go:194] Error preparing data for projected volume kube-api-access-6jh7w for pod openshift-network-diagnostics/network-check-target-jpd9b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 13:02:21.388625 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:21.388352 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea47420b-798b-4626-8614-a2fb41be4ba0-kube-api-access-6jh7w podName:ea47420b-798b-4626-8614-a2fb41be4ba0 nodeName:}" failed. No retries permitted until 2026-05-21 13:02:23.388333859 +0000 UTC m=+6.243045333 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6jh7w" (UniqueName: "kubernetes.io/projected/ea47420b-798b-4626-8614-a2fb41be4ba0-kube-api-access-6jh7w") pod "network-check-target-jpd9b" (UID: "ea47420b-798b-4626-8614-a2fb41be4ba0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 13:02:21.689873 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:21.688145 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jpd9b" May 21 13:02:21.689873 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:21.688273 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jpd9b" podUID="ea47420b-798b-4626-8614-a2fb41be4ba0" May 21 13:02:21.713605 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:21.712741 2561 generic.go:358] "Generic (PLEG): container finished" podID="9c2f61b69c4ebcd1af01e7a032d7d756" containerID="21202251fbbdecc1c55d70172d88a5b7aa78421a1f0970e9d74b51390779a4dc" exitCode=0 May 21 13:02:21.713605 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:21.713304 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal" event={"ID":"9c2f61b69c4ebcd1af01e7a032d7d756","Type":"ContainerDied","Data":"21202251fbbdecc1c55d70172d88a5b7aa78421a1f0970e9d74b51390779a4dc"} May 21 13:02:22.687406 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:22.687374 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:02:22.687662 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:22.687517 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xxmv" podUID="1457bd6e-e261-401d-a957-cf50ed787bf8" May 21 13:02:22.725433 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:22.725393 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal" event={"ID":"9c2f61b69c4ebcd1af01e7a032d7d756","Type":"ContainerStarted","Data":"dbb43184bf7f54b6615bf5e4fb44042d8cb06b646bc4663aaada8bab68f0d976"} May 21 13:02:23.307485 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:23.307450 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1457bd6e-e261-401d-a957-cf50ed787bf8-metrics-certs\") pod \"network-metrics-daemon-5xxmv\" (UID: \"1457bd6e-e261-401d-a957-cf50ed787bf8\") " pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:02:23.307690 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:23.307626 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 13:02:23.307756 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:23.307705 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1457bd6e-e261-401d-a957-cf50ed787bf8-metrics-certs podName:1457bd6e-e261-401d-a957-cf50ed787bf8 nodeName:}" failed. No retries permitted until 2026-05-21 13:02:27.307685326 +0000 UTC m=+10.162396800 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1457bd6e-e261-401d-a957-cf50ed787bf8-metrics-certs") pod "network-metrics-daemon-5xxmv" (UID: "1457bd6e-e261-401d-a957-cf50ed787bf8") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 13:02:23.408172 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:23.408131 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6jh7w\" (UniqueName: \"kubernetes.io/projected/ea47420b-798b-4626-8614-a2fb41be4ba0-kube-api-access-6jh7w\") pod \"network-check-target-jpd9b\" (UID: \"ea47420b-798b-4626-8614-a2fb41be4ba0\") " pod="openshift-network-diagnostics/network-check-target-jpd9b" May 21 13:02:23.408351 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:23.408304 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 13:02:23.408351 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:23.408326 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 13:02:23.408351 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:23.408340 2561 projected.go:194] Error preparing data for projected volume kube-api-access-6jh7w for pod openshift-network-diagnostics/network-check-target-jpd9b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 13:02:23.408511 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:23.408399 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea47420b-798b-4626-8614-a2fb41be4ba0-kube-api-access-6jh7w podName:ea47420b-798b-4626-8614-a2fb41be4ba0 nodeName:}" failed. No retries permitted until 2026-05-21 13:02:27.408378677 +0000 UTC m=+10.263090147 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6jh7w" (UniqueName: "kubernetes.io/projected/ea47420b-798b-4626-8614-a2fb41be4ba0-kube-api-access-6jh7w") pod "network-check-target-jpd9b" (UID: "ea47420b-798b-4626-8614-a2fb41be4ba0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 13:02:23.687725 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:23.687629 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jpd9b" May 21 13:02:23.687994 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:23.687747 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jpd9b" podUID="ea47420b-798b-4626-8614-a2fb41be4ba0" May 21 13:02:24.688057 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:24.688021 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:02:24.688564 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:24.688172 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xxmv" podUID="1457bd6e-e261-401d-a957-cf50ed787bf8" May 21 13:02:25.692845 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:25.688474 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jpd9b" May 21 13:02:25.693326 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:25.692993 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jpd9b" podUID="ea47420b-798b-4626-8614-a2fb41be4ba0" May 21 13:02:26.687807 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:26.687771 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:02:26.687996 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:26.687926 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xxmv" podUID="1457bd6e-e261-401d-a957-cf50ed787bf8" May 21 13:02:27.342519 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:27.342128 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1457bd6e-e261-401d-a957-cf50ed787bf8-metrics-certs\") pod \"network-metrics-daemon-5xxmv\" (UID: \"1457bd6e-e261-401d-a957-cf50ed787bf8\") " pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:02:27.342519 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:27.342277 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 13:02:27.342519 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:27.342347 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1457bd6e-e261-401d-a957-cf50ed787bf8-metrics-certs podName:1457bd6e-e261-401d-a957-cf50ed787bf8 nodeName:}" failed. No retries permitted until 2026-05-21 13:02:35.342328898 +0000 UTC m=+18.197040373 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1457bd6e-e261-401d-a957-cf50ed787bf8-metrics-certs") pod "network-metrics-daemon-5xxmv" (UID: "1457bd6e-e261-401d-a957-cf50ed787bf8") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 13:02:27.443543 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:27.443469 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6jh7w\" (UniqueName: \"kubernetes.io/projected/ea47420b-798b-4626-8614-a2fb41be4ba0-kube-api-access-6jh7w\") pod \"network-check-target-jpd9b\" (UID: \"ea47420b-798b-4626-8614-a2fb41be4ba0\") " pod="openshift-network-diagnostics/network-check-target-jpd9b" May 21 13:02:27.443736 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:27.443632 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 13:02:27.443736 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:27.443683 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 13:02:27.443736 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:27.443717 2561 projected.go:194] Error preparing data for projected volume kube-api-access-6jh7w for pod openshift-network-diagnostics/network-check-target-jpd9b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 13:02:27.443878 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:27.443785 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea47420b-798b-4626-8614-a2fb41be4ba0-kube-api-access-6jh7w podName:ea47420b-798b-4626-8614-a2fb41be4ba0 nodeName:}" failed. No retries permitted until 2026-05-21 13:02:35.443766129 +0000 UTC m=+18.298477616 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6jh7w" (UniqueName: "kubernetes.io/projected/ea47420b-798b-4626-8614-a2fb41be4ba0-kube-api-access-6jh7w") pod "network-check-target-jpd9b" (UID: "ea47420b-798b-4626-8614-a2fb41be4ba0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 13:02:27.688473 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:27.688350 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jpd9b" May 21 13:02:27.689424 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:27.689387 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jpd9b" podUID="ea47420b-798b-4626-8614-a2fb41be4ba0" May 21 13:02:28.687408 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:28.687372 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:02:28.687865 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:28.687517 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xxmv" podUID="1457bd6e-e261-401d-a957-cf50ed787bf8" May 21 13:02:29.687437 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:29.687400 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jpd9b" May 21 13:02:29.687850 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:29.687535 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jpd9b" podUID="ea47420b-798b-4626-8614-a2fb41be4ba0" May 21 13:02:30.687802 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:30.687765 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:02:30.688183 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:30.687902 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xxmv" podUID="1457bd6e-e261-401d-a957-cf50ed787bf8" May 21 13:02:31.687298 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:31.687264 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jpd9b" May 21 13:02:31.687468 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:31.687393 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jpd9b" podUID="ea47420b-798b-4626-8614-a2fb41be4ba0" May 21 13:02:32.687735 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:32.687704 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:02:32.688178 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:32.687837 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xxmv" podUID="1457bd6e-e261-401d-a957-cf50ed787bf8" May 21 13:02:33.687536 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:33.687500 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jpd9b" May 21 13:02:33.687702 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:33.687650 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jpd9b" podUID="ea47420b-798b-4626-8614-a2fb41be4ba0" May 21 13:02:34.215182 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:34.215111 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-142.ec2.internal" podStartSLOduration=15.215090588 podStartE2EDuration="15.215090588s" podCreationTimestamp="2026-05-21 13:02:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 13:02:22.740147373 +0000 UTC m=+5.594858863" watchObservedRunningTime="2026-05-21 13:02:34.215090588 +0000 UTC m=+17.069802080" May 21 13:02:34.215829 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:34.215804 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-wpjmn"] May 21 13:02:34.228092 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:34.228046 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpjmn" May 21 13:02:34.228234 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:34.228139 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wpjmn" podUID="8621c605-ffd6-4f1c-8279-33031fef7e8f" May 21 13:02:34.291657 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:34.291623 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8621c605-ffd6-4f1c-8279-33031fef7e8f-original-pull-secret\") pod \"global-pull-secret-syncer-wpjmn\" (UID: \"8621c605-ffd6-4f1c-8279-33031fef7e8f\") " pod="kube-system/global-pull-secret-syncer-wpjmn" May 21 13:02:34.291839 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:34.291668 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8621c605-ffd6-4f1c-8279-33031fef7e8f-kubelet-config\") pod \"global-pull-secret-syncer-wpjmn\" (UID: \"8621c605-ffd6-4f1c-8279-33031fef7e8f\") " pod="kube-system/global-pull-secret-syncer-wpjmn" May 21 13:02:34.291839 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:34.291692 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8621c605-ffd6-4f1c-8279-33031fef7e8f-dbus\") pod \"global-pull-secret-syncer-wpjmn\" (UID: \"8621c605-ffd6-4f1c-8279-33031fef7e8f\") " pod="kube-system/global-pull-secret-syncer-wpjmn" May 21 13:02:34.392851 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:34.392815 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8621c605-ffd6-4f1c-8279-33031fef7e8f-kubelet-config\") pod \"global-pull-secret-syncer-wpjmn\" (UID: \"8621c605-ffd6-4f1c-8279-33031fef7e8f\") " pod="kube-system/global-pull-secret-syncer-wpjmn" May 21 13:02:34.392851 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:34.392859 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8621c605-ffd6-4f1c-8279-33031fef7e8f-dbus\") pod \"global-pull-secret-syncer-wpjmn\" (UID: \"8621c605-ffd6-4f1c-8279-33031fef7e8f\") " pod="kube-system/global-pull-secret-syncer-wpjmn" May 21 13:02:34.393107 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:34.392942 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8621c605-ffd6-4f1c-8279-33031fef7e8f-original-pull-secret\") pod \"global-pull-secret-syncer-wpjmn\" (UID: \"8621c605-ffd6-4f1c-8279-33031fef7e8f\") " pod="kube-system/global-pull-secret-syncer-wpjmn" May 21 13:02:34.393107 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:34.392960 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8621c605-ffd6-4f1c-8279-33031fef7e8f-kubelet-config\") pod \"global-pull-secret-syncer-wpjmn\" (UID: \"8621c605-ffd6-4f1c-8279-33031fef7e8f\") " pod="kube-system/global-pull-secret-syncer-wpjmn" May 21 13:02:34.393107 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:34.393056 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 13:02:34.393107 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:34.393081 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8621c605-ffd6-4f1c-8279-33031fef7e8f-dbus\") pod \"global-pull-secret-syncer-wpjmn\" (UID: \"8621c605-ffd6-4f1c-8279-33031fef7e8f\") " pod="kube-system/global-pull-secret-syncer-wpjmn" May 21 13:02:34.393253 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:34.393116 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8621c605-ffd6-4f1c-8279-33031fef7e8f-original-pull-secret podName:8621c605-ffd6-4f1c-8279-33031fef7e8f nodeName:}" failed. No retries permitted until 2026-05-21 13:02:34.893098047 +0000 UTC m=+17.747809530 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8621c605-ffd6-4f1c-8279-33031fef7e8f-original-pull-secret") pod "global-pull-secret-syncer-wpjmn" (UID: "8621c605-ffd6-4f1c-8279-33031fef7e8f") : object "kube-system"/"original-pull-secret" not registered May 21 13:02:34.687423 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:34.687394 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:02:34.687716 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:34.687501 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xxmv" podUID="1457bd6e-e261-401d-a957-cf50ed787bf8" May 21 13:02:34.896018 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:34.895982 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8621c605-ffd6-4f1c-8279-33031fef7e8f-original-pull-secret\") pod \"global-pull-secret-syncer-wpjmn\" (UID: \"8621c605-ffd6-4f1c-8279-33031fef7e8f\") " pod="kube-system/global-pull-secret-syncer-wpjmn" May 21 13:02:34.896181 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:34.896102 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 13:02:34.896181 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:34.896168 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8621c605-ffd6-4f1c-8279-33031fef7e8f-original-pull-secret podName:8621c605-ffd6-4f1c-8279-33031fef7e8f nodeName:}" failed. No retries permitted until 2026-05-21 13:02:35.896149201 +0000 UTC m=+18.750860681 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8621c605-ffd6-4f1c-8279-33031fef7e8f-original-pull-secret") pod "global-pull-secret-syncer-wpjmn" (UID: "8621c605-ffd6-4f1c-8279-33031fef7e8f") : object "kube-system"/"original-pull-secret" not registered May 21 13:02:35.398830 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:35.398794 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1457bd6e-e261-401d-a957-cf50ed787bf8-metrics-certs\") pod \"network-metrics-daemon-5xxmv\" (UID: \"1457bd6e-e261-401d-a957-cf50ed787bf8\") " pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:02:35.399264 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:35.398944 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 13:02:35.399264 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:35.399012 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1457bd6e-e261-401d-a957-cf50ed787bf8-metrics-certs podName:1457bd6e-e261-401d-a957-cf50ed787bf8 nodeName:}" failed. No retries permitted until 2026-05-21 13:02:51.398994189 +0000 UTC m=+34.253705671 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1457bd6e-e261-401d-a957-cf50ed787bf8-metrics-certs") pod "network-metrics-daemon-5xxmv" (UID: "1457bd6e-e261-401d-a957-cf50ed787bf8") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 13:02:35.499959 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:35.499893 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6jh7w\" (UniqueName: \"kubernetes.io/projected/ea47420b-798b-4626-8614-a2fb41be4ba0-kube-api-access-6jh7w\") pod \"network-check-target-jpd9b\" (UID: \"ea47420b-798b-4626-8614-a2fb41be4ba0\") " pod="openshift-network-diagnostics/network-check-target-jpd9b" May 21 13:02:35.500135 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:35.500021 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 13:02:35.500135 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:35.500040 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 13:02:35.500135 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:35.500052 2561 projected.go:194] Error preparing data for projected volume kube-api-access-6jh7w for pod openshift-network-diagnostics/network-check-target-jpd9b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 13:02:35.500135 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:35.500109 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ea47420b-798b-4626-8614-a2fb41be4ba0-kube-api-access-6jh7w podName:ea47420b-798b-4626-8614-a2fb41be4ba0 nodeName:}" failed. No retries permitted until 2026-05-21 13:02:51.500091294 +0000 UTC m=+34.354802773 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6jh7w" (UniqueName: "kubernetes.io/projected/ea47420b-798b-4626-8614-a2fb41be4ba0-kube-api-access-6jh7w") pod "network-check-target-jpd9b" (UID: "ea47420b-798b-4626-8614-a2fb41be4ba0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 13:02:35.687938 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:35.687823 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jpd9b" May 21 13:02:35.687938 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:35.687877 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpjmn" May 21 13:02:35.688130 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:35.687979 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jpd9b" podUID="ea47420b-798b-4626-8614-a2fb41be4ba0" May 21 13:02:35.688185 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:35.688125 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wpjmn" podUID="8621c605-ffd6-4f1c-8279-33031fef7e8f" May 21 13:02:35.902433 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:35.902405 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8621c605-ffd6-4f1c-8279-33031fef7e8f-original-pull-secret\") pod \"global-pull-secret-syncer-wpjmn\" (UID: \"8621c605-ffd6-4f1c-8279-33031fef7e8f\") " pod="kube-system/global-pull-secret-syncer-wpjmn" May 21 13:02:35.902638 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:35.902557 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 13:02:35.902638 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:35.902629 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8621c605-ffd6-4f1c-8279-33031fef7e8f-original-pull-secret podName:8621c605-ffd6-4f1c-8279-33031fef7e8f nodeName:}" failed. No retries permitted until 2026-05-21 13:02:37.90261277 +0000 UTC m=+20.757324246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8621c605-ffd6-4f1c-8279-33031fef7e8f-original-pull-secret") pod "global-pull-secret-syncer-wpjmn" (UID: "8621c605-ffd6-4f1c-8279-33031fef7e8f") : object "kube-system"/"original-pull-secret" not registered May 21 13:02:36.687522 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:36.687490 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:02:36.688084 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:36.687637 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xxmv" podUID="1457bd6e-e261-401d-a957-cf50ed787bf8" May 21 13:02:37.687974 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:37.687943 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jpd9b" May 21 13:02:37.688281 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:37.688046 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jpd9b" podUID="ea47420b-798b-4626-8614-a2fb41be4ba0" May 21 13:02:37.688281 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:37.688109 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpjmn" May 21 13:02:37.688281 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:37.688204 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wpjmn" podUID="8621c605-ffd6-4f1c-8279-33031fef7e8f" May 21 13:02:37.919770 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:37.919695 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8621c605-ffd6-4f1c-8279-33031fef7e8f-original-pull-secret\") pod \"global-pull-secret-syncer-wpjmn\" (UID: \"8621c605-ffd6-4f1c-8279-33031fef7e8f\") " pod="kube-system/global-pull-secret-syncer-wpjmn" May 21 13:02:37.919906 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:37.919867 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 13:02:37.919968 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:37.919946 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8621c605-ffd6-4f1c-8279-33031fef7e8f-original-pull-secret podName:8621c605-ffd6-4f1c-8279-33031fef7e8f nodeName:}" failed. No retries permitted until 2026-05-21 13:02:41.919927346 +0000 UTC m=+24.774638832 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8621c605-ffd6-4f1c-8279-33031fef7e8f-original-pull-secret") pod "global-pull-secret-syncer-wpjmn" (UID: "8621c605-ffd6-4f1c-8279-33031fef7e8f") : object "kube-system"/"original-pull-secret" not registered May 21 13:02:38.687609 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:38.687367 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:02:38.687742 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:38.687723 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xxmv" podUID="1457bd6e-e261-401d-a957-cf50ed787bf8" May 21 13:02:38.752547 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:38.752515 2561 generic.go:358] "Generic (PLEG): container finished" podID="90df9cf5-af9f-4ced-a8b9-bc37cb33c819" containerID="c9b449c21f399fa2df347d0bcb85dd397f44dcb3bf8b7b0fe69af7d09f773a41" exitCode=0 May 21 13:02:38.753398 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:38.752595 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pf45t" event={"ID":"90df9cf5-af9f-4ced-a8b9-bc37cb33c819","Type":"ContainerDied","Data":"c9b449c21f399fa2df347d0bcb85dd397f44dcb3bf8b7b0fe69af7d09f773a41"} May 21 13:02:38.754219 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:38.754045 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-z99cs" event={"ID":"c90f9ff1-662a-4aeb-8c12-ec54ec6c9eb0","Type":"ContainerStarted","Data":"5037fe0b009fc2417448b995f494a8a6afecfdc2f83fa07a2f8dcf515caecdb9"} May 21 13:02:38.759785 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:38.759759 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" event={"ID":"95243429-9417-4afa-ab0b-01596ab17da7","Type":"ContainerStarted","Data":"47430b71bc80108eedfc71e8b850ed977cd2a6fa552aa03051c91e18bef969ae"} May 21 13:02:38.759881 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:38.759791 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" event={"ID":"95243429-9417-4afa-ab0b-01596ab17da7","Type":"ContainerStarted","Data":"9f91b4f7223b9e38fb666a832d775fe7c59f41ea423e30672f3cfe20104b0444"} May 21 13:02:38.759881 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:38.759801 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" event={"ID":"95243429-9417-4afa-ab0b-01596ab17da7","Type":"ContainerStarted","Data":"d27e9d2e2628e23bfcf4b3a96db8af3e38f438e0eb10c807c22392419f1a4ef3"} May 21 13:02:38.759881 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:38.759809 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" event={"ID":"95243429-9417-4afa-ab0b-01596ab17da7","Type":"ContainerStarted","Data":"c95cac733478401d455a5f924e897cd6cc7cd237c5bb0a68b31ea9c2b2ca0699"} May 21 13:02:38.759881 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:38.759816 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" event={"ID":"95243429-9417-4afa-ab0b-01596ab17da7","Type":"ContainerStarted","Data":"4ae823c820b312a03917ba63838f93fc7eb5c8accef48549af8d36bd140c20e1"} May 21 13:02:38.759881 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:38.759824 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" event={"ID":"95243429-9417-4afa-ab0b-01596ab17da7","Type":"ContainerStarted","Data":"f3ba22fdce3bc964e6dd741802383f14057c8a9706a15593d944dbc799402a54"} May 21 13:02:38.761139 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:38.761115 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5l8fb" event={"ID":"28d596d9-39b6-420f-bdae-5238e6bb5ff7","Type":"ContainerStarted","Data":"fa0727aa2def0c002b7efb5e7ddc6ddb75aee518658ea6fa9c1e4e1c2ec09482"} May 21 13:02:38.762472 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:38.762449 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" event={"ID":"c580f711-baaf-45c0-b480-5cee528524ed","Type":"ContainerStarted","Data":"3b8a4ca26eab1554f7cf87aebd9e41f4beafd61686fa83f3567710071b818d00"} May 21 13:02:38.763670 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:38.763651 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hts48" event={"ID":"d6095d2c-d51f-42aa-9514-91273a5b74a7","Type":"ContainerStarted","Data":"175124e0d7e81206bd33f80095c73e93d311f62fc410b3a80418af9128bc86e1"} May 21 13:02:38.764960 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:38.764940 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vknxk" event={"ID":"d810a2f9-8ddb-40bb-aedb-fcac7542fb8b","Type":"ContainerStarted","Data":"a18991d6ad8fbae9df47a44a6dca5109043ea27e5c11da8aa5f4d012f181b86a"} May 21 13:02:38.792455 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:38.792413 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hts48" podStartSLOduration=4.379053965 podStartE2EDuration="21.792399386s" podCreationTimestamp="2026-05-21 13:02:17 +0000 UTC" firstStartedPulling="2026-05-21 13:02:20.427647417 +0000 UTC m=+3.282358901" lastFinishedPulling="2026-05-21 13:02:37.840992847 +0000 UTC m=+20.695704322" observedRunningTime="2026-05-21 13:02:38.79202008 +0000 UTC m=+21.646731571" watchObservedRunningTime="2026-05-21 13:02:38.792399386 +0000 UTC m=+21.647110875" May 21 13:02:38.827541 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:38.827488 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-z99cs" podStartSLOduration=9.049636414 podStartE2EDuration="21.827474505s" podCreationTimestamp="2026-05-21 13:02:17 +0000 UTC" firstStartedPulling="2026-05-21 13:02:20.426112295 +0000 UTC m=+3.280823763" lastFinishedPulling="2026-05-21 13:02:33.203950368 +0000 UTC m=+16.058661854" observedRunningTime="2026-05-21 13:02:38.810071745 +0000 UTC m=+21.664783234" watchObservedRunningTime="2026-05-21 13:02:38.827474505 +0000 UTC m=+21.682185993" May 21 13:02:38.844301 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:38.844252 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sjgk9" podStartSLOduration=3.430006005 podStartE2EDuration="20.844236408s" podCreationTimestamp="2026-05-21 13:02:18 +0000 UTC" firstStartedPulling="2026-05-21 13:02:20.428359381 +0000 UTC m=+3.283070854" lastFinishedPulling="2026-05-21 13:02:37.842589776 +0000 UTC m=+20.697301257" observedRunningTime="2026-05-21 13:02:38.843740524 +0000 UTC m=+21.698452016" watchObservedRunningTime="2026-05-21 13:02:38.844236408 +0000 UTC m=+21.698947897" May 21 13:02:38.844439 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:38.844417 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-5l8fb" podStartSLOduration=4.429329903 podStartE2EDuration="21.844411322s" podCreationTimestamp="2026-05-21 13:02:17 +0000 UTC" firstStartedPulling="2026-05-21 13:02:20.429131342 +0000 UTC m=+3.283842809" lastFinishedPulling="2026-05-21 13:02:37.844212755 +0000 UTC m=+20.698924228" observedRunningTime="2026-05-21 13:02:38.827325174 +0000 UTC m=+21.682036687" watchObservedRunningTime="2026-05-21 13:02:38.844411322 +0000 UTC m=+21.699122810" May 21 13:02:39.009509 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:39.009489 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 13:02:39.189437 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:39.189349 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-z99cs" May 21 13:02:39.435057 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:39.435025 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-z99cs" May 21 13:02:39.435757 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:39.435731 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-z99cs" May 21 13:02:39.629597 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:39.629478 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T13:02:39.009505226Z","UUID":"be4d4180-2f9b-488d-be0f-7c8dd037462b","Handler":null,"Name":"","Endpoint":""} May 21 13:02:39.631141 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:39.631115 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 13:02:39.631141 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:39.631145 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 13:02:39.687432 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:39.687399 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpjmn" May 21 13:02:39.687615 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:39.687399 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jpd9b" May 21 13:02:39.687615 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:39.687513 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wpjmn" podUID="8621c605-ffd6-4f1c-8279-33031fef7e8f" May 21 13:02:39.687729 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:39.687614 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jpd9b" podUID="ea47420b-798b-4626-8614-a2fb41be4ba0" May 21 13:02:39.768238 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:39.768196 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vknxk" event={"ID":"d810a2f9-8ddb-40bb-aedb-fcac7542fb8b","Type":"ContainerStarted","Data":"8e78666d741ee2fab49b4938d2f452a6f157a59966b88e10800cbe4943c5e220"} May 21 13:02:39.769525 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:39.769492 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fr9ps" event={"ID":"5fcca11f-a823-4785-a382-abeb26b0264b","Type":"ContainerStarted","Data":"900a6452345549f9eb393ecca2467102371380184e4be894f9ea65c149e7b404"} May 21 13:02:39.770784 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:39.770765 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-z99cs" May 21 13:02:39.796020 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:39.795957 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fr9ps" podStartSLOduration=5.374774107 podStartE2EDuration="22.79593828s" podCreationTimestamp="2026-05-21 13:02:17 +0000 UTC" firstStartedPulling="2026-05-21 13:02:20.419827353 +0000 UTC m=+3.274538823" lastFinishedPulling="2026-05-21 13:02:37.840991521 +0000 UTC m=+20.695702996" observedRunningTime="2026-05-21 13:02:39.795796937 +0000 UTC m=+22.650508432" watchObservedRunningTime="2026-05-21 13:02:39.79593828 +0000 UTC m=+22.650649795" May 21 13:02:40.687396 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:40.687360 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:02:40.687555 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:40.687503 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xxmv" podUID="1457bd6e-e261-401d-a957-cf50ed787bf8" May 21 13:02:40.773489 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:40.773410 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vknxk" event={"ID":"d810a2f9-8ddb-40bb-aedb-fcac7542fb8b","Type":"ContainerStarted","Data":"8ca99c13be08c142fbee0e3ac35a2d2eb1e59971199fd546bbec7debeed5ff87"} May 21 13:02:40.776417 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:40.776387 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" event={"ID":"95243429-9417-4afa-ab0b-01596ab17da7","Type":"ContainerStarted","Data":"e18ea85d420c263dd185849e94e00feb9be4c1bea09f4498681b4f9bbe188079"} May 21 13:02:41.687870 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:41.687771 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jpd9b" May 21 13:02:41.687870 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:41.687816 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpjmn" May 21 13:02:41.688082 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:41.687904 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jpd9b" podUID="ea47420b-798b-4626-8614-a2fb41be4ba0" May 21 13:02:41.688082 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:41.688024 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wpjmn" podUID="8621c605-ffd6-4f1c-8279-33031fef7e8f" May 21 13:02:41.952904 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:41.952672 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8621c605-ffd6-4f1c-8279-33031fef7e8f-original-pull-secret\") pod \"global-pull-secret-syncer-wpjmn\" (UID: \"8621c605-ffd6-4f1c-8279-33031fef7e8f\") " pod="kube-system/global-pull-secret-syncer-wpjmn" May 21 13:02:41.953252 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:41.952805 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 13:02:41.953252 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:41.952972 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8621c605-ffd6-4f1c-8279-33031fef7e8f-original-pull-secret podName:8621c605-ffd6-4f1c-8279-33031fef7e8f nodeName:}" failed. No retries permitted until 2026-05-21 13:02:49.952950168 +0000 UTC m=+32.807661639 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8621c605-ffd6-4f1c-8279-33031fef7e8f-original-pull-secret") pod "global-pull-secret-syncer-wpjmn" (UID: "8621c605-ffd6-4f1c-8279-33031fef7e8f") : object "kube-system"/"original-pull-secret" not registered May 21 13:02:42.687666 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:42.687625 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:02:42.687828 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:42.687751 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xxmv" podUID="1457bd6e-e261-401d-a957-cf50ed787bf8" May 21 13:02:43.687694 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:43.687664 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jpd9b" May 21 13:02:43.688140 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:43.687782 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jpd9b" podUID="ea47420b-798b-4626-8614-a2fb41be4ba0" May 21 13:02:43.688140 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:43.687863 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpjmn" May 21 13:02:43.688140 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:43.687979 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wpjmn" podUID="8621c605-ffd6-4f1c-8279-33031fef7e8f" May 21 13:02:44.687841 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:44.687606 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:02:44.688447 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:44.687857 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xxmv" podUID="1457bd6e-e261-401d-a957-cf50ed787bf8" May 21 13:02:44.784119 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:44.784086 2561 generic.go:358] "Generic (PLEG): container finished" podID="90df9cf5-af9f-4ced-a8b9-bc37cb33c819" containerID="a43ff5e2b52aa0758306a15b5975e678b6a489b3926911073a0764a66299b955" exitCode=0 May 21 13:02:44.784273 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:44.784169 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pf45t" event={"ID":"90df9cf5-af9f-4ced-a8b9-bc37cb33c819","Type":"ContainerDied","Data":"a43ff5e2b52aa0758306a15b5975e678b6a489b3926911073a0764a66299b955"} May 21 13:02:44.787325 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:44.787304 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" event={"ID":"95243429-9417-4afa-ab0b-01596ab17da7","Type":"ContainerStarted","Data":"af49f00f0919a26c0981ade3b9ddf2e31329779ee37ab84ca3076df3a3d178b9"} May 21 13:02:44.787611 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:44.787595 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:44.787689 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:44.787619 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:44.802075 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:44.802054 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:44.808072 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:44.808039 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vknxk" podStartSLOduration=8.390870437 podStartE2EDuration="27.808028192s" podCreationTimestamp="2026-05-21 13:02:17 +0000 UTC" firstStartedPulling="2026-05-21 13:02:20.423952839 +0000 UTC m=+3.278664318" lastFinishedPulling="2026-05-21 13:02:39.841110599 +0000 UTC m=+22.695822073" observedRunningTime="2026-05-21 13:02:40.792470001 +0000 UTC m=+23.647181490" watchObservedRunningTime="2026-05-21 13:02:44.808028192 +0000 UTC m=+27.662739695" May 21 13:02:44.833943 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:44.833903 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" podStartSLOduration=9.372866013 podStartE2EDuration="26.833890448s" podCreationTimestamp="2026-05-21 13:02:18 +0000 UTC" firstStartedPulling="2026-05-21 13:02:20.42482732 +0000 UTC m=+3.279538793" lastFinishedPulling="2026-05-21 13:02:37.885851746 +0000 UTC m=+20.740563228" observedRunningTime="2026-05-21 13:02:44.833771716 +0000 UTC m=+27.688483206" watchObservedRunningTime="2026-05-21 13:02:44.833890448 +0000 UTC m=+27.688601937" May 21 13:02:45.481725 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:45.481693 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-9zcrx"] May 21 13:02:45.497165 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:45.497138 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9zcrx" May 21 13:02:45.504699 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:45.504679 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 13:02:45.504814 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:45.504740 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zzdv5\"" May 21 13:02:45.504814 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:45.504746 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 13:02:45.582279 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:45.582246 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a149808-cb2d-482b-8d99-7e2d58b6b997-hosts-file\") pod \"node-resolver-9zcrx\" (UID: \"3a149808-cb2d-482b-8d99-7e2d58b6b997\") " pod="openshift-dns/node-resolver-9zcrx" May 21 13:02:45.582469 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:45.582297 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a149808-cb2d-482b-8d99-7e2d58b6b997-tmp-dir\") pod \"node-resolver-9zcrx\" (UID: \"3a149808-cb2d-482b-8d99-7e2d58b6b997\") " pod="openshift-dns/node-resolver-9zcrx" May 21 13:02:45.582469 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:45.582379 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl42j\" (UniqueName: \"kubernetes.io/projected/3a149808-cb2d-482b-8d99-7e2d58b6b997-kube-api-access-gl42j\") pod \"node-resolver-9zcrx\" (UID: \"3a149808-cb2d-482b-8d99-7e2d58b6b997\") " pod="openshift-dns/node-resolver-9zcrx" May 21 13:02:45.682955 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:45.682925 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a149808-cb2d-482b-8d99-7e2d58b6b997-hosts-file\") pod \"node-resolver-9zcrx\" (UID: \"3a149808-cb2d-482b-8d99-7e2d58b6b997\") " pod="openshift-dns/node-resolver-9zcrx" May 21 13:02:45.683110 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:45.682967 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a149808-cb2d-482b-8d99-7e2d58b6b997-tmp-dir\") pod \"node-resolver-9zcrx\" (UID: \"3a149808-cb2d-482b-8d99-7e2d58b6b997\") " pod="openshift-dns/node-resolver-9zcrx" May 21 13:02:45.683110 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:45.683018 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gl42j\" (UniqueName: \"kubernetes.io/projected/3a149808-cb2d-482b-8d99-7e2d58b6b997-kube-api-access-gl42j\") pod \"node-resolver-9zcrx\" (UID: \"3a149808-cb2d-482b-8d99-7e2d58b6b997\") " pod="openshift-dns/node-resolver-9zcrx" May 21 13:02:45.683110 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:45.683065 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3a149808-cb2d-482b-8d99-7e2d58b6b997-hosts-file\") pod \"node-resolver-9zcrx\" (UID: \"3a149808-cb2d-482b-8d99-7e2d58b6b997\") " pod="openshift-dns/node-resolver-9zcrx" May 21 13:02:45.683351 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:45.683330 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a149808-cb2d-482b-8d99-7e2d58b6b997-tmp-dir\") pod \"node-resolver-9zcrx\" (UID: \"3a149808-cb2d-482b-8d99-7e2d58b6b997\") " pod="openshift-dns/node-resolver-9zcrx" May 21 13:02:45.687999 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:45.687982 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpjmn" May 21 13:02:45.688361 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:45.688106 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wpjmn" podUID="8621c605-ffd6-4f1c-8279-33031fef7e8f" May 21 13:02:45.688361 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:45.688168 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jpd9b" May 21 13:02:45.688361 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:45.688252 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jpd9b" podUID="ea47420b-798b-4626-8614-a2fb41be4ba0" May 21 13:02:45.693483 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:45.693461 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl42j\" (UniqueName: \"kubernetes.io/projected/3a149808-cb2d-482b-8d99-7e2d58b6b997-kube-api-access-gl42j\") pod \"node-resolver-9zcrx\" (UID: \"3a149808-cb2d-482b-8d99-7e2d58b6b997\") " pod="openshift-dns/node-resolver-9zcrx" May 21 13:02:45.789465 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:45.789404 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:45.805084 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:45.805057 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:02:45.805301 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:45.805252 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9zcrx" May 21 13:02:45.812484 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:45.812458 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a149808_cb2d_482b_8d99_7e2d58b6b997.slice/crio-ea7888463c6a397af848653d9bf72a2297083515ae685d88f3a099166da6bb60 WatchSource:0}: Error finding container ea7888463c6a397af848653d9bf72a2297083515ae685d88f3a099166da6bb60: Status 404 returned error can't find the container with id ea7888463c6a397af848653d9bf72a2297083515ae685d88f3a099166da6bb60 May 21 13:02:46.299944 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:46.299866 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wpjmn"] May 21 13:02:46.300104 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:46.300012 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpjmn" May 21 13:02:46.300147 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:46.300123 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wpjmn" podUID="8621c605-ffd6-4f1c-8279-33031fef7e8f" May 21 13:02:46.306037 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:46.306013 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jpd9b"] May 21 13:02:46.306138 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:46.306103 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jpd9b" May 21 13:02:46.306208 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:46.306188 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jpd9b" podUID="ea47420b-798b-4626-8614-a2fb41be4ba0" May 21 13:02:46.307346 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:46.307320 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5xxmv"] May 21 13:02:46.307441 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:46.307428 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:02:46.307546 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:46.307527 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xxmv" podUID="1457bd6e-e261-401d-a957-cf50ed787bf8" May 21 13:02:46.792348 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:46.792315 2561 generic.go:358] "Generic (PLEG): container finished" podID="90df9cf5-af9f-4ced-a8b9-bc37cb33c819" containerID="395bd8c5e20aff4561f0f67bdf34b03f3d1b3213fac983cd47dd709c19053958" exitCode=0 May 21 13:02:46.792791 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:46.792391 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pf45t" event={"ID":"90df9cf5-af9f-4ced-a8b9-bc37cb33c819","Type":"ContainerDied","Data":"395bd8c5e20aff4561f0f67bdf34b03f3d1b3213fac983cd47dd709c19053958"} May 21 13:02:46.793722 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:46.793685 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9zcrx" event={"ID":"3a149808-cb2d-482b-8d99-7e2d58b6b997","Type":"ContainerStarted","Data":"212676b37c8f1d88408d97d5432e90024e994a530e32bfc1172a97158e8b79fd"} May 21 13:02:46.793722 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:46.793724 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9zcrx" event={"ID":"3a149808-cb2d-482b-8d99-7e2d58b6b997","Type":"ContainerStarted","Data":"ea7888463c6a397af848653d9bf72a2297083515ae685d88f3a099166da6bb60"} May 21 13:02:47.688819 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:47.688560 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jpd9b" May 21 13:02:47.688934 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:47.688696 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:02:47.688934 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:47.688916 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jpd9b" podUID="ea47420b-798b-4626-8614-a2fb41be4ba0" May 21 13:02:47.689053 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:47.689030 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xxmv" podUID="1457bd6e-e261-401d-a957-cf50ed787bf8" May 21 13:02:47.797819 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:47.797794 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pf45t" event={"ID":"90df9cf5-af9f-4ced-a8b9-bc37cb33c819","Type":"ContainerStarted","Data":"23fa2b3cf9bf0ce53310e1874291409a38f82a35eaecd61e8f0ba2c4514c78aa"} May 21 13:02:48.687042 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:48.687013 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpjmn" May 21 13:02:48.687188 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:48.687113 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wpjmn" podUID="8621c605-ffd6-4f1c-8279-33031fef7e8f" May 21 13:02:48.801821 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:48.801785 2561 generic.go:358] "Generic (PLEG): container finished" podID="90df9cf5-af9f-4ced-a8b9-bc37cb33c819" containerID="23fa2b3cf9bf0ce53310e1874291409a38f82a35eaecd61e8f0ba2c4514c78aa" exitCode=0 May 21 13:02:48.802214 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:48.801841 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pf45t" event={"ID":"90df9cf5-af9f-4ced-a8b9-bc37cb33c819","Type":"ContainerDied","Data":"23fa2b3cf9bf0ce53310e1874291409a38f82a35eaecd61e8f0ba2c4514c78aa"} May 21 13:02:48.836138 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:48.836056 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-9zcrx" podStartSLOduration=3.836042421 podStartE2EDuration="3.836042421s" podCreationTimestamp="2026-05-21 13:02:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 13:02:46.832336597 +0000 UTC m=+29.687048087" watchObservedRunningTime="2026-05-21 13:02:48.836042421 +0000 UTC m=+31.690753916" May 21 13:02:49.687962 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:49.687926 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jpd9b" May 21 13:02:49.688303 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:49.687935 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:02:49.688303 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:49.688045 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jpd9b" podUID="ea47420b-798b-4626-8614-a2fb41be4ba0" May 21 13:02:49.688303 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:49.688151 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xxmv" podUID="1457bd6e-e261-401d-a957-cf50ed787bf8" May 21 13:02:50.016035 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:50.015945 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8621c605-ffd6-4f1c-8279-33031fef7e8f-original-pull-secret\") pod \"global-pull-secret-syncer-wpjmn\" (UID: \"8621c605-ffd6-4f1c-8279-33031fef7e8f\") " pod="kube-system/global-pull-secret-syncer-wpjmn" May 21 13:02:50.016414 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:50.016108 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 21 13:02:50.016414 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:50.016187 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8621c605-ffd6-4f1c-8279-33031fef7e8f-original-pull-secret podName:8621c605-ffd6-4f1c-8279-33031fef7e8f nodeName:}" failed. No retries permitted until 2026-05-21 13:03:06.016167876 +0000 UTC m=+48.870879357 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8621c605-ffd6-4f1c-8279-33031fef7e8f-original-pull-secret") pod "global-pull-secret-syncer-wpjmn" (UID: "8621c605-ffd6-4f1c-8279-33031fef7e8f") : object "kube-system"/"original-pull-secret" not registered May 21 13:02:50.687599 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:50.687507 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpjmn" May 21 13:02:50.687747 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:50.687638 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wpjmn" podUID="8621c605-ffd6-4f1c-8279-33031fef7e8f" May 21 13:02:50.942607 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:50.942519 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-142.ec2.internal" event="NodeReady" May 21 13:02:50.942756 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:50.942680 2561 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 13:02:50.977623 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:50.977594 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-96d5fcb49-fjhxc"] May 21 13:02:50.997098 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:50.997020 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8rd5h"] May 21 13:02:51.021399 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.021306 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-hj996"] May 21 13:02:51.021883 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.021445 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:02:51.024884 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.024768 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 21 13:02:51.024884 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.024813 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pgxzw\"" May 21 13:02:51.025069 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.024889 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 21 13:02:51.025069 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.024921 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 21 13:02:51.030521 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.030490 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 21 13:02:51.044548 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.044521 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-96d5fcb49-fjhxc"] May 21 13:02:51.044703 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.044596 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8rd5h"] May 21 13:02:51.044703 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.044635 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8rd5h" May 21 13:02:51.044703 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.044691 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-d8lss"] May 21 13:02:51.044854 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.044758 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hj996" May 21 13:02:51.047308 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.047153 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 21 13:02:51.047308 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.047190 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-l6ftc\"" May 21 13:02:51.047669 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.047421 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 21 13:02:51.047669 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.047429 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 21 13:02:51.047669 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.047474 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 21 13:02:51.047669 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.047490 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 21 13:02:51.047669 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.047586 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 21 13:02:51.047930 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.047684 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 21 13:02:51.047930 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.047766 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 21 13:02:51.047930 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.047872 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-jd6lz\"" May 21 13:02:51.067535 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.067508 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9cl59"] May 21 13:02:51.067691 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.067668 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-d8lss" May 21 13:02:51.070147 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.070107 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 13:02:51.070246 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.070167 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 13:02:51.070246 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.070201 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-xjfzc\"" May 21 13:02:51.091283 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.091259 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r7bq5"] May 21 13:02:51.091411 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.091388 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9cl59" May 21 13:02:51.094008 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.093989 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4szfj\"" May 21 13:02:51.094008 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.094006 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 13:02:51.094157 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.093989 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 13:02:51.114587 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.114556 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d99bf56db-gscx7"] May 21 13:02:51.114730 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.114703 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r7bq5" May 21 13:02:51.117724 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.117705 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 13:02:51.118036 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.118021 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 13:02:51.118242 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.118223 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 13:02:51.118388 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.118282 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7b4pc\"" May 21 13:02:51.124058 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.124036 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a1c588d2-c125-462d-8b87-0e2d37de91ae-serving-cert\") pod \"service-ca-operator-57b5b68b8-hj996\" (UID: \"a1c588d2-c125-462d-8b87-0e2d37de91ae\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hj996" May 21 13:02:51.124154 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.124072 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5r7w\" (UniqueName: \"kubernetes.io/projected/de80e51e-6c75-4dab-a690-14b4eb31eb99-kube-api-access-f5r7w\") pod \"kube-storage-version-migrator-operator-565644f49-8rd5h\" (UID: \"de80e51e-6c75-4dab-a690-14b4eb31eb99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8rd5h" May 21 13:02:51.124154 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.124105 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-image-registry-private-configuration\") pod \"image-registry-96d5fcb49-fjhxc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:02:51.124154 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.124137 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-trusted-ca\") pod \"image-registry-96d5fcb49-fjhxc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:02:51.124329 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.124164 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpn4k\" (UniqueName: \"kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-kube-api-access-hpn4k\") pod \"image-registry-96d5fcb49-fjhxc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:02:51.124329 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.124181 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1c588d2-c125-462d-8b87-0e2d37de91ae-config\") pod \"service-ca-operator-57b5b68b8-hj996\" (UID: \"a1c588d2-c125-462d-8b87-0e2d37de91ae\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hj996" May 21 13:02:51.124329 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.124204 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tp8c\" (UniqueName: \"kubernetes.io/projected/a1c588d2-c125-462d-8b87-0e2d37de91ae-kube-api-access-4tp8c\") pod \"service-ca-operator-57b5b68b8-hj996\" (UID: \"a1c588d2-c125-462d-8b87-0e2d37de91ae\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hj996" May 21 13:02:51.124329 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.124255 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-registry-tls\") pod \"image-registry-96d5fcb49-fjhxc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:02:51.124522 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.124360 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de80e51e-6c75-4dab-a690-14b4eb31eb99-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-8rd5h\" (UID: \"de80e51e-6c75-4dab-a690-14b4eb31eb99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8rd5h" May 21 13:02:51.124522 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.124387 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/de80e51e-6c75-4dab-a690-14b4eb31eb99-config\") pod \"kube-storage-version-migrator-operator-565644f49-8rd5h\" (UID: \"de80e51e-6c75-4dab-a690-14b4eb31eb99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8rd5h" May 21 13:02:51.124522 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.124405 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-installation-pull-secrets\") pod \"image-registry-96d5fcb49-fjhxc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:02:51.124522 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.124423 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-bound-sa-token\") pod \"image-registry-96d5fcb49-fjhxc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:02:51.124522 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.124460 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-ca-trust-extracted\") pod \"image-registry-96d5fcb49-fjhxc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:02:51.124522 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.124482 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-registry-certificates\") pod \"image-registry-96d5fcb49-fjhxc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:02:51.139096 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.139076 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cbf4d488-wvlw5"] May 21 13:02:51.139232 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.139214 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d99bf56db-gscx7" May 21 13:02:51.142044 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.142024 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 21 13:02:51.142146 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.142057 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-lmvsf\"" May 21 13:02:51.142146 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.142064 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 21 13:02:51.142146 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.142095 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 21 13:02:51.142440 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.142413 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" May 21 13:02:51.164026 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.164004 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt"] May 21 13:02:51.164176 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.164160 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cbf4d488-wvlw5" May 21 13:02:51.166986 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.166968 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 21 13:02:51.188157 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.188137 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-qps6z"] May 21 13:02:51.188309 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.188292 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" May 21 13:02:51.190979 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.190941 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" May 21 13:02:51.190979 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.190956 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" May 21 13:02:51.191143 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.191004 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" May 21 13:02:51.191257 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.191243 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" May 21 13:02:51.211308 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.211286 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-hj996"] May 21 13:02:51.211417 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.211314 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-d8lss"] May 21 13:02:51.211417 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.211327 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9cl59"] May 21 13:02:51.211417 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.211341 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r7bq5"] May 21 13:02:51.211417 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.211352 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-qps6z"] May 21 13:02:51.211417 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.211362 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cbf4d488-wvlw5"] May 21 13:02:51.211417 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.211372 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt"] May 21 13:02:51.211417 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.211382 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d99bf56db-gscx7"] May 21 13:02:51.211800 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.211437 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-qps6z" May 21 13:02:51.214056 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.214035 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" May 21 13:02:51.214056 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.214052 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" May 21 13:02:51.214201 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.214170 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bst5m\"" May 21 13:02:51.225719 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.225701 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de80e51e-6c75-4dab-a690-14b4eb31eb99-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-8rd5h\" (UID: \"de80e51e-6c75-4dab-a690-14b4eb31eb99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8rd5h" May 21 13:02:51.225822 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.225732 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/de80e51e-6c75-4dab-a690-14b4eb31eb99-config\") pod \"kube-storage-version-migrator-operator-565644f49-8rd5h\" (UID: \"de80e51e-6c75-4dab-a690-14b4eb31eb99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8rd5h" May 21 13:02:51.225822 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.225762 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2djf4\" (UniqueName: \"kubernetes.io/projected/268e0d5b-525c-4c90-a50e-a475cec07731-kube-api-access-2djf4\") pod \"network-check-source-7f44b6dd87-d8lss\" (UID: \"268e0d5b-525c-4c90-a50e-a475cec07731\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-d8lss" May 21 13:02:51.225822 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.225793 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-installation-pull-secrets\") pod \"image-registry-96d5fcb49-fjhxc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:02:51.225978 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.225817 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-bound-sa-token\") pod \"image-registry-96d5fcb49-fjhxc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:02:51.225978 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.225858 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcsq5\" (UniqueName: \"kubernetes.io/projected/7314ef2e-ec8f-4126-b669-0866b6d355c0-kube-api-access-tcsq5\") pod \"managed-serviceaccount-addon-agent-5d99bf56db-gscx7\" (UID: \"7314ef2e-ec8f-4126-b669-0866b6d355c0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d99bf56db-gscx7" May 21 13:02:51.225978 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.225886 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/26c9dda0-e679-4ac2-bab6-7df9f5f26703-config-volume\") pod \"dns-default-9cl59\" (UID: \"26c9dda0-e679-4ac2-bab6-7df9f5f26703\") " pod="openshift-dns/dns-default-9cl59" May 21 13:02:51.225978 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.225914 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrhml\" (UniqueName: \"kubernetes.io/projected/26c9dda0-e679-4ac2-bab6-7df9f5f26703-kube-api-access-lrhml\") pod \"dns-default-9cl59\" (UID: \"26c9dda0-e679-4ac2-bab6-7df9f5f26703\") " pod="openshift-dns/dns-default-9cl59" May 21 13:02:51.225978 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.225951 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-ca-trust-extracted\") pod \"image-registry-96d5fcb49-fjhxc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:02:51.226216 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.225976 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-registry-certificates\") pod \"image-registry-96d5fcb49-fjhxc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:02:51.226216 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.226004 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nppdv\" (UniqueName: \"kubernetes.io/projected/5efbaa38-37d0-454b-9599-c194f169cd39-kube-api-access-nppdv\") pod \"ingress-canary-r7bq5\" (UID: \"5efbaa38-37d0-454b-9599-c194f169cd39\") " pod="openshift-ingress-canary/ingress-canary-r7bq5" May 21 13:02:51.226216 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.226046 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a1c588d2-c125-462d-8b87-0e2d37de91ae-serving-cert\") pod \"service-ca-operator-57b5b68b8-hj996\" (UID: \"a1c588d2-c125-462d-8b87-0e2d37de91ae\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hj996" May 21 13:02:51.226216 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.226080 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f5r7w\" (UniqueName: \"kubernetes.io/projected/de80e51e-6c75-4dab-a690-14b4eb31eb99-kube-api-access-f5r7w\") pod \"kube-storage-version-migrator-operator-565644f49-8rd5h\" (UID: \"de80e51e-6c75-4dab-a690-14b4eb31eb99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8rd5h" May 21 13:02:51.226639 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.226474 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-image-registry-private-configuration\") pod \"image-registry-96d5fcb49-fjhxc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:02:51.226639 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.226521 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-trusted-ca\") pod \"image-registry-96d5fcb49-fjhxc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:02:51.226639 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.226554 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26c9dda0-e679-4ac2-bab6-7df9f5f26703-metrics-tls\") pod \"dns-default-9cl59\" (UID: \"26c9dda0-e679-4ac2-bab6-7df9f5f26703\") " pod="openshift-dns/dns-default-9cl59" May 21 13:02:51.226639 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.226600 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hpn4k\" (UniqueName: \"kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-kube-api-access-hpn4k\") pod \"image-registry-96d5fcb49-fjhxc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:02:51.226639 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.226630 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7314ef2e-ec8f-4126-b669-0866b6d355c0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5d99bf56db-gscx7\" (UID: \"7314ef2e-ec8f-4126-b669-0866b6d355c0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d99bf56db-gscx7" May 21 13:02:51.226915 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.226660 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1c588d2-c125-462d-8b87-0e2d37de91ae-config\") pod \"service-ca-operator-57b5b68b8-hj996\" (UID: \"a1c588d2-c125-462d-8b87-0e2d37de91ae\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hj996" May 21 13:02:51.226915 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.226684 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4tp8c\" (UniqueName: \"kubernetes.io/projected/a1c588d2-c125-462d-8b87-0e2d37de91ae-kube-api-access-4tp8c\") pod \"service-ca-operator-57b5b68b8-hj996\" (UID: \"a1c588d2-c125-462d-8b87-0e2d37de91ae\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hj996" May 21 13:02:51.226915 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.226713 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26c9dda0-e679-4ac2-bab6-7df9f5f26703-tmp-dir\") pod \"dns-default-9cl59\" (UID: \"26c9dda0-e679-4ac2-bab6-7df9f5f26703\") " pod="openshift-dns/dns-default-9cl59" May 21 13:02:51.226915 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.226756 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-registry-tls\") pod \"image-registry-96d5fcb49-fjhxc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:02:51.226915 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.226781 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5efbaa38-37d0-454b-9599-c194f169cd39-cert\") pod \"ingress-canary-r7bq5\" (UID: \"5efbaa38-37d0-454b-9599-c194f169cd39\") " pod="openshift-ingress-canary/ingress-canary-r7bq5" May 21 13:02:51.226915 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.226862 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-ca-trust-extracted\") pod \"image-registry-96d5fcb49-fjhxc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:02:51.227685 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.227322 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a1c588d2-c125-462d-8b87-0e2d37de91ae-config\") pod \"service-ca-operator-57b5b68b8-hj996\" (UID: \"a1c588d2-c125-462d-8b87-0e2d37de91ae\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hj996" May 21 13:02:51.227685 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:51.227406 2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 13:02:51.227685 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:51.227418 2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96d5fcb49-fjhxc: secret "image-registry-tls" not found May 21 13:02:51.227685 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:51.227468 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-registry-tls podName:bfbc7ef9-d45f-495f-95ef-dba579b5dffc nodeName:}" failed. No retries permitted until 2026-05-21 13:02:51.727453388 +0000 UTC m=+34.582164855 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-registry-tls") pod "image-registry-96d5fcb49-fjhxc" (UID: "bfbc7ef9-d45f-495f-95ef-dba579b5dffc") : secret "image-registry-tls" not found May 21 13:02:51.227902 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.227700 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/de80e51e-6c75-4dab-a690-14b4eb31eb99-config\") pod \"kube-storage-version-migrator-operator-565644f49-8rd5h\" (UID: \"de80e51e-6c75-4dab-a690-14b4eb31eb99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8rd5h" May 21 13:02:51.227960 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.227948 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-trusted-ca\") pod \"image-registry-96d5fcb49-fjhxc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:02:51.228010 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.227999 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-registry-certificates\") pod \"image-registry-96d5fcb49-fjhxc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:02:51.230620 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.230600 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a1c588d2-c125-462d-8b87-0e2d37de91ae-serving-cert\") pod \"service-ca-operator-57b5b68b8-hj996\" (UID: \"a1c588d2-c125-462d-8b87-0e2d37de91ae\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hj996" May 21 13:02:51.230702 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.230622 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de80e51e-6c75-4dab-a690-14b4eb31eb99-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-8rd5h\" (UID: \"de80e51e-6c75-4dab-a690-14b4eb31eb99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8rd5h" May 21 13:02:51.230930 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.230910 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-installation-pull-secrets\") pod \"image-registry-96d5fcb49-fjhxc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:02:51.235592 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.235557 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-bound-sa-token\") pod \"image-registry-96d5fcb49-fjhxc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:02:51.239207 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.239158 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-image-registry-private-configuration\") pod \"image-registry-96d5fcb49-fjhxc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:02:51.240246 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.240223 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tp8c\" (UniqueName: \"kubernetes.io/projected/a1c588d2-c125-462d-8b87-0e2d37de91ae-kube-api-access-4tp8c\") pod \"service-ca-operator-57b5b68b8-hj996\" (UID: \"a1c588d2-c125-462d-8b87-0e2d37de91ae\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hj996" May 21 13:02:51.240667 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.240645 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5r7w\" (UniqueName: \"kubernetes.io/projected/de80e51e-6c75-4dab-a690-14b4eb31eb99-kube-api-access-f5r7w\") pod \"kube-storage-version-migrator-operator-565644f49-8rd5h\" (UID: \"de80e51e-6c75-4dab-a690-14b4eb31eb99\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8rd5h" May 21 13:02:51.241188 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.241165 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpn4k\" (UniqueName: \"kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-kube-api-access-hpn4k\") pod \"image-registry-96d5fcb49-fjhxc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:02:51.328179 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.328141 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2effc3cd-50d2-4f44-b393-42875748b504-hub\") pod \"cluster-proxy-proxy-agent-d4c884775-k4slt\" (UID: \"2effc3cd-50d2-4f44-b393-42875748b504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" May 21 13:02:51.328179 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.328178 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f8t2\" (UniqueName: \"kubernetes.io/projected/2effc3cd-50d2-4f44-b393-42875748b504-kube-api-access-8f8t2\") pod \"cluster-proxy-proxy-agent-d4c884775-k4slt\" (UID: \"2effc3cd-50d2-4f44-b393-42875748b504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" May 21 13:02:51.328398 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.328224 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1602ae60-f2e5-40c7-ac65-56a27fde007a-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-qps6z\" (UID: \"1602ae60-f2e5-40c7-ac65-56a27fde007a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-qps6z" May 21 13:02:51.328398 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.328243 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/2effc3cd-50d2-4f44-b393-42875748b504-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-d4c884775-k4slt\" (UID: \"2effc3cd-50d2-4f44-b393-42875748b504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" May 21 13:02:51.328398 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.328279 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5efbaa38-37d0-454b-9599-c194f169cd39-cert\") pod \"ingress-canary-r7bq5\" (UID: \"5efbaa38-37d0-454b-9599-c194f169cd39\") " pod="openshift-ingress-canary/ingress-canary-r7bq5" May 21 13:02:51.328398 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.328357 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26c9dda0-e679-4ac2-bab6-7df9f5f26703-tmp-dir\") pod \"dns-default-9cl59\" (UID: \"26c9dda0-e679-4ac2-bab6-7df9f5f26703\") " pod="openshift-dns/dns-default-9cl59" May 21 13:02:51.328398 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:51.328372 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 13:02:51.328655 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.328415 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1602ae60-f2e5-40c7-ac65-56a27fde007a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-qps6z\" (UID: \"1602ae60-f2e5-40c7-ac65-56a27fde007a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-qps6z" May 21 13:02:51.328655 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:51.328466 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5efbaa38-37d0-454b-9599-c194f169cd39-cert podName:5efbaa38-37d0-454b-9599-c194f169cd39 nodeName:}" failed. No retries permitted until 2026-05-21 13:02:51.828447512 +0000 UTC m=+34.683158991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5efbaa38-37d0-454b-9599-c194f169cd39-cert") pod "ingress-canary-r7bq5" (UID: "5efbaa38-37d0-454b-9599-c194f169cd39") : secret "canary-serving-cert" not found May 21 13:02:51.328655 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.328485 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2djf4\" (UniqueName: \"kubernetes.io/projected/268e0d5b-525c-4c90-a50e-a475cec07731-kube-api-access-2djf4\") pod \"network-check-source-7f44b6dd87-d8lss\" (UID: \"268e0d5b-525c-4c90-a50e-a475cec07731\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-d8lss" May 21 13:02:51.328655 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.328515 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2effc3cd-50d2-4f44-b393-42875748b504-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d4c884775-k4slt\" (UID: \"2effc3cd-50d2-4f44-b393-42875748b504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" May 21 13:02:51.328655 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.328543 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp9pv\" (UniqueName: \"kubernetes.io/projected/64fe292d-b83a-4ac9-9bf3-2fa03e8e58c4-kube-api-access-pp9pv\") pod \"klusterlet-addon-workmgr-77cbf4d488-wvlw5\" (UID: \"64fe292d-b83a-4ac9-9bf3-2fa03e8e58c4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cbf4d488-wvlw5" May 21 13:02:51.328896 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.328686 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/26c9dda0-e679-4ac2-bab6-7df9f5f26703-config-volume\") pod \"dns-default-9cl59\" (UID: \"26c9dda0-e679-4ac2-bab6-7df9f5f26703\") " pod="openshift-dns/dns-default-9cl59" May 21 13:02:51.328896 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.328708 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26c9dda0-e679-4ac2-bab6-7df9f5f26703-tmp-dir\") pod \"dns-default-9cl59\" (UID: \"26c9dda0-e679-4ac2-bab6-7df9f5f26703\") " pod="openshift-dns/dns-default-9cl59" May 21 13:02:51.328896 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.328716 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64fe292d-b83a-4ac9-9bf3-2fa03e8e58c4-tmp\") pod \"klusterlet-addon-workmgr-77cbf4d488-wvlw5\" (UID: \"64fe292d-b83a-4ac9-9bf3-2fa03e8e58c4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cbf4d488-wvlw5" May 21 13:02:51.328896 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.328747 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tcsq5\" (UniqueName: \"kubernetes.io/projected/7314ef2e-ec8f-4126-b669-0866b6d355c0-kube-api-access-tcsq5\") pod \"managed-serviceaccount-addon-agent-5d99bf56db-gscx7\" (UID: \"7314ef2e-ec8f-4126-b669-0866b6d355c0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d99bf56db-gscx7" May 21 13:02:51.328896 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.328789 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lrhml\" (UniqueName: \"kubernetes.io/projected/26c9dda0-e679-4ac2-bab6-7df9f5f26703-kube-api-access-lrhml\") pod \"dns-default-9cl59\" (UID: \"26c9dda0-e679-4ac2-bab6-7df9f5f26703\") " pod="openshift-dns/dns-default-9cl59" May 21 13:02:51.328896 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.328814 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2effc3cd-50d2-4f44-b393-42875748b504-ca\") pod \"cluster-proxy-proxy-agent-d4c884775-k4slt\" (UID: \"2effc3cd-50d2-4f44-b393-42875748b504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" May 21 13:02:51.328896 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.328837 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/64fe292d-b83a-4ac9-9bf3-2fa03e8e58c4-klusterlet-config\") pod \"klusterlet-addon-workmgr-77cbf4d488-wvlw5\" (UID: \"64fe292d-b83a-4ac9-9bf3-2fa03e8e58c4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cbf4d488-wvlw5" May 21 13:02:51.328896 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.328862 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nppdv\" (UniqueName: \"kubernetes.io/projected/5efbaa38-37d0-454b-9599-c194f169cd39-kube-api-access-nppdv\") pod \"ingress-canary-r7bq5\" (UID: \"5efbaa38-37d0-454b-9599-c194f169cd39\") " pod="openshift-ingress-canary/ingress-canary-r7bq5" May 21 13:02:51.328896 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.328893 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2effc3cd-50d2-4f44-b393-42875748b504-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d4c884775-k4slt\" (UID: \"2effc3cd-50d2-4f44-b393-42875748b504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" May 21 13:02:51.329318 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.328920 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26c9dda0-e679-4ac2-bab6-7df9f5f26703-metrics-tls\") pod \"dns-default-9cl59\" (UID: \"26c9dda0-e679-4ac2-bab6-7df9f5f26703\") " pod="openshift-dns/dns-default-9cl59" May 21 13:02:51.329373 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:51.329353 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 13:02:51.329428 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.329411 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7314ef2e-ec8f-4126-b669-0866b6d355c0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5d99bf56db-gscx7\" (UID: \"7314ef2e-ec8f-4126-b669-0866b6d355c0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d99bf56db-gscx7" May 21 13:02:51.329464 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:51.329434 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26c9dda0-e679-4ac2-bab6-7df9f5f26703-metrics-tls podName:26c9dda0-e679-4ac2-bab6-7df9f5f26703 nodeName:}" failed. No retries permitted until 2026-05-21 13:02:51.829414367 +0000 UTC m=+34.684125839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26c9dda0-e679-4ac2-bab6-7df9f5f26703-metrics-tls") pod "dns-default-9cl59" (UID: "26c9dda0-e679-4ac2-bab6-7df9f5f26703") : secret "dns-default-metrics-tls" not found May 21 13:02:51.329683 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.329178 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/26c9dda0-e679-4ac2-bab6-7df9f5f26703-config-volume\") pod \"dns-default-9cl59\" (UID: \"26c9dda0-e679-4ac2-bab6-7df9f5f26703\") " pod="openshift-dns/dns-default-9cl59" May 21 13:02:51.332226 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.332207 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7314ef2e-ec8f-4126-b669-0866b6d355c0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5d99bf56db-gscx7\" (UID: \"7314ef2e-ec8f-4126-b669-0866b6d355c0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d99bf56db-gscx7" May 21 13:02:51.339284 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.339237 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2djf4\" (UniqueName: \"kubernetes.io/projected/268e0d5b-525c-4c90-a50e-a475cec07731-kube-api-access-2djf4\") pod \"network-check-source-7f44b6dd87-d8lss\" (UID: \"268e0d5b-525c-4c90-a50e-a475cec07731\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-d8lss" May 21 13:02:51.339385 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.339339 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nppdv\" (UniqueName: \"kubernetes.io/projected/5efbaa38-37d0-454b-9599-c194f169cd39-kube-api-access-nppdv\") pod \"ingress-canary-r7bq5\" (UID: \"5efbaa38-37d0-454b-9599-c194f169cd39\") " pod="openshift-ingress-canary/ingress-canary-r7bq5" May 21 13:02:51.341253 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.341235 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcsq5\" (UniqueName: \"kubernetes.io/projected/7314ef2e-ec8f-4126-b669-0866b6d355c0-kube-api-access-tcsq5\") pod \"managed-serviceaccount-addon-agent-5d99bf56db-gscx7\" (UID: \"7314ef2e-ec8f-4126-b669-0866b6d355c0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d99bf56db-gscx7" May 21 13:02:51.341542 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.341523 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrhml\" (UniqueName: \"kubernetes.io/projected/26c9dda0-e679-4ac2-bab6-7df9f5f26703-kube-api-access-lrhml\") pod \"dns-default-9cl59\" (UID: \"26c9dda0-e679-4ac2-bab6-7df9f5f26703\") " pod="openshift-dns/dns-default-9cl59" May 21 13:02:51.356472 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.356454 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8rd5h" May 21 13:02:51.363174 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.363159 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hj996" May 21 13:02:51.376736 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.376711 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-d8lss" May 21 13:02:51.430211 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.430170 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2effc3cd-50d2-4f44-b393-42875748b504-ca\") pod \"cluster-proxy-proxy-agent-d4c884775-k4slt\" (UID: \"2effc3cd-50d2-4f44-b393-42875748b504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" May 21 13:02:51.430390 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.430220 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/64fe292d-b83a-4ac9-9bf3-2fa03e8e58c4-klusterlet-config\") pod \"klusterlet-addon-workmgr-77cbf4d488-wvlw5\" (UID: \"64fe292d-b83a-4ac9-9bf3-2fa03e8e58c4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cbf4d488-wvlw5" May 21 13:02:51.430390 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.430257 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2effc3cd-50d2-4f44-b393-42875748b504-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d4c884775-k4slt\" (UID: \"2effc3cd-50d2-4f44-b393-42875748b504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" May 21 13:02:51.430390 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.430319 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2effc3cd-50d2-4f44-b393-42875748b504-hub\") pod \"cluster-proxy-proxy-agent-d4c884775-k4slt\" (UID: \"2effc3cd-50d2-4f44-b393-42875748b504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" May 21 13:02:51.430390 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.430346 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8f8t2\" (UniqueName: \"kubernetes.io/projected/2effc3cd-50d2-4f44-b393-42875748b504-kube-api-access-8f8t2\") pod \"cluster-proxy-proxy-agent-d4c884775-k4slt\" (UID: \"2effc3cd-50d2-4f44-b393-42875748b504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" May 21 13:02:51.430623 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.430402 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1602ae60-f2e5-40c7-ac65-56a27fde007a-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-qps6z\" (UID: \"1602ae60-f2e5-40c7-ac65-56a27fde007a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-qps6z" May 21 13:02:51.430623 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.430425 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/2effc3cd-50d2-4f44-b393-42875748b504-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-d4c884775-k4slt\" (UID: \"2effc3cd-50d2-4f44-b393-42875748b504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" May 21 13:02:51.430623 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.430501 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1457bd6e-e261-401d-a957-cf50ed787bf8-metrics-certs\") pod \"network-metrics-daemon-5xxmv\" (UID: \"1457bd6e-e261-401d-a957-cf50ed787bf8\") " pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:02:51.430623 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.430529 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1602ae60-f2e5-40c7-ac65-56a27fde007a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-qps6z\" (UID: \"1602ae60-f2e5-40c7-ac65-56a27fde007a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-qps6z" May 21 13:02:51.430623 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.430563 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2effc3cd-50d2-4f44-b393-42875748b504-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d4c884775-k4slt\" (UID: \"2effc3cd-50d2-4f44-b393-42875748b504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" May 21 13:02:51.430623 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.430609 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pp9pv\" (UniqueName: \"kubernetes.io/projected/64fe292d-b83a-4ac9-9bf3-2fa03e8e58c4-kube-api-access-pp9pv\") pod \"klusterlet-addon-workmgr-77cbf4d488-wvlw5\" (UID: \"64fe292d-b83a-4ac9-9bf3-2fa03e8e58c4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cbf4d488-wvlw5" May 21 13:02:51.430891 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.430636 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64fe292d-b83a-4ac9-9bf3-2fa03e8e58c4-tmp\") pod \"klusterlet-addon-workmgr-77cbf4d488-wvlw5\" (UID: \"64fe292d-b83a-4ac9-9bf3-2fa03e8e58c4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cbf4d488-wvlw5" May 21 13:02:51.431718 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:51.431694 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 13:02:51.431890 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:51.431877 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1602ae60-f2e5-40c7-ac65-56a27fde007a-networking-console-plugin-cert podName:1602ae60-f2e5-40c7-ac65-56a27fde007a nodeName:}" failed. No retries permitted until 2026-05-21 13:02:51.931854539 +0000 UTC m=+34.786566020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1602ae60-f2e5-40c7-ac65-56a27fde007a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-qps6z" (UID: "1602ae60-f2e5-40c7-ac65-56a27fde007a") : secret "networking-console-plugin-cert" not found May 21 13:02:51.433595 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.433455 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64fe292d-b83a-4ac9-9bf3-2fa03e8e58c4-tmp\") pod \"klusterlet-addon-workmgr-77cbf4d488-wvlw5\" (UID: \"64fe292d-b83a-4ac9-9bf3-2fa03e8e58c4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cbf4d488-wvlw5" May 21 13:02:51.434521 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.433950 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2effc3cd-50d2-4f44-b393-42875748b504-ca\") pod \"cluster-proxy-proxy-agent-d4c884775-k4slt\" (UID: \"2effc3cd-50d2-4f44-b393-42875748b504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" May 21 13:02:51.434521 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.434367 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/64fe292d-b83a-4ac9-9bf3-2fa03e8e58c4-klusterlet-config\") pod \"klusterlet-addon-workmgr-77cbf4d488-wvlw5\" (UID: \"64fe292d-b83a-4ac9-9bf3-2fa03e8e58c4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cbf4d488-wvlw5" May 21 13:02:51.434521 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.434481 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1602ae60-f2e5-40c7-ac65-56a27fde007a-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-qps6z\" (UID: \"1602ae60-f2e5-40c7-ac65-56a27fde007a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-qps6z" May 21 13:02:51.434719 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:51.434630 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 13:02:51.434719 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:51.434687 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1457bd6e-e261-401d-a957-cf50ed787bf8-metrics-certs podName:1457bd6e-e261-401d-a957-cf50ed787bf8 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:23.434670643 +0000 UTC m=+66.289382123 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1457bd6e-e261-401d-a957-cf50ed787bf8-metrics-certs") pod "network-metrics-daemon-5xxmv" (UID: "1457bd6e-e261-401d-a957-cf50ed787bf8") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 13:02:51.437406 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.434998 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/2effc3cd-50d2-4f44-b393-42875748b504-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-d4c884775-k4slt\" (UID: \"2effc3cd-50d2-4f44-b393-42875748b504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" May 21 13:02:51.438763 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.438727 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2effc3cd-50d2-4f44-b393-42875748b504-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-d4c884775-k4slt\" (UID: \"2effc3cd-50d2-4f44-b393-42875748b504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" May 21 13:02:51.438862 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.438801 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2effc3cd-50d2-4f44-b393-42875748b504-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-d4c884775-k4slt\" (UID: \"2effc3cd-50d2-4f44-b393-42875748b504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" May 21 13:02:51.439943 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.439921 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2effc3cd-50d2-4f44-b393-42875748b504-hub\") pod \"cluster-proxy-proxy-agent-d4c884775-k4slt\" (UID: \"2effc3cd-50d2-4f44-b393-42875748b504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" May 21 13:02:51.440638 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.440616 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp9pv\" (UniqueName: \"kubernetes.io/projected/64fe292d-b83a-4ac9-9bf3-2fa03e8e58c4-kube-api-access-pp9pv\") pod \"klusterlet-addon-workmgr-77cbf4d488-wvlw5\" (UID: \"64fe292d-b83a-4ac9-9bf3-2fa03e8e58c4\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cbf4d488-wvlw5" May 21 13:02:51.450680 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.450630 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f8t2\" (UniqueName: \"kubernetes.io/projected/2effc3cd-50d2-4f44-b393-42875748b504-kube-api-access-8f8t2\") pod \"cluster-proxy-proxy-agent-d4c884775-k4slt\" (UID: \"2effc3cd-50d2-4f44-b393-42875748b504\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" May 21 13:02:51.460148 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.459484 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d99bf56db-gscx7" May 21 13:02:51.474814 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.474474 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cbf4d488-wvlw5" May 21 13:02:51.499493 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.498091 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" May 21 13:02:51.532620 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.532471 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6jh7w\" (UniqueName: \"kubernetes.io/projected/ea47420b-798b-4626-8614-a2fb41be4ba0-kube-api-access-6jh7w\") pod \"network-check-target-jpd9b\" (UID: \"ea47420b-798b-4626-8614-a2fb41be4ba0\") " pod="openshift-network-diagnostics/network-check-target-jpd9b" May 21 13:02:51.540774 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.540410 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jh7w\" (UniqueName: \"kubernetes.io/projected/ea47420b-798b-4626-8614-a2fb41be4ba0-kube-api-access-6jh7w\") pod \"network-check-target-jpd9b\" (UID: \"ea47420b-798b-4626-8614-a2fb41be4ba0\") " pod="openshift-network-diagnostics/network-check-target-jpd9b" May 21 13:02:51.586383 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.586304 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-d8lss"] May 21 13:02:51.599247 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:51.596908 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod268e0d5b_525c_4c90_a50e_a475cec07731.slice/crio-a40c53403562c018ace2bd1b625a78faacf6c5f283e2f19a20474bf928fac1d5 WatchSource:0}: Error finding container a40c53403562c018ace2bd1b625a78faacf6c5f283e2f19a20474bf928fac1d5: Status 404 returned error can't find the container with id a40c53403562c018ace2bd1b625a78faacf6c5f283e2f19a20474bf928fac1d5 May 21 13:02:51.599247 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.597870 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8rd5h"] May 21 13:02:51.618989 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.618743 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-hj996"] May 21 13:02:51.620255 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:51.620214 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde80e51e_6c75_4dab_a690_14b4eb31eb99.slice/crio-28a3e7079337208d7492f55e239bc6608e8e7ed624b5387eb68d62f24b8ccec0 WatchSource:0}: Error finding container 28a3e7079337208d7492f55e239bc6608e8e7ed624b5387eb68d62f24b8ccec0: Status 404 returned error can't find the container with id 28a3e7079337208d7492f55e239bc6608e8e7ed624b5387eb68d62f24b8ccec0 May 21 13:02:51.688118 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.687272 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d99bf56db-gscx7"] May 21 13:02:51.688118 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.687478 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:02:51.688118 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.687507 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jpd9b" May 21 13:02:51.690285 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.690261 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 13:02:51.690485 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.690295 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dfgjb\"" May 21 13:02:51.690653 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.690608 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b4mfv\"" May 21 13:02:51.693324 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:51.693297 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7314ef2e_ec8f_4126_b669_0866b6d355c0.slice/crio-34f7144f6235112abbbbd868b3d6ffb9bea969b2e2362bd7c44ec745d84610b8 WatchSource:0}: Error finding container 34f7144f6235112abbbbd868b3d6ffb9bea969b2e2362bd7c44ec745d84610b8: Status 404 returned error can't find the container with id 34f7144f6235112abbbbd868b3d6ffb9bea969b2e2362bd7c44ec745d84610b8 May 21 13:02:51.701278 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.701172 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cbf4d488-wvlw5"] May 21 13:02:51.704145 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:51.704121 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64fe292d_b83a_4ac9_9bf3_2fa03e8e58c4.slice/crio-7ed7a968f205ce8bc3fb1f86de134a3fcc91d212d4b136e422f6e77b08ac6cf8 WatchSource:0}: Error finding container 7ed7a968f205ce8bc3fb1f86de134a3fcc91d212d4b136e422f6e77b08ac6cf8: Status 404 returned error can't find the container with id 7ed7a968f205ce8bc3fb1f86de134a3fcc91d212d4b136e422f6e77b08ac6cf8 May 21 13:02:51.708982 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.708966 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jpd9b" May 21 13:02:51.717533 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.717508 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt"] May 21 13:02:51.720613 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:51.720585 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2effc3cd_50d2_4f44_b393_42875748b504.slice/crio-8dd8105b989ebb65b55fca70b9bb6df6ed6f96fd14138fc0804cac7ca7e4299d WatchSource:0}: Error finding container 8dd8105b989ebb65b55fca70b9bb6df6ed6f96fd14138fc0804cac7ca7e4299d: Status 404 returned error can't find the container with id 8dd8105b989ebb65b55fca70b9bb6df6ed6f96fd14138fc0804cac7ca7e4299d May 21 13:02:51.736960 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.736935 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-registry-tls\") pod \"image-registry-96d5fcb49-fjhxc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:02:51.737124 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:51.737102 2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 13:02:51.737168 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:51.737128 2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96d5fcb49-fjhxc: secret "image-registry-tls" not found May 21 13:02:51.737210 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:51.737196 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-registry-tls podName:bfbc7ef9-d45f-495f-95ef-dba579b5dffc nodeName:}" failed. No retries permitted until 2026-05-21 13:02:52.737175508 +0000 UTC m=+35.591886989 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-registry-tls") pod "image-registry-96d5fcb49-fjhxc" (UID: "bfbc7ef9-d45f-495f-95ef-dba579b5dffc") : secret "image-registry-tls" not found May 21 13:02:51.808704 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.808670 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cbf4d488-wvlw5" event={"ID":"64fe292d-b83a-4ac9-9bf3-2fa03e8e58c4","Type":"ContainerStarted","Data":"7ed7a968f205ce8bc3fb1f86de134a3fcc91d212d4b136e422f6e77b08ac6cf8"} May 21 13:02:51.809896 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.809866 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-d8lss" event={"ID":"268e0d5b-525c-4c90-a50e-a475cec07731","Type":"ContainerStarted","Data":"a40c53403562c018ace2bd1b625a78faacf6c5f283e2f19a20474bf928fac1d5"} May 21 13:02:51.810991 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.810968 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d99bf56db-gscx7" event={"ID":"7314ef2e-ec8f-4126-b669-0866b6d355c0","Type":"ContainerStarted","Data":"34f7144f6235112abbbbd868b3d6ffb9bea969b2e2362bd7c44ec745d84610b8"} May 21 13:02:51.812082 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.812050 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8rd5h" event={"ID":"de80e51e-6c75-4dab-a690-14b4eb31eb99","Type":"ContainerStarted","Data":"28a3e7079337208d7492f55e239bc6608e8e7ed624b5387eb68d62f24b8ccec0"} May 21 13:02:51.813203 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.813173 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hj996" event={"ID":"a1c588d2-c125-462d-8b87-0e2d37de91ae","Type":"ContainerStarted","Data":"a2ee22683010bc4fe2139ce6dbf69df19d188dedb70e3a9eb989d66678b7c8f2"} May 21 13:02:51.814268 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.814245 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" event={"ID":"2effc3cd-50d2-4f44-b393-42875748b504","Type":"ContainerStarted","Data":"8dd8105b989ebb65b55fca70b9bb6df6ed6f96fd14138fc0804cac7ca7e4299d"} May 21 13:02:51.837742 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.837712 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5efbaa38-37d0-454b-9599-c194f169cd39-cert\") pod \"ingress-canary-r7bq5\" (UID: \"5efbaa38-37d0-454b-9599-c194f169cd39\") " pod="openshift-ingress-canary/ingress-canary-r7bq5" May 21 13:02:51.837878 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.837836 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26c9dda0-e679-4ac2-bab6-7df9f5f26703-metrics-tls\") pod \"dns-default-9cl59\" (UID: \"26c9dda0-e679-4ac2-bab6-7df9f5f26703\") " pod="openshift-dns/dns-default-9cl59" May 21 13:02:51.837947 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:51.837876 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 13:02:51.837947 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:51.837919 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 13:02:51.837947 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:51.837937 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5efbaa38-37d0-454b-9599-c194f169cd39-cert podName:5efbaa38-37d0-454b-9599-c194f169cd39 nodeName:}" failed. No retries permitted until 2026-05-21 13:02:52.837922139 +0000 UTC m=+35.692633611 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5efbaa38-37d0-454b-9599-c194f169cd39-cert") pod "ingress-canary-r7bq5" (UID: "5efbaa38-37d0-454b-9599-c194f169cd39") : secret "canary-serving-cert" not found May 21 13:02:51.838119 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:51.837957 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26c9dda0-e679-4ac2-bab6-7df9f5f26703-metrics-tls podName:26c9dda0-e679-4ac2-bab6-7df9f5f26703 nodeName:}" failed. No retries permitted until 2026-05-21 13:02:52.837946532 +0000 UTC m=+35.692657999 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26c9dda0-e679-4ac2-bab6-7df9f5f26703-metrics-tls") pod "dns-default-9cl59" (UID: "26c9dda0-e679-4ac2-bab6-7df9f5f26703") : secret "dns-default-metrics-tls" not found May 21 13:02:51.842961 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.842938 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jpd9b"] May 21 13:02:51.858825 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:02:51.858797 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea47420b_798b_4626_8614_a2fb41be4ba0.slice/crio-b6cc88665755b30643eefbb581452f9f0fdf6d4ef56465ff7a922b56e612f14f WatchSource:0}: Error finding container b6cc88665755b30643eefbb581452f9f0fdf6d4ef56465ff7a922b56e612f14f: Status 404 returned error can't find the container with id b6cc88665755b30643eefbb581452f9f0fdf6d4ef56465ff7a922b56e612f14f May 21 13:02:51.939202 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:51.939166 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1602ae60-f2e5-40c7-ac65-56a27fde007a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-qps6z\" (UID: \"1602ae60-f2e5-40c7-ac65-56a27fde007a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-qps6z" May 21 13:02:51.939370 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:51.939335 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 13:02:51.939431 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:51.939418 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1602ae60-f2e5-40c7-ac65-56a27fde007a-networking-console-plugin-cert podName:1602ae60-f2e5-40c7-ac65-56a27fde007a nodeName:}" failed. No retries permitted until 2026-05-21 13:02:52.939395999 +0000 UTC m=+35.794107488 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1602ae60-f2e5-40c7-ac65-56a27fde007a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-qps6z" (UID: "1602ae60-f2e5-40c7-ac65-56a27fde007a") : secret "networking-console-plugin-cert" not found May 21 13:02:52.687942 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:52.687317 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpjmn" May 21 13:02:52.693002 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:52.691348 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 13:02:52.747491 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:52.747403 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-registry-tls\") pod \"image-registry-96d5fcb49-fjhxc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:02:52.747668 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:52.747563 2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 13:02:52.747668 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:52.747605 2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96d5fcb49-fjhxc: secret "image-registry-tls" not found May 21 13:02:52.747797 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:52.747676 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-registry-tls podName:bfbc7ef9-d45f-495f-95ef-dba579b5dffc nodeName:}" failed. No retries permitted until 2026-05-21 13:02:54.747655962 +0000 UTC m=+37.602367439 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-registry-tls") pod "image-registry-96d5fcb49-fjhxc" (UID: "bfbc7ef9-d45f-495f-95ef-dba579b5dffc") : secret "image-registry-tls" not found May 21 13:02:52.824578 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:52.824495 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jpd9b" event={"ID":"ea47420b-798b-4626-8614-a2fb41be4ba0","Type":"ContainerStarted","Data":"b6cc88665755b30643eefbb581452f9f0fdf6d4ef56465ff7a922b56e612f14f"} May 21 13:02:52.848545 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:52.848505 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5efbaa38-37d0-454b-9599-c194f169cd39-cert\") pod \"ingress-canary-r7bq5\" (UID: \"5efbaa38-37d0-454b-9599-c194f169cd39\") " pod="openshift-ingress-canary/ingress-canary-r7bq5" May 21 13:02:52.849416 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:52.848882 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 13:02:52.849416 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:52.848947 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5efbaa38-37d0-454b-9599-c194f169cd39-cert podName:5efbaa38-37d0-454b-9599-c194f169cd39 nodeName:}" failed. No retries permitted until 2026-05-21 13:02:54.848928259 +0000 UTC m=+37.703639739 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5efbaa38-37d0-454b-9599-c194f169cd39-cert") pod "ingress-canary-r7bq5" (UID: "5efbaa38-37d0-454b-9599-c194f169cd39") : secret "canary-serving-cert" not found May 21 13:02:52.849931 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:52.849737 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26c9dda0-e679-4ac2-bab6-7df9f5f26703-metrics-tls\") pod \"dns-default-9cl59\" (UID: \"26c9dda0-e679-4ac2-bab6-7df9f5f26703\") " pod="openshift-dns/dns-default-9cl59" May 21 13:02:52.849931 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:52.849862 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 13:02:52.849931 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:52.849906 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26c9dda0-e679-4ac2-bab6-7df9f5f26703-metrics-tls podName:26c9dda0-e679-4ac2-bab6-7df9f5f26703 nodeName:}" failed. No retries permitted until 2026-05-21 13:02:54.849891813 +0000 UTC m=+37.704603284 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26c9dda0-e679-4ac2-bab6-7df9f5f26703-metrics-tls") pod "dns-default-9cl59" (UID: "26c9dda0-e679-4ac2-bab6-7df9f5f26703") : secret "dns-default-metrics-tls" not found May 21 13:02:52.951402 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:52.950703 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1602ae60-f2e5-40c7-ac65-56a27fde007a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-qps6z\" (UID: \"1602ae60-f2e5-40c7-ac65-56a27fde007a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-qps6z" May 21 13:02:52.951402 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:52.950877 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 13:02:52.951402 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:52.950942 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1602ae60-f2e5-40c7-ac65-56a27fde007a-networking-console-plugin-cert podName:1602ae60-f2e5-40c7-ac65-56a27fde007a nodeName:}" failed. No retries permitted until 2026-05-21 13:02:54.950923122 +0000 UTC m=+37.805634591 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1602ae60-f2e5-40c7-ac65-56a27fde007a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-qps6z" (UID: "1602ae60-f2e5-40c7-ac65-56a27fde007a") : secret "networking-console-plugin-cert" not found May 21 13:02:54.773193 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:54.772518 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-registry-tls\") pod \"image-registry-96d5fcb49-fjhxc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:02:54.773193 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:54.772753 2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 13:02:54.773193 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:54.772773 2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96d5fcb49-fjhxc: secret "image-registry-tls" not found May 21 13:02:54.773193 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:54.772834 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-registry-tls podName:bfbc7ef9-d45f-495f-95ef-dba579b5dffc nodeName:}" failed. No retries permitted until 2026-05-21 13:02:58.772813984 +0000 UTC m=+41.627525468 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-registry-tls") pod "image-registry-96d5fcb49-fjhxc" (UID: "bfbc7ef9-d45f-495f-95ef-dba579b5dffc") : secret "image-registry-tls" not found May 21 13:02:54.874472 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:54.873651 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5efbaa38-37d0-454b-9599-c194f169cd39-cert\") pod \"ingress-canary-r7bq5\" (UID: \"5efbaa38-37d0-454b-9599-c194f169cd39\") " pod="openshift-ingress-canary/ingress-canary-r7bq5" May 21 13:02:54.874472 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:54.873761 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26c9dda0-e679-4ac2-bab6-7df9f5f26703-metrics-tls\") pod \"dns-default-9cl59\" (UID: \"26c9dda0-e679-4ac2-bab6-7df9f5f26703\") " pod="openshift-dns/dns-default-9cl59" May 21 13:02:54.874472 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:54.873891 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 13:02:54.874472 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:54.873957 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26c9dda0-e679-4ac2-bab6-7df9f5f26703-metrics-tls podName:26c9dda0-e679-4ac2-bab6-7df9f5f26703 nodeName:}" failed. No retries permitted until 2026-05-21 13:02:58.873935744 +0000 UTC m=+41.728647229 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26c9dda0-e679-4ac2-bab6-7df9f5f26703-metrics-tls") pod "dns-default-9cl59" (UID: "26c9dda0-e679-4ac2-bab6-7df9f5f26703") : secret "dns-default-metrics-tls" not found May 21 13:02:54.874472 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:54.874373 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 13:02:54.874472 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:54.874424 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5efbaa38-37d0-454b-9599-c194f169cd39-cert podName:5efbaa38-37d0-454b-9599-c194f169cd39 nodeName:}" failed. No retries permitted until 2026-05-21 13:02:58.874409024 +0000 UTC m=+41.729120495 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5efbaa38-37d0-454b-9599-c194f169cd39-cert") pod "ingress-canary-r7bq5" (UID: "5efbaa38-37d0-454b-9599-c194f169cd39") : secret "canary-serving-cert" not found May 21 13:02:54.975614 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:54.974987 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1602ae60-f2e5-40c7-ac65-56a27fde007a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-qps6z\" (UID: \"1602ae60-f2e5-40c7-ac65-56a27fde007a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-qps6z" May 21 13:02:54.975614 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:54.975159 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 13:02:54.975614 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:54.975230 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1602ae60-f2e5-40c7-ac65-56a27fde007a-networking-console-plugin-cert podName:1602ae60-f2e5-40c7-ac65-56a27fde007a nodeName:}" failed. No retries permitted until 2026-05-21 13:02:58.975210962 +0000 UTC m=+41.829922440 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1602ae60-f2e5-40c7-ac65-56a27fde007a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-qps6z" (UID: "1602ae60-f2e5-40c7-ac65-56a27fde007a") : secret "networking-console-plugin-cert" not found May 21 13:02:58.805761 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:58.805515 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-registry-tls\") pod \"image-registry-96d5fcb49-fjhxc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:02:58.806190 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:58.805699 2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 13:02:58.806190 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:58.805832 2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96d5fcb49-fjhxc: secret "image-registry-tls" not found May 21 13:02:58.806190 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:58.805913 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-registry-tls podName:bfbc7ef9-d45f-495f-95ef-dba579b5dffc nodeName:}" failed. No retries permitted until 2026-05-21 13:03:06.805886954 +0000 UTC m=+49.660598441 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-registry-tls") pod "image-registry-96d5fcb49-fjhxc" (UID: "bfbc7ef9-d45f-495f-95ef-dba579b5dffc") : secret "image-registry-tls" not found May 21 13:02:58.906613 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:58.906560 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5efbaa38-37d0-454b-9599-c194f169cd39-cert\") pod \"ingress-canary-r7bq5\" (UID: \"5efbaa38-37d0-454b-9599-c194f169cd39\") " pod="openshift-ingress-canary/ingress-canary-r7bq5" May 21 13:02:58.906783 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:58.906719 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 13:02:58.906783 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:58.906773 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26c9dda0-e679-4ac2-bab6-7df9f5f26703-metrics-tls\") pod \"dns-default-9cl59\" (UID: \"26c9dda0-e679-4ac2-bab6-7df9f5f26703\") " pod="openshift-dns/dns-default-9cl59" May 21 13:02:58.906865 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:58.906784 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5efbaa38-37d0-454b-9599-c194f169cd39-cert podName:5efbaa38-37d0-454b-9599-c194f169cd39 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:06.906768358 +0000 UTC m=+49.761479825 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5efbaa38-37d0-454b-9599-c194f169cd39-cert") pod "ingress-canary-r7bq5" (UID: "5efbaa38-37d0-454b-9599-c194f169cd39") : secret "canary-serving-cert" not found May 21 13:02:58.906923 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:58.906897 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 13:02:58.906962 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:58.906952 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26c9dda0-e679-4ac2-bab6-7df9f5f26703-metrics-tls podName:26c9dda0-e679-4ac2-bab6-7df9f5f26703 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:06.90693759 +0000 UTC m=+49.761649069 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26c9dda0-e679-4ac2-bab6-7df9f5f26703-metrics-tls") pod "dns-default-9cl59" (UID: "26c9dda0-e679-4ac2-bab6-7df9f5f26703") : secret "dns-default-metrics-tls" not found May 21 13:02:59.010782 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:02:59.010042 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1602ae60-f2e5-40c7-ac65-56a27fde007a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-qps6z\" (UID: \"1602ae60-f2e5-40c7-ac65-56a27fde007a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-qps6z" May 21 13:02:59.010782 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:59.010301 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 13:02:59.010782 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:02:59.010376 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1602ae60-f2e5-40c7-ac65-56a27fde007a-networking-console-plugin-cert podName:1602ae60-f2e5-40c7-ac65-56a27fde007a nodeName:}" failed. No retries permitted until 2026-05-21 13:03:07.010355842 +0000 UTC m=+49.865067326 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1602ae60-f2e5-40c7-ac65-56a27fde007a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-qps6z" (UID: "1602ae60-f2e5-40c7-ac65-56a27fde007a") : secret "networking-console-plugin-cert" not found May 21 13:03:05.856002 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:05.855923 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hj996" event={"ID":"a1c588d2-c125-462d-8b87-0e2d37de91ae","Type":"ContainerStarted","Data":"230792d0bec1162ba205a35d1cc7a27e34765025360f0b7c4538f217f9de3440"} May 21 13:03:05.857358 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:05.857330 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" event={"ID":"2effc3cd-50d2-4f44-b393-42875748b504","Type":"ContainerStarted","Data":"9c57a12b201c7837f1085683141a99c6d3395213e3213b929ebb739778393dc1"} May 21 13:03:05.858760 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:05.858733 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jpd9b" event={"ID":"ea47420b-798b-4626-8614-a2fb41be4ba0","Type":"ContainerStarted","Data":"ff0551a6580b1e5bd62f0fef0280bc34bebeb5feda4c6258295e0a6cc4a531a9"} May 21 13:03:05.858883 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:05.858867 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jpd9b" May 21 13:03:05.860129 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:05.860102 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cbf4d488-wvlw5" event={"ID":"64fe292d-b83a-4ac9-9bf3-2fa03e8e58c4","Type":"ContainerStarted","Data":"97aad641bc05679ecbbe14d1ec3ecf9f988779607454ea37ea081656a4ed110d"} May 21 13:03:05.860312 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:05.860295 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cbf4d488-wvlw5" May 21 13:03:05.861521 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:05.861496 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-d8lss" event={"ID":"268e0d5b-525c-4c90-a50e-a475cec07731","Type":"ContainerStarted","Data":"694b4876da7a4d818b3875d803a774ed0206c4921c8e2df311f8d2421f90f818"} May 21 13:03:05.862050 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:05.862018 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cbf4d488-wvlw5" May 21 13:03:05.864160 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:05.864140 2561 generic.go:358] "Generic (PLEG): container finished" podID="90df9cf5-af9f-4ced-a8b9-bc37cb33c819" containerID="2c99d6b369e87506ae7a4e68501aae3e4b575a1c356433605600c8c036a49ac0" exitCode=0 May 21 13:03:05.864249 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:05.864201 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pf45t" event={"ID":"90df9cf5-af9f-4ced-a8b9-bc37cb33c819","Type":"ContainerDied","Data":"2c99d6b369e87506ae7a4e68501aae3e4b575a1c356433605600c8c036a49ac0"} May 21 13:03:05.865618 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:05.865596 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d99bf56db-gscx7" event={"ID":"7314ef2e-ec8f-4126-b669-0866b6d355c0","Type":"ContainerStarted","Data":"7e2a611f70e82aae7143917fdceda08cf61f087f7894c3bfd9631e4381cb36cd"} May 21 13:03:05.867216 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:05.867196 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8rd5h" event={"ID":"de80e51e-6c75-4dab-a690-14b4eb31eb99","Type":"ContainerStarted","Data":"cf9d6e02a4629d5bc52dd66a6005674685ca55c974b474db1411abee8cd94da6"} May 21 13:03:05.874178 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:05.874135 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hj996" podStartSLOduration=30.027255429 podStartE2EDuration="43.874121266s" podCreationTimestamp="2026-05-21 13:02:22 +0000 UTC" firstStartedPulling="2026-05-21 13:02:51.63919199 +0000 UTC m=+34.493903467" lastFinishedPulling="2026-05-21 13:03:05.486057835 +0000 UTC m=+48.340769304" observedRunningTime="2026-05-21 13:03:05.872854821 +0000 UTC m=+48.727566311" watchObservedRunningTime="2026-05-21 13:03:05.874121266 +0000 UTC m=+48.728832757" May 21 13:03:05.891142 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:05.889199 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-d8lss" podStartSLOduration=29.003027463 podStartE2EDuration="42.889184612s" podCreationTimestamp="2026-05-21 13:02:23 +0000 UTC" firstStartedPulling="2026-05-21 13:02:51.59992766 +0000 UTC m=+34.454639140" lastFinishedPulling="2026-05-21 13:03:05.486084805 +0000 UTC m=+48.340796289" observedRunningTime="2026-05-21 13:03:05.88823057 +0000 UTC m=+48.742942063" watchObservedRunningTime="2026-05-21 13:03:05.889184612 +0000 UTC m=+48.743896102" May 21 13:03:05.950709 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:05.950660 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d99bf56db-gscx7" podStartSLOduration=10.132291501 podStartE2EDuration="23.950643062s" podCreationTimestamp="2026-05-21 13:02:42 +0000 UTC" firstStartedPulling="2026-05-21 13:02:51.695759206 +0000 UTC m=+34.550470687" lastFinishedPulling="2026-05-21 13:03:05.51411078 +0000 UTC m=+48.368822248" observedRunningTime="2026-05-21 13:03:05.915518331 +0000 UTC m=+48.770229822" watchObservedRunningTime="2026-05-21 13:03:05.950643062 +0000 UTC m=+48.805354549" May 21 13:03:05.950849 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:05.950777 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-77cbf4d488-wvlw5" podStartSLOduration=10.154954328 podStartE2EDuration="23.950770986s" podCreationTimestamp="2026-05-21 13:02:42 +0000 UTC" firstStartedPulling="2026-05-21 13:02:51.706231512 +0000 UTC m=+34.560942993" lastFinishedPulling="2026-05-21 13:03:05.502048175 +0000 UTC m=+48.356759651" observedRunningTime="2026-05-21 13:03:05.950515134 +0000 UTC m=+48.805226623" watchObservedRunningTime="2026-05-21 13:03:05.950770986 +0000 UTC m=+48.805482475" May 21 13:03:06.032274 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:06.032218 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8rd5h" podStartSLOduration=32.226645039 podStartE2EDuration="46.032200365s" podCreationTimestamp="2026-05-21 13:02:20 +0000 UTC" firstStartedPulling="2026-05-21 13:02:51.626938791 +0000 UTC m=+34.481650272" lastFinishedPulling="2026-05-21 13:03:05.432494123 +0000 UTC m=+48.287205598" observedRunningTime="2026-05-21 13:03:06.031997163 +0000 UTC m=+48.886708652" watchObservedRunningTime="2026-05-21 13:03:06.032200365 +0000 UTC m=+48.886911854" May 21 13:03:06.052885 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:06.052749 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jpd9b" podStartSLOduration=34.410788527 podStartE2EDuration="48.052735843s" podCreationTimestamp="2026-05-21 13:02:18 +0000 UTC" firstStartedPulling="2026-05-21 13:02:51.860980834 +0000 UTC m=+34.715692320" lastFinishedPulling="2026-05-21 13:03:05.502928156 +0000 UTC m=+48.357639636" observedRunningTime="2026-05-21 13:03:06.052466465 +0000 UTC m=+48.907177954" watchObservedRunningTime="2026-05-21 13:03:06.052735843 +0000 UTC m=+48.907447329" May 21 13:03:06.071210 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:06.071023 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8621c605-ffd6-4f1c-8279-33031fef7e8f-original-pull-secret\") pod \"global-pull-secret-syncer-wpjmn\" (UID: \"8621c605-ffd6-4f1c-8279-33031fef7e8f\") " pod="kube-system/global-pull-secret-syncer-wpjmn" May 21 13:03:06.074269 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:06.074237 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8621c605-ffd6-4f1c-8279-33031fef7e8f-original-pull-secret\") pod \"global-pull-secret-syncer-wpjmn\" (UID: \"8621c605-ffd6-4f1c-8279-33031fef7e8f\") " pod="kube-system/global-pull-secret-syncer-wpjmn" May 21 13:03:06.205147 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:06.205110 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wpjmn" May 21 13:03:06.337727 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:06.337647 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wpjmn"] May 21 13:03:06.341975 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:03:06.341934 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8621c605_ffd6_4f1c_8279_33031fef7e8f.slice/crio-beca28701fc63eecef74ebc58eb955c9649ebba2ed188e5e18cc5b77522a9f73 WatchSource:0}: Error finding container beca28701fc63eecef74ebc58eb955c9649ebba2ed188e5e18cc5b77522a9f73: Status 404 returned error can't find the container with id beca28701fc63eecef74ebc58eb955c9649ebba2ed188e5e18cc5b77522a9f73 May 21 13:03:06.877345 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:06.877291 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wpjmn" event={"ID":"8621c605-ffd6-4f1c-8279-33031fef7e8f","Type":"ContainerStarted","Data":"beca28701fc63eecef74ebc58eb955c9649ebba2ed188e5e18cc5b77522a9f73"} May 21 13:03:06.879083 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:06.879060 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-registry-tls\") pod \"image-registry-96d5fcb49-fjhxc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:03:06.879207 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:03:06.879180 2561 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 21 13:03:06.879207 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:03:06.879195 2561 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-96d5fcb49-fjhxc: secret "image-registry-tls" not found May 21 13:03:06.879309 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:03:06.879243 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-registry-tls podName:bfbc7ef9-d45f-495f-95ef-dba579b5dffc nodeName:}" failed. No retries permitted until 2026-05-21 13:03:22.879228577 +0000 UTC m=+65.733940046 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-registry-tls") pod "image-registry-96d5fcb49-fjhxc" (UID: "bfbc7ef9-d45f-495f-95ef-dba579b5dffc") : secret "image-registry-tls" not found May 21 13:03:06.880832 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:06.880803 2561 generic.go:358] "Generic (PLEG): container finished" podID="90df9cf5-af9f-4ced-a8b9-bc37cb33c819" containerID="358b8ea95e176427c56647603fecf8fbd0b135d334de9d8251663ad2b2e1b4e8" exitCode=0 May 21 13:03:06.880943 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:06.880922 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pf45t" event={"ID":"90df9cf5-af9f-4ced-a8b9-bc37cb33c819","Type":"ContainerDied","Data":"358b8ea95e176427c56647603fecf8fbd0b135d334de9d8251663ad2b2e1b4e8"} May 21 13:03:06.975686 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:06.975656 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-7bmnm"] May 21 13:03:06.978670 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:06.978650 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7bmnm" May 21 13:03:06.980840 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:06.980683 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26c9dda0-e679-4ac2-bab6-7df9f5f26703-metrics-tls\") pod \"dns-default-9cl59\" (UID: \"26c9dda0-e679-4ac2-bab6-7df9f5f26703\") " pod="openshift-dns/dns-default-9cl59" May 21 13:03:06.981053 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:06.981029 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5efbaa38-37d0-454b-9599-c194f169cd39-cert\") pod \"ingress-canary-r7bq5\" (UID: \"5efbaa38-37d0-454b-9599-c194f169cd39\") " pod="openshift-ingress-canary/ingress-canary-r7bq5" May 21 13:03:06.981182 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:03:06.981125 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 13:03:06.981182 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:03:06.981179 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5efbaa38-37d0-454b-9599-c194f169cd39-cert podName:5efbaa38-37d0-454b-9599-c194f169cd39 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:22.98116147 +0000 UTC m=+65.835872940 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5efbaa38-37d0-454b-9599-c194f169cd39-cert") pod "ingress-canary-r7bq5" (UID: "5efbaa38-37d0-454b-9599-c194f169cd39") : secret "canary-serving-cert" not found May 21 13:03:06.981724 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:03:06.981701 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 13:03:06.981816 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:03:06.981762 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26c9dda0-e679-4ac2-bab6-7df9f5f26703-metrics-tls podName:26c9dda0-e679-4ac2-bab6-7df9f5f26703 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:22.981749249 +0000 UTC m=+65.836460721 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26c9dda0-e679-4ac2-bab6-7df9f5f26703-metrics-tls") pod "dns-default-9cl59" (UID: "26c9dda0-e679-4ac2-bab6-7df9f5f26703") : secret "dns-default-metrics-tls" not found May 21 13:03:06.982551 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:06.982357 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" May 21 13:03:06.982551 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:06.982442 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-vnkll\"" May 21 13:03:06.983712 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:06.983695 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" May 21 13:03:06.994243 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:06.994199 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-7bmnm"] May 21 13:03:07.082662 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:03:07.082196 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 13:03:07.082662 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:07.082510 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1602ae60-f2e5-40c7-ac65-56a27fde007a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-qps6z\" (UID: \"1602ae60-f2e5-40c7-ac65-56a27fde007a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-qps6z" May 21 13:03:07.082662 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:07.082629 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq6pm\" (UniqueName: \"kubernetes.io/projected/f545c6e3-e3f4-4c9d-8cff-230fc949f3bc-kube-api-access-hq6pm\") pod \"migrator-b985f5d89-7bmnm\" (UID: \"f545c6e3-e3f4-4c9d-8cff-230fc949f3bc\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7bmnm" May 21 13:03:07.083160 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:03:07.082799 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1602ae60-f2e5-40c7-ac65-56a27fde007a-networking-console-plugin-cert podName:1602ae60-f2e5-40c7-ac65-56a27fde007a nodeName:}" failed. No retries permitted until 2026-05-21 13:03:23.082779338 +0000 UTC m=+65.937490816 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1602ae60-f2e5-40c7-ac65-56a27fde007a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-qps6z" (UID: "1602ae60-f2e5-40c7-ac65-56a27fde007a") : secret "networking-console-plugin-cert" not found May 21 13:03:07.183932 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:07.183784 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hq6pm\" (UniqueName: \"kubernetes.io/projected/f545c6e3-e3f4-4c9d-8cff-230fc949f3bc-kube-api-access-hq6pm\") pod \"migrator-b985f5d89-7bmnm\" (UID: \"f545c6e3-e3f4-4c9d-8cff-230fc949f3bc\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7bmnm" May 21 13:03:07.193163 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:07.193135 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq6pm\" (UniqueName: \"kubernetes.io/projected/f545c6e3-e3f4-4c9d-8cff-230fc949f3bc-kube-api-access-hq6pm\") pod \"migrator-b985f5d89-7bmnm\" (UID: \"f545c6e3-e3f4-4c9d-8cff-230fc949f3bc\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7bmnm" May 21 13:03:07.294503 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:07.294467 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7bmnm" May 21 13:03:07.455736 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:07.455582 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-7bmnm"] May 21 13:03:07.460613 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:03:07.460558 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf545c6e3_e3f4_4c9d_8cff_230fc949f3bc.slice/crio-c27d7ff84a2139be2a672833d4d64742f09d5af382cedda11accc4dc471d8225 WatchSource:0}: Error finding container c27d7ff84a2139be2a672833d4d64742f09d5af382cedda11accc4dc471d8225: Status 404 returned error can't find the container with id c27d7ff84a2139be2a672833d4d64742f09d5af382cedda11accc4dc471d8225 May 21 13:03:07.885505 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:07.885460 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7bmnm" event={"ID":"f545c6e3-e3f4-4c9d-8cff-230fc949f3bc","Type":"ContainerStarted","Data":"c27d7ff84a2139be2a672833d4d64742f09d5af382cedda11accc4dc471d8225"} May 21 13:03:07.889351 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:07.889325 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pf45t" event={"ID":"90df9cf5-af9f-4ced-a8b9-bc37cb33c819","Type":"ContainerStarted","Data":"011bae4f424d5ad769228fe44c1edad62c3fb04c45cee271bce9454723caad04"} May 21 13:03:07.917279 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:07.916291 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pf45t" podStartSLOduration=7.258160287 podStartE2EDuration="50.916274953s" podCreationTimestamp="2026-05-21 13:02:17 +0000 UTC" firstStartedPulling="2026-05-21 13:02:20.422902222 +0000 UTC m=+3.277613691" lastFinishedPulling="2026-05-21 13:03:04.081016889 +0000 UTC m=+46.935728357" observedRunningTime="2026-05-21 13:03:07.914525433 +0000 UTC m=+50.769236934" watchObservedRunningTime="2026-05-21 13:03:07.916274953 +0000 UTC m=+50.770986444" May 21 13:03:08.894864 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:08.894822 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" event={"ID":"2effc3cd-50d2-4f44-b393-42875748b504","Type":"ContainerStarted","Data":"d9e68d8ab3a092e9e4880dc21f704217047270bed6844b7221ca563cf52c98fd"} May 21 13:03:08.895276 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:08.894871 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" event={"ID":"2effc3cd-50d2-4f44-b393-42875748b504","Type":"ContainerStarted","Data":"7125f5da777037960c310d5effe5f55e684b879efc853c289d2c414042ce5a57"} May 21 13:03:08.916464 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:08.916408 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" podStartSLOduration=10.432224028 podStartE2EDuration="26.9163917s" podCreationTimestamp="2026-05-21 13:02:42 +0000 UTC" firstStartedPulling="2026-05-21 13:02:51.722548774 +0000 UTC m=+34.577260241" lastFinishedPulling="2026-05-21 13:03:08.206716437 +0000 UTC m=+51.061427913" observedRunningTime="2026-05-21 13:03:08.914926425 +0000 UTC m=+51.769637914" watchObservedRunningTime="2026-05-21 13:03:08.9163917 +0000 UTC m=+51.771103191" May 21 13:03:09.900629 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:09.900586 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7bmnm" event={"ID":"f545c6e3-e3f4-4c9d-8cff-230fc949f3bc","Type":"ContainerStarted","Data":"851999aa31176a7e2ee93eb7127c062ff191fe5290ab89c79e782f97ba58ce1a"} May 21 13:03:09.901054 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:09.900639 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7bmnm" event={"ID":"f545c6e3-e3f4-4c9d-8cff-230fc949f3bc","Type":"ContainerStarted","Data":"630b863830af93bdba34d2462c9cd15a8aaa5f56f46202000bcbac3f9ed0d4cd"} May 21 13:03:09.934247 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:09.934193 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-7bmnm" podStartSLOduration=2.245170298 podStartE2EDuration="3.934179483s" podCreationTimestamp="2026-05-21 13:03:06 +0000 UTC" firstStartedPulling="2026-05-21 13:03:07.462853837 +0000 UTC m=+50.317565320" lastFinishedPulling="2026-05-21 13:03:09.151863025 +0000 UTC m=+52.006574505" observedRunningTime="2026-05-21 13:03:09.933442763 +0000 UTC m=+52.788154257" watchObservedRunningTime="2026-05-21 13:03:09.934179483 +0000 UTC m=+52.788890972" May 21 13:03:11.910628 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:11.910591 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wpjmn" event={"ID":"8621c605-ffd6-4f1c-8279-33031fef7e8f","Type":"ContainerStarted","Data":"fdc00b2f9cc3eb5c4ba71c0bcb6b0dedc2c928be14f9605856a6da2f09bc6920"} May 21 13:03:11.928969 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:11.928921 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wpjmn" podStartSLOduration=32.951650507 podStartE2EDuration="37.928909453s" podCreationTimestamp="2026-05-21 13:02:34 +0000 UTC" firstStartedPulling="2026-05-21 13:03:06.344735038 +0000 UTC m=+49.199446511" lastFinishedPulling="2026-05-21 13:03:11.321993973 +0000 UTC m=+54.176705457" observedRunningTime="2026-05-21 13:03:11.928528537 +0000 UTC m=+54.783240027" watchObservedRunningTime="2026-05-21 13:03:11.928909453 +0000 UTC m=+54.783620935" May 21 13:03:17.815537 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:17.815511 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hxtvm" May 21 13:03:22.919043 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:22.919001 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-registry-tls\") pod \"image-registry-96d5fcb49-fjhxc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:03:22.921494 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:22.921462 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-registry-tls\") pod \"image-registry-96d5fcb49-fjhxc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:03:23.019829 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:23.019789 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5efbaa38-37d0-454b-9599-c194f169cd39-cert\") pod \"ingress-canary-r7bq5\" (UID: \"5efbaa38-37d0-454b-9599-c194f169cd39\") " pod="openshift-ingress-canary/ingress-canary-r7bq5" May 21 13:03:23.020001 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:23.019862 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26c9dda0-e679-4ac2-bab6-7df9f5f26703-metrics-tls\") pod \"dns-default-9cl59\" (UID: \"26c9dda0-e679-4ac2-bab6-7df9f5f26703\") " pod="openshift-dns/dns-default-9cl59" May 21 13:03:23.022086 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:23.022057 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26c9dda0-e679-4ac2-bab6-7df9f5f26703-metrics-tls\") pod \"dns-default-9cl59\" (UID: \"26c9dda0-e679-4ac2-bab6-7df9f5f26703\") " pod="openshift-dns/dns-default-9cl59" May 21 13:03:23.022267 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:23.022246 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5efbaa38-37d0-454b-9599-c194f169cd39-cert\") pod \"ingress-canary-r7bq5\" (UID: \"5efbaa38-37d0-454b-9599-c194f169cd39\") " pod="openshift-ingress-canary/ingress-canary-r7bq5" May 21 13:03:23.120345 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:23.120304 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1602ae60-f2e5-40c7-ac65-56a27fde007a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-qps6z\" (UID: \"1602ae60-f2e5-40c7-ac65-56a27fde007a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-qps6z" May 21 13:03:23.120515 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:03:23.120430 2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 21 13:03:23.120515 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:03:23.120482 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1602ae60-f2e5-40c7-ac65-56a27fde007a-networking-console-plugin-cert podName:1602ae60-f2e5-40c7-ac65-56a27fde007a nodeName:}" failed. No retries permitted until 2026-05-21 13:03:55.120468713 +0000 UTC m=+97.975180180 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/1602ae60-f2e5-40c7-ac65-56a27fde007a-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-qps6z" (UID: "1602ae60-f2e5-40c7-ac65-56a27fde007a") : secret "networking-console-plugin-cert" not found May 21 13:03:23.135380 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:23.135353 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pgxzw\"" May 21 13:03:23.143643 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:23.143621 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:03:23.205841 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:23.205625 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4szfj\"" May 21 13:03:23.213024 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:23.212999 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9cl59" May 21 13:03:23.226867 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:23.226847 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7b4pc\"" May 21 13:03:23.235097 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:23.235066 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r7bq5" May 21 13:03:23.277351 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:23.276881 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-96d5fcb49-fjhxc"] May 21 13:03:23.282403 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:03:23.281855 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfbc7ef9_d45f_495f_95ef_dba579b5dffc.slice/crio-8d6ab9fa0bd4c75a83ba36baf51e94b6ab6b8247f190393c4b71a1d780cb494d WatchSource:0}: Error finding container 8d6ab9fa0bd4c75a83ba36baf51e94b6ab6b8247f190393c4b71a1d780cb494d: Status 404 returned error can't find the container with id 8d6ab9fa0bd4c75a83ba36baf51e94b6ab6b8247f190393c4b71a1d780cb494d May 21 13:03:23.348107 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:23.348072 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9cl59"] May 21 13:03:23.351201 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:03:23.351176 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26c9dda0_e679_4ac2_bab6_7df9f5f26703.slice/crio-73a13c9a6d0b228d4c2dd04a46658931b5291668b55b913503940bab5d7f2bef WatchSource:0}: Error finding container 73a13c9a6d0b228d4c2dd04a46658931b5291668b55b913503940bab5d7f2bef: Status 404 returned error can't find the container with id 73a13c9a6d0b228d4c2dd04a46658931b5291668b55b913503940bab5d7f2bef May 21 13:03:23.368091 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:23.368069 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r7bq5"] May 21 13:03:23.371095 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:03:23.371070 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5efbaa38_37d0_454b_9599_c194f169cd39.slice/crio-870f9ed5abd17a9b41f93b52947f42df06e8fd1a2b7df3432d17dcb77dec9911 WatchSource:0}: Error finding container 870f9ed5abd17a9b41f93b52947f42df06e8fd1a2b7df3432d17dcb77dec9911: Status 404 returned error can't find the container with id 870f9ed5abd17a9b41f93b52947f42df06e8fd1a2b7df3432d17dcb77dec9911 May 21 13:03:23.524214 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:23.524180 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1457bd6e-e261-401d-a957-cf50ed787bf8-metrics-certs\") pod \"network-metrics-daemon-5xxmv\" (UID: \"1457bd6e-e261-401d-a957-cf50ed787bf8\") " pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:03:23.527015 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:23.526997 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 13:03:23.536774 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:23.536754 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1457bd6e-e261-401d-a957-cf50ed787bf8-metrics-certs\") pod \"network-metrics-daemon-5xxmv\" (UID: \"1457bd6e-e261-401d-a957-cf50ed787bf8\") " pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:03:23.806173 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:23.806096 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dfgjb\"" May 21 13:03:23.814275 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:23.814249 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xxmv" May 21 13:03:23.942636 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:03:23.942602 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1457bd6e_e261_401d_a957_cf50ed787bf8.slice/crio-b28ea998ec710fb844f842dbeaf2ec6efe1d27d967d0d12b53ba53229ab12f03 WatchSource:0}: Error finding container b28ea998ec710fb844f842dbeaf2ec6efe1d27d967d0d12b53ba53229ab12f03: Status 404 returned error can't find the container with id b28ea998ec710fb844f842dbeaf2ec6efe1d27d967d0d12b53ba53229ab12f03 May 21 13:03:23.943217 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:23.943149 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5xxmv"] May 21 13:03:23.945189 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:23.945161 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9cl59" event={"ID":"26c9dda0-e679-4ac2-bab6-7df9f5f26703","Type":"ContainerStarted","Data":"73a13c9a6d0b228d4c2dd04a46658931b5291668b55b913503940bab5d7f2bef"} May 21 13:03:23.947069 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:23.947045 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" event={"ID":"bfbc7ef9-d45f-495f-95ef-dba579b5dffc","Type":"ContainerStarted","Data":"3b8f83a85783ba490508e5a7dab9f4a4bdddf193ac7b7a7bc68a98952f1750d2"} May 21 13:03:23.947169 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:23.947079 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" event={"ID":"bfbc7ef9-d45f-495f-95ef-dba579b5dffc","Type":"ContainerStarted","Data":"8d6ab9fa0bd4c75a83ba36baf51e94b6ab6b8247f190393c4b71a1d780cb494d"} May 21 13:03:23.947169 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:23.947113 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:03:23.948072 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:23.948051 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r7bq5" event={"ID":"5efbaa38-37d0-454b-9599-c194f169cd39","Type":"ContainerStarted","Data":"870f9ed5abd17a9b41f93b52947f42df06e8fd1a2b7df3432d17dcb77dec9911"} May 21 13:03:23.966167 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:23.966117 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" podStartSLOduration=65.966104667 podStartE2EDuration="1m5.966104667s" podCreationTimestamp="2026-05-21 13:02:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 13:03:23.965831496 +0000 UTC m=+66.820542993" watchObservedRunningTime="2026-05-21 13:03:23.966104667 +0000 UTC m=+66.820816157" May 21 13:03:24.952545 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:24.952502 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5xxmv" event={"ID":"1457bd6e-e261-401d-a957-cf50ed787bf8","Type":"ContainerStarted","Data":"b28ea998ec710fb844f842dbeaf2ec6efe1d27d967d0d12b53ba53229ab12f03"} May 21 13:03:26.961682 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:26.961646 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9cl59" event={"ID":"26c9dda0-e679-4ac2-bab6-7df9f5f26703","Type":"ContainerStarted","Data":"06a6b60bbeff944dd03b991392372fa2bc567f77701b50454ccd69aad0e55e77"} May 21 13:03:27.970173 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:27.970138 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r7bq5" event={"ID":"5efbaa38-37d0-454b-9599-c194f169cd39","Type":"ContainerStarted","Data":"9349aef502cf1e7b7d6c362764271964b01a894c7dd491513392705c96ba61f6"} May 21 13:03:27.971740 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:27.971715 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5xxmv" event={"ID":"1457bd6e-e261-401d-a957-cf50ed787bf8","Type":"ContainerStarted","Data":"9e68821981395e4aadd2e87021981770c2016061b6c43b99be2e2dca0e1d076c"} May 21 13:03:27.971847 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:27.971747 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5xxmv" event={"ID":"1457bd6e-e261-401d-a957-cf50ed787bf8","Type":"ContainerStarted","Data":"c5aa8fb405626541392bea17fcf4ea33bd6fcbcf9c950fa203222ef0b5db781e"} May 21 13:03:27.973195 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:27.973176 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9cl59" event={"ID":"26c9dda0-e679-4ac2-bab6-7df9f5f26703","Type":"ContainerStarted","Data":"3311770df0d8759e633bdb3a9942fa6e84c21b541f853261137ed299bd18545b"} May 21 13:03:27.973336 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:27.973323 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9cl59" May 21 13:03:27.998370 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:27.998331 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r7bq5" podStartSLOduration=34.584150599 podStartE2EDuration="37.998319415s" podCreationTimestamp="2026-05-21 13:02:50 +0000 UTC" firstStartedPulling="2026-05-21 13:03:23.372821569 +0000 UTC m=+66.227533036" lastFinishedPulling="2026-05-21 13:03:26.786990366 +0000 UTC m=+69.641701852" observedRunningTime="2026-05-21 13:03:27.997750164 +0000 UTC m=+70.852461653" watchObservedRunningTime="2026-05-21 13:03:27.998319415 +0000 UTC m=+70.853030905" May 21 13:03:28.023114 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:28.023072 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-9cl59" podStartSLOduration=34.589618697 podStartE2EDuration="38.02306005s" podCreationTimestamp="2026-05-21 13:02:50 +0000 UTC" firstStartedPulling="2026-05-21 13:03:23.352947124 +0000 UTC m=+66.207658591" lastFinishedPulling="2026-05-21 13:03:26.786388468 +0000 UTC m=+69.641099944" observedRunningTime="2026-05-21 13:03:28.021657529 +0000 UTC m=+70.876369019" watchObservedRunningTime="2026-05-21 13:03:28.02306005 +0000 UTC m=+70.877771539" May 21 13:03:28.044326 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:28.044285 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5xxmv" podStartSLOduration=67.198810794 podStartE2EDuration="1m10.044273259s" podCreationTimestamp="2026-05-21 13:02:18 +0000 UTC" firstStartedPulling="2026-05-21 13:03:23.94465465 +0000 UTC m=+66.799366118" lastFinishedPulling="2026-05-21 13:03:26.790117113 +0000 UTC m=+69.644828583" observedRunningTime="2026-05-21 13:03:28.043664737 +0000 UTC m=+70.898376228" watchObservedRunningTime="2026-05-21 13:03:28.044273259 +0000 UTC m=+70.898984748" May 21 13:03:36.416780 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:36.416750 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9cl59_26c9dda0-e679-4ac2-bab6-7df9f5f26703/dns/0.log" May 21 13:03:36.598387 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:36.598357 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9cl59_26c9dda0-e679-4ac2-bab6-7df9f5f26703/kube-rbac-proxy/0.log" May 21 13:03:36.883518 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:36.883485 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jpd9b" May 21 13:03:37.798445 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:37.798418 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9zcrx_3a149808-cb2d-482b-8d99-7e2d58b6b997/dns-node-resolver/0.log" May 21 13:03:37.981413 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:37.981385 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9cl59" May 21 13:03:38.398973 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:38.398944 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-96d5fcb49-fjhxc_bfbc7ef9-d45f-495f-95ef-dba579b5dffc/registry/0.log" May 21 13:03:38.745123 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:38.745043 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pfcxz"] May 21 13:03:38.748107 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:38.748086 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pfcxz" May 21 13:03:38.750885 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:38.750863 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-722bt\"" May 21 13:03:38.750885 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:38.750863 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 13:03:38.752091 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:38.752073 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 13:03:38.752160 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:38.752101 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 13:03:38.752160 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:38.752076 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 13:03:38.765441 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:38.765411 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pfcxz"] May 21 13:03:38.841269 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:38.841224 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9b82e57e-bc5f-405a-b589-f2fab982c427-crio-socket\") pod \"insights-runtime-extractor-pfcxz\" (UID: \"9b82e57e-bc5f-405a-b589-f2fab982c427\") " pod="openshift-insights/insights-runtime-extractor-pfcxz" May 21 13:03:38.841269 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:38.841272 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b82e57e-bc5f-405a-b589-f2fab982c427-data-volume\") pod \"insights-runtime-extractor-pfcxz\" (UID: \"9b82e57e-bc5f-405a-b589-f2fab982c427\") " pod="openshift-insights/insights-runtime-extractor-pfcxz" May 21 13:03:38.841730 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:38.841299 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24s4h\" (UniqueName: \"kubernetes.io/projected/9b82e57e-bc5f-405a-b589-f2fab982c427-kube-api-access-24s4h\") pod \"insights-runtime-extractor-pfcxz\" (UID: \"9b82e57e-bc5f-405a-b589-f2fab982c427\") " pod="openshift-insights/insights-runtime-extractor-pfcxz" May 21 13:03:38.841730 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:38.841407 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b82e57e-bc5f-405a-b589-f2fab982c427-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pfcxz\" (UID: \"9b82e57e-bc5f-405a-b589-f2fab982c427\") " pod="openshift-insights/insights-runtime-extractor-pfcxz" May 21 13:03:38.841730 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:38.841447 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b82e57e-bc5f-405a-b589-f2fab982c427-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pfcxz\" (UID: \"9b82e57e-bc5f-405a-b589-f2fab982c427\") " pod="openshift-insights/insights-runtime-extractor-pfcxz" May 21 13:03:38.942085 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:38.942045 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b82e57e-bc5f-405a-b589-f2fab982c427-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pfcxz\" (UID: \"9b82e57e-bc5f-405a-b589-f2fab982c427\") " pod="openshift-insights/insights-runtime-extractor-pfcxz" May 21 13:03:38.942085 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:38.942090 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b82e57e-bc5f-405a-b589-f2fab982c427-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pfcxz\" (UID: \"9b82e57e-bc5f-405a-b589-f2fab982c427\") " pod="openshift-insights/insights-runtime-extractor-pfcxz" May 21 13:03:38.942312 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:38.942121 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9b82e57e-bc5f-405a-b589-f2fab982c427-crio-socket\") pod \"insights-runtime-extractor-pfcxz\" (UID: \"9b82e57e-bc5f-405a-b589-f2fab982c427\") " pod="openshift-insights/insights-runtime-extractor-pfcxz" May 21 13:03:38.942312 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:38.942191 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b82e57e-bc5f-405a-b589-f2fab982c427-data-volume\") pod \"insights-runtime-extractor-pfcxz\" (UID: \"9b82e57e-bc5f-405a-b589-f2fab982c427\") " pod="openshift-insights/insights-runtime-extractor-pfcxz" May 21 13:03:38.942312 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:03:38.942199 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found May 21 13:03:38.942312 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:38.942227 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-24s4h\" (UniqueName: \"kubernetes.io/projected/9b82e57e-bc5f-405a-b589-f2fab982c427-kube-api-access-24s4h\") pod \"insights-runtime-extractor-pfcxz\" (UID: \"9b82e57e-bc5f-405a-b589-f2fab982c427\") " pod="openshift-insights/insights-runtime-extractor-pfcxz" May 21 13:03:38.942312 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:38.942256 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9b82e57e-bc5f-405a-b589-f2fab982c427-crio-socket\") pod \"insights-runtime-extractor-pfcxz\" (UID: \"9b82e57e-bc5f-405a-b589-f2fab982c427\") " pod="openshift-insights/insights-runtime-extractor-pfcxz" May 21 13:03:38.942541 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:03:38.942372 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b82e57e-bc5f-405a-b589-f2fab982c427-insights-runtime-extractor-tls podName:9b82e57e-bc5f-405a-b589-f2fab982c427 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:39.442351749 +0000 UTC m=+82.297063218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b82e57e-bc5f-405a-b589-f2fab982c427-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pfcxz" (UID: "9b82e57e-bc5f-405a-b589-f2fab982c427") : secret "insights-runtime-extractor-tls" not found May 21 13:03:38.942659 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:38.942548 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b82e57e-bc5f-405a-b589-f2fab982c427-data-volume\") pod \"insights-runtime-extractor-pfcxz\" (UID: \"9b82e57e-bc5f-405a-b589-f2fab982c427\") " pod="openshift-insights/insights-runtime-extractor-pfcxz" May 21 13:03:38.942659 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:38.942562 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b82e57e-bc5f-405a-b589-f2fab982c427-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pfcxz\" (UID: \"9b82e57e-bc5f-405a-b589-f2fab982c427\") " pod="openshift-insights/insights-runtime-extractor-pfcxz" May 21 13:03:38.965090 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:38.965062 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24s4h\" (UniqueName: \"kubernetes.io/projected/9b82e57e-bc5f-405a-b589-f2fab982c427-kube-api-access-24s4h\") pod \"insights-runtime-extractor-pfcxz\" (UID: \"9b82e57e-bc5f-405a-b589-f2fab982c427\") " pod="openshift-insights/insights-runtime-extractor-pfcxz" May 21 13:03:39.007868 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:39.007790 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hts48_d6095d2c-d51f-42aa-9514-91273a5b74a7/node-ca/0.log" May 21 13:03:39.446094 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:39.446041 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b82e57e-bc5f-405a-b589-f2fab982c427-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pfcxz\" (UID: \"9b82e57e-bc5f-405a-b589-f2fab982c427\") " pod="openshift-insights/insights-runtime-extractor-pfcxz" May 21 13:03:39.448742 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:39.448720 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b82e57e-bc5f-405a-b589-f2fab982c427-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pfcxz\" (UID: \"9b82e57e-bc5f-405a-b589-f2fab982c427\") " pod="openshift-insights/insights-runtime-extractor-pfcxz" May 21 13:03:39.657311 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:39.657261 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pfcxz" May 21 13:03:39.785364 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:39.785339 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pfcxz"] May 21 13:03:39.787855 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:03:39.787828 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b82e57e_bc5f_405a_b589_f2fab982c427.slice/crio-61c1a70472077d42dda0f1a9ec614319fe8a2c2f23bba6a6ab9a09f04e985179 WatchSource:0}: Error finding container 61c1a70472077d42dda0f1a9ec614319fe8a2c2f23bba6a6ab9a09f04e985179: Status 404 returned error can't find the container with id 61c1a70472077d42dda0f1a9ec614319fe8a2c2f23bba6a6ab9a09f04e985179 May 21 13:03:39.999374 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:39.999292 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r7bq5_5efbaa38-37d0-454b-9599-c194f169cd39/serve-healthcheck-canary/0.log" May 21 13:03:40.009773 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:40.009745 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pfcxz" event={"ID":"9b82e57e-bc5f-405a-b589-f2fab982c427","Type":"ContainerStarted","Data":"bd51635bf80b0ee8b384cd7552ba6f34c633b47f892c633349b9e07e4d677ed8"} May 21 13:03:40.009926 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:40.009781 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pfcxz" event={"ID":"9b82e57e-bc5f-405a-b589-f2fab982c427","Type":"ContainerStarted","Data":"61c1a70472077d42dda0f1a9ec614319fe8a2c2f23bba6a6ab9a09f04e985179"} May 21 13:03:41.015004 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:41.014966 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pfcxz" event={"ID":"9b82e57e-bc5f-405a-b589-f2fab982c427","Type":"ContainerStarted","Data":"77cec703e07e558bc78cde98b73734555c35860f19293400659a8000da9d16bd"} May 21 13:03:43.021529 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:43.021493 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pfcxz" event={"ID":"9b82e57e-bc5f-405a-b589-f2fab982c427","Type":"ContainerStarted","Data":"14bb8f741f44f3ab2c70120490c6f425c79017786f3d8564b6f18df91c3a5f1f"} May 21 13:03:43.041622 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:43.041557 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pfcxz" podStartSLOduration=2.466357604 podStartE2EDuration="5.041543065s" podCreationTimestamp="2026-05-21 13:03:38 +0000 UTC" firstStartedPulling="2026-05-21 13:03:39.853359098 +0000 UTC m=+82.708070569" lastFinishedPulling="2026-05-21 13:03:42.428544562 +0000 UTC m=+85.283256030" observedRunningTime="2026-05-21 13:03:43.039684197 +0000 UTC m=+85.894395687" watchObservedRunningTime="2026-05-21 13:03:43.041543065 +0000 UTC m=+85.896254625" May 21 13:03:43.147674 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:43.147639 2561 patch_prober.go:28] interesting pod/image-registry-96d5fcb49-fjhxc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 21 13:03:43.147835 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:43.147693 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" podUID="bfbc7ef9-d45f-495f-95ef-dba579b5dffc" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 13:03:44.956879 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:44.956850 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:03:45.941396 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:45.941354 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jp4z9"] May 21 13:03:45.944238 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:45.944214 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jp4z9" May 21 13:03:45.946860 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:45.946824 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 13:03:45.948141 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:45.948114 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 13:03:45.948256 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:45.948139 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 13:03:45.948256 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:45.948151 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 13:03:45.948256 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:45.948139 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 13:03:45.948256 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:45.948174 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 13:03:45.948256 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:45.948237 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2vl85\"" May 21 13:03:45.997740 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:45.997702 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4-node-exporter-accelerators-collector-config\") pod \"node-exporter-jp4z9\" (UID: \"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4\") " pod="openshift-monitoring/node-exporter-jp4z9" May 21 13:03:45.997740 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:45.997743 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4-node-exporter-wtmp\") pod \"node-exporter-jp4z9\" (UID: \"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4\") " pod="openshift-monitoring/node-exporter-jp4z9" May 21 13:03:45.998169 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:45.997762 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4-metrics-client-ca\") pod \"node-exporter-jp4z9\" (UID: \"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4\") " pod="openshift-monitoring/node-exporter-jp4z9" May 21 13:03:45.998169 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:45.997813 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jp4z9\" (UID: \"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4\") " pod="openshift-monitoring/node-exporter-jp4z9" May 21 13:03:45.998169 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:45.997834 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4-node-exporter-textfile\") pod \"node-exporter-jp4z9\" (UID: \"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4\") " pod="openshift-monitoring/node-exporter-jp4z9" May 21 13:03:45.998169 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:45.997889 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4-root\") pod \"node-exporter-jp4z9\" (UID: \"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4\") " pod="openshift-monitoring/node-exporter-jp4z9" May 21 13:03:45.998169 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:45.997911 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4-sys\") pod \"node-exporter-jp4z9\" (UID: \"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4\") " pod="openshift-monitoring/node-exporter-jp4z9" May 21 13:03:45.998169 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:45.997925 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4-node-exporter-tls\") pod \"node-exporter-jp4z9\" (UID: \"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4\") " pod="openshift-monitoring/node-exporter-jp4z9" May 21 13:03:45.998169 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:45.997947 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7g8k\" (UniqueName: \"kubernetes.io/projected/ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4-kube-api-access-r7g8k\") pod \"node-exporter-jp4z9\" (UID: \"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4\") " pod="openshift-monitoring/node-exporter-jp4z9" May 21 13:03:46.099274 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:46.099238 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jp4z9\" (UID: \"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4\") " pod="openshift-monitoring/node-exporter-jp4z9" May 21 13:03:46.099465 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:46.099283 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4-node-exporter-textfile\") pod \"node-exporter-jp4z9\" (UID: \"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4\") " pod="openshift-monitoring/node-exporter-jp4z9" May 21 13:03:46.099465 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:46.099330 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4-root\") pod \"node-exporter-jp4z9\" (UID: \"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4\") " pod="openshift-monitoring/node-exporter-jp4z9" May 21 13:03:46.099465 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:46.099352 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4-sys\") pod \"node-exporter-jp4z9\" (UID: \"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4\") " pod="openshift-monitoring/node-exporter-jp4z9" May 21 13:03:46.099465 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:46.099368 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4-node-exporter-tls\") pod \"node-exporter-jp4z9\" (UID: \"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4\") " pod="openshift-monitoring/node-exporter-jp4z9" May 21 13:03:46.099465 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:46.099393 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r7g8k\" (UniqueName: \"kubernetes.io/projected/ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4-kube-api-access-r7g8k\") pod \"node-exporter-jp4z9\" (UID: \"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4\") " pod="openshift-monitoring/node-exporter-jp4z9" May 21 13:03:46.099465 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:46.099428 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4-node-exporter-accelerators-collector-config\") pod \"node-exporter-jp4z9\" (UID: \"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4\") " pod="openshift-monitoring/node-exporter-jp4z9" May 21 13:03:46.099465 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:46.099448 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4-sys\") pod \"node-exporter-jp4z9\" (UID: \"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4\") " pod="openshift-monitoring/node-exporter-jp4z9" May 21 13:03:46.099465 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:46.099461 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4-node-exporter-wtmp\") pod \"node-exporter-jp4z9\" (UID: \"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4\") " pod="openshift-monitoring/node-exporter-jp4z9" May 21 13:03:46.099961 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:46.099430 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4-root\") pod \"node-exporter-jp4z9\" (UID: \"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4\") " pod="openshift-monitoring/node-exporter-jp4z9" May 21 13:03:46.099961 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:46.099486 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4-metrics-client-ca\") pod \"node-exporter-jp4z9\" (UID: \"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4\") " pod="openshift-monitoring/node-exporter-jp4z9" May 21 13:03:46.099961 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:46.099608 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4-node-exporter-wtmp\") pod \"node-exporter-jp4z9\" (UID: \"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4\") " pod="openshift-monitoring/node-exporter-jp4z9" May 21 13:03:46.099961 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:03:46.099684 2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 21 13:03:46.099961 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:46.099746 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4-node-exporter-textfile\") pod \"node-exporter-jp4z9\" (UID: \"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4\") " pod="openshift-monitoring/node-exporter-jp4z9" May 21 13:03:46.099961 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:03:46.099784 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4-node-exporter-tls podName:ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4 nodeName:}" failed. No retries permitted until 2026-05-21 13:03:46.59976064 +0000 UTC m=+89.454472123 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4-node-exporter-tls") pod "node-exporter-jp4z9" (UID: "ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4") : secret "node-exporter-tls" not found May 21 13:03:46.100288 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:46.100014 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4-metrics-client-ca\") pod \"node-exporter-jp4z9\" (UID: \"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4\") " pod="openshift-monitoring/node-exporter-jp4z9" May 21 13:03:46.100451 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:46.100426 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4-node-exporter-accelerators-collector-config\") pod \"node-exporter-jp4z9\" (UID: \"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4\") " pod="openshift-monitoring/node-exporter-jp4z9" May 21 13:03:46.101864 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:46.101843 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jp4z9\" (UID: \"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4\") " pod="openshift-monitoring/node-exporter-jp4z9" May 21 13:03:46.109382 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:46.109356 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7g8k\" (UniqueName: \"kubernetes.io/projected/ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4-kube-api-access-r7g8k\") pod \"node-exporter-jp4z9\" (UID: \"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4\") " pod="openshift-monitoring/node-exporter-jp4z9" May 21 13:03:46.603956 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:46.603923 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4-node-exporter-tls\") pod \"node-exporter-jp4z9\" (UID: \"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4\") " pod="openshift-monitoring/node-exporter-jp4z9" May 21 13:03:46.606260 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:46.606231 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4-node-exporter-tls\") pod \"node-exporter-jp4z9\" (UID: \"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4\") " pod="openshift-monitoring/node-exporter-jp4z9" May 21 13:03:46.853402 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:46.853374 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jp4z9" May 21 13:03:46.863129 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:03:46.863095 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca2ae8aa_4309_4f0a_9c3b_4836a117e5c4.slice/crio-f051841ad503cd17029d1359fff3d7fbea192e96888d52669354ce01a0974d18 WatchSource:0}: Error finding container f051841ad503cd17029d1359fff3d7fbea192e96888d52669354ce01a0974d18: Status 404 returned error can't find the container with id f051841ad503cd17029d1359fff3d7fbea192e96888d52669354ce01a0974d18 May 21 13:03:47.035082 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:47.035044 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jp4z9" event={"ID":"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4","Type":"ContainerStarted","Data":"f051841ad503cd17029d1359fff3d7fbea192e96888d52669354ce01a0974d18"} May 21 13:03:48.041023 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:48.040163 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jp4z9" event={"ID":"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4","Type":"ContainerStarted","Data":"f54ca71c5aff60e2693c4278f2adec456b76695f983020046edea6f7b2b00bf0"} May 21 13:03:49.044144 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:49.044113 2561 generic.go:358] "Generic (PLEG): container finished" podID="ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4" containerID="f54ca71c5aff60e2693c4278f2adec456b76695f983020046edea6f7b2b00bf0" exitCode=0 May 21 13:03:49.044602 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:49.044197 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jp4z9" event={"ID":"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4","Type":"ContainerDied","Data":"f54ca71c5aff60e2693c4278f2adec456b76695f983020046edea6f7b2b00bf0"} May 21 13:03:50.048772 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:50.048739 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jp4z9" event={"ID":"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4","Type":"ContainerStarted","Data":"8f6f5ae3983b6bf0297a28cc91c1bd79fdc7fb06b98cb45e5aedb26d1da68d8a"} May 21 13:03:50.048772 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:50.048775 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jp4z9" event={"ID":"ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4","Type":"ContainerStarted","Data":"a1fc9c1619c99c74c08c4c8f416d488727b878668766c0b92552d4cddebb512c"} May 21 13:03:50.069507 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:50.069458 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jp4z9" podStartSLOduration=4.046604539 podStartE2EDuration="5.069446195s" podCreationTimestamp="2026-05-21 13:03:45 +0000 UTC" firstStartedPulling="2026-05-21 13:03:46.865236013 +0000 UTC m=+89.719947481" lastFinishedPulling="2026-05-21 13:03:47.888077669 +0000 UTC m=+90.742789137" observedRunningTime="2026-05-21 13:03:50.068822321 +0000 UTC m=+92.923533848" watchObservedRunningTime="2026-05-21 13:03:50.069446195 +0000 UTC m=+92.924157685" May 21 13:03:52.357804 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:52.357768 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-96d5fcb49-fjhxc"] May 21 13:03:55.172149 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:55.172112 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1602ae60-f2e5-40c7-ac65-56a27fde007a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-qps6z\" (UID: \"1602ae60-f2e5-40c7-ac65-56a27fde007a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-qps6z" May 21 13:03:55.174419 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:55.174400 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1602ae60-f2e5-40c7-ac65-56a27fde007a-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-qps6z\" (UID: \"1602ae60-f2e5-40c7-ac65-56a27fde007a\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-qps6z" May 21 13:03:55.463928 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:55.463832 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bst5m\"" May 21 13:03:55.471439 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:55.471415 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-qps6z" May 21 13:03:55.596762 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:55.596728 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-qps6z"] May 21 13:03:55.600243 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:03:55.600215 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1602ae60_f2e5_40c7_ac65_56a27fde007a.slice/crio-f830cebee1afd036e045695ecf5616b204d6bdea36893b7615f5cb391cb983fe WatchSource:0}: Error finding container f830cebee1afd036e045695ecf5616b204d6bdea36893b7615f5cb391cb983fe: Status 404 returned error can't find the container with id f830cebee1afd036e045695ecf5616b204d6bdea36893b7615f5cb391cb983fe May 21 13:03:56.066055 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:56.066024 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-qps6z" event={"ID":"1602ae60-f2e5-40c7-ac65-56a27fde007a","Type":"ContainerStarted","Data":"f830cebee1afd036e045695ecf5616b204d6bdea36893b7615f5cb391cb983fe"} May 21 13:03:57.069934 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:57.069844 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-qps6z" event={"ID":"1602ae60-f2e5-40c7-ac65-56a27fde007a","Type":"ContainerStarted","Data":"a614065dbff6a56a9c6beda898d8c6212a35b5e738217e1eb87faf1f5a57a769"} May 21 13:03:57.116400 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:03:57.116352 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-qps6z" podStartSLOduration=65.898273376 podStartE2EDuration="1m7.116336536s" podCreationTimestamp="2026-05-21 13:02:50 +0000 UTC" firstStartedPulling="2026-05-21 13:03:55.60206126 +0000 UTC m=+98.456772728" lastFinishedPulling="2026-05-21 13:03:56.820124417 +0000 UTC m=+99.674835888" observedRunningTime="2026-05-21 13:03:57.115292397 +0000 UTC m=+99.970003887" watchObservedRunningTime="2026-05-21 13:03:57.116336536 +0000 UTC m=+99.971048026" May 21 13:04:17.376467 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:17.376404 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" podUID="bfbc7ef9-d45f-495f-95ef-dba579b5dffc" containerName="registry" containerID="cri-o://3b8f83a85783ba490508e5a7dab9f4a4bdddf193ac7b7a7bc68a98952f1750d2" gracePeriod=30 May 21 13:04:17.631157 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:17.631079 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:04:17.739539 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:17.739504 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-bound-sa-token\") pod \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " May 21 13:04:17.739740 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:17.739586 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-trusted-ca\") pod \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " May 21 13:04:17.739740 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:17.739628 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-image-registry-private-configuration\") pod \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " May 21 13:04:17.739846 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:17.739779 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-installation-pull-secrets\") pod \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " May 21 13:04:17.739846 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:17.739817 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-registry-certificates\") pod \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " May 21 13:04:17.739951 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:17.739927 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpn4k\" (UniqueName: \"kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-kube-api-access-hpn4k\") pod \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " May 21 13:04:17.740004 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:17.739985 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-registry-tls\") pod \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " May 21 13:04:17.740055 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:17.740019 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-ca-trust-extracted\") pod \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\" (UID: \"bfbc7ef9-d45f-495f-95ef-dba579b5dffc\") " May 21 13:04:17.740105 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:17.740082 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "bfbc7ef9-d45f-495f-95ef-dba579b5dffc" (UID: "bfbc7ef9-d45f-495f-95ef-dba579b5dffc"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 13:04:17.740207 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:17.740183 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "bfbc7ef9-d45f-495f-95ef-dba579b5dffc" (UID: "bfbc7ef9-d45f-495f-95ef-dba579b5dffc"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 21 13:04:17.740320 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:17.740302 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-trusted-ca\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\"" May 21 13:04:17.742556 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:17.742517 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "bfbc7ef9-d45f-495f-95ef-dba579b5dffc" (UID: "bfbc7ef9-d45f-495f-95ef-dba579b5dffc"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 13:04:17.742735 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:17.742653 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "bfbc7ef9-d45f-495f-95ef-dba579b5dffc" (UID: "bfbc7ef9-d45f-495f-95ef-dba579b5dffc"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 13:04:17.742829 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:17.742801 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "bfbc7ef9-d45f-495f-95ef-dba579b5dffc" (UID: "bfbc7ef9-d45f-495f-95ef-dba579b5dffc"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:04:17.742965 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:17.742875 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "bfbc7ef9-d45f-495f-95ef-dba579b5dffc" (UID: "bfbc7ef9-d45f-495f-95ef-dba579b5dffc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:04:17.742965 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:17.742892 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-kube-api-access-hpn4k" (OuterVolumeSpecName: "kube-api-access-hpn4k") pod "bfbc7ef9-d45f-495f-95ef-dba579b5dffc" (UID: "bfbc7ef9-d45f-495f-95ef-dba579b5dffc"). InnerVolumeSpecName "kube-api-access-hpn4k". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:04:17.758502 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:17.758468 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "bfbc7ef9-d45f-495f-95ef-dba579b5dffc" (UID: "bfbc7ef9-d45f-495f-95ef-dba579b5dffc"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 13:04:17.841447 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:17.841391 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-image-registry-private-configuration\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\"" May 21 13:04:17.841447 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:17.841438 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-installation-pull-secrets\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\"" May 21 13:04:17.841447 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:17.841451 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-registry-certificates\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\"" May 21 13:04:17.841447 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:17.841461 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpn4k\" (UniqueName: \"kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-kube-api-access-hpn4k\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\"" May 21 13:04:17.841752 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:17.841471 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-registry-tls\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\"" May 21 13:04:17.841752 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:17.841481 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-ca-trust-extracted\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\"" May 21 13:04:17.841752 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:17.841489 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bfbc7ef9-d45f-495f-95ef-dba579b5dffc-bound-sa-token\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\"" May 21 13:04:18.124594 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:18.124548 2561 generic.go:358] "Generic (PLEG): container finished" podID="bfbc7ef9-d45f-495f-95ef-dba579b5dffc" containerID="3b8f83a85783ba490508e5a7dab9f4a4bdddf193ac7b7a7bc68a98952f1750d2" exitCode=0 May 21 13:04:18.124764 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:18.124612 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" event={"ID":"bfbc7ef9-d45f-495f-95ef-dba579b5dffc","Type":"ContainerDied","Data":"3b8f83a85783ba490508e5a7dab9f4a4bdddf193ac7b7a7bc68a98952f1750d2"} May 21 13:04:18.124764 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:18.124628 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" May 21 13:04:18.124764 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:18.124657 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-96d5fcb49-fjhxc" event={"ID":"bfbc7ef9-d45f-495f-95ef-dba579b5dffc","Type":"ContainerDied","Data":"8d6ab9fa0bd4c75a83ba36baf51e94b6ab6b8247f190393c4b71a1d780cb494d"} May 21 13:04:18.124764 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:18.124677 2561 scope.go:117] "RemoveContainer" containerID="3b8f83a85783ba490508e5a7dab9f4a4bdddf193ac7b7a7bc68a98952f1750d2" May 21 13:04:18.133465 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:18.133446 2561 scope.go:117] "RemoveContainer" containerID="3b8f83a85783ba490508e5a7dab9f4a4bdddf193ac7b7a7bc68a98952f1750d2" May 21 13:04:18.133702 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:04:18.133685 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b8f83a85783ba490508e5a7dab9f4a4bdddf193ac7b7a7bc68a98952f1750d2\": container with ID starting with 3b8f83a85783ba490508e5a7dab9f4a4bdddf193ac7b7a7bc68a98952f1750d2 not found: ID does not exist" containerID="3b8f83a85783ba490508e5a7dab9f4a4bdddf193ac7b7a7bc68a98952f1750d2" May 21 13:04:18.133753 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:18.133710 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b8f83a85783ba490508e5a7dab9f4a4bdddf193ac7b7a7bc68a98952f1750d2"} err="failed to get container status \"3b8f83a85783ba490508e5a7dab9f4a4bdddf193ac7b7a7bc68a98952f1750d2\": rpc error: code = NotFound desc = could not find container \"3b8f83a85783ba490508e5a7dab9f4a4bdddf193ac7b7a7bc68a98952f1750d2\": container with ID starting with 3b8f83a85783ba490508e5a7dab9f4a4bdddf193ac7b7a7bc68a98952f1750d2 not found: ID does not exist" May 21 13:04:18.147059 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:18.147036 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-96d5fcb49-fjhxc"] May 21 13:04:18.151831 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:18.151812 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-96d5fcb49-fjhxc"] May 21 13:04:19.691300 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:19.691268 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfbc7ef9-d45f-495f-95ef-dba579b5dffc" path="/var/lib/kubelet/pods/bfbc7ef9-d45f-495f-95ef-dba579b5dffc/volumes" May 21 13:04:31.499988 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:31.499944 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" podUID="2effc3cd-50d2-4f44-b393-42875748b504" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 13:04:36.172874 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:36.172783 2561 generic.go:358] "Generic (PLEG): container finished" podID="de80e51e-6c75-4dab-a690-14b4eb31eb99" containerID="cf9d6e02a4629d5bc52dd66a6005674685ca55c974b474db1411abee8cd94da6" exitCode=0 May 21 13:04:36.172874 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:36.172858 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8rd5h" event={"ID":"de80e51e-6c75-4dab-a690-14b4eb31eb99","Type":"ContainerDied","Data":"cf9d6e02a4629d5bc52dd66a6005674685ca55c974b474db1411abee8cd94da6"} May 21 13:04:36.173378 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:36.173246 2561 scope.go:117] "RemoveContainer" containerID="cf9d6e02a4629d5bc52dd66a6005674685ca55c974b474db1411abee8cd94da6" May 21 13:04:37.177004 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:37.176969 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-8rd5h" event={"ID":"de80e51e-6c75-4dab-a690-14b4eb31eb99","Type":"ContainerStarted","Data":"ec696d87b2d134fda6bc31dc073bed3c52ac057614b08a9f0a8e66b746ad6890"} May 21 13:04:38.181058 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:38.181027 2561 generic.go:358] "Generic (PLEG): container finished" podID="a1c588d2-c125-462d-8b87-0e2d37de91ae" containerID="230792d0bec1162ba205a35d1cc7a27e34765025360f0b7c4538f217f9de3440" exitCode=0 May 21 13:04:38.181524 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:38.181092 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hj996" event={"ID":"a1c588d2-c125-462d-8b87-0e2d37de91ae","Type":"ContainerDied","Data":"230792d0bec1162ba205a35d1cc7a27e34765025360f0b7c4538f217f9de3440"} May 21 13:04:38.181524 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:38.181503 2561 scope.go:117] "RemoveContainer" containerID="230792d0bec1162ba205a35d1cc7a27e34765025360f0b7c4538f217f9de3440" May 21 13:04:39.186033 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:39.186001 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-hj996" event={"ID":"a1c588d2-c125-462d-8b87-0e2d37de91ae","Type":"ContainerStarted","Data":"4dff6724b85dd3e5e20e95db7da2e0c8a6d562543adcc8b1d176486995162553"} May 21 13:04:41.499964 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:41.499925 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" podUID="2effc3cd-50d2-4f44-b393-42875748b504" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 13:04:51.499652 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:51.499597 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" podUID="2effc3cd-50d2-4f44-b393-42875748b504" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 21 13:04:51.500242 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:51.499687 2561 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" May 21 13:04:51.500351 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:51.500327 2561 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"d9e68d8ab3a092e9e4880dc21f704217047270bed6844b7221ca563cf52c98fd"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" containerMessage="Container service-proxy failed liveness probe, will be restarted" May 21 13:04:51.500414 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:51.500384 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" podUID="2effc3cd-50d2-4f44-b393-42875748b504" containerName="service-proxy" containerID="cri-o://d9e68d8ab3a092e9e4880dc21f704217047270bed6844b7221ca563cf52c98fd" gracePeriod=30 May 21 13:04:52.222110 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:52.222079 2561 generic.go:358] "Generic (PLEG): container finished" podID="2effc3cd-50d2-4f44-b393-42875748b504" containerID="d9e68d8ab3a092e9e4880dc21f704217047270bed6844b7221ca563cf52c98fd" exitCode=2 May 21 13:04:52.222283 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:52.222117 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" event={"ID":"2effc3cd-50d2-4f44-b393-42875748b504","Type":"ContainerDied","Data":"d9e68d8ab3a092e9e4880dc21f704217047270bed6844b7221ca563cf52c98fd"} May 21 13:04:52.222283 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:04:52.222139 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-d4c884775-k4slt" event={"ID":"2effc3cd-50d2-4f44-b393-42875748b504","Type":"ContainerStarted","Data":"fd0f9cef5385826d1f317da1f0c57a55b3201d1bfb33c353ded4bf646343fcf9"} May 21 13:07:13.951083 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:13.951054 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8545859b7d-zpfhp"] May 21 13:07:13.951483 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:13.951287 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfbc7ef9-d45f-495f-95ef-dba579b5dffc" containerName="registry" May 21 13:07:13.951483 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:13.951301 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfbc7ef9-d45f-495f-95ef-dba579b5dffc" containerName="registry" May 21 13:07:13.951483 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:13.951358 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="bfbc7ef9-d45f-495f-95ef-dba579b5dffc" containerName="registry" May 21 13:07:13.955027 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:13.955010 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zpfhp" May 21 13:07:13.959033 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:13.959013 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 13:07:13.959226 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:13.959210 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2g5gn\"" May 21 13:07:13.959283 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:13.959245 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 13:07:13.959316 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:13.959281 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 13:07:13.959766 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:13.959753 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 13:07:13.984862 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:13.984835 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8545859b7d-zpfhp"] May 21 13:07:14.084139 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:14.084109 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1dc30b58-ad90-4ade-a17d-4be95ce05b0d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8545859b7d-zpfhp\" (UID: \"1dc30b58-ad90-4ade-a17d-4be95ce05b0d\") " pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zpfhp" May 21 13:07:14.084139 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:14.084142 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1dc30b58-ad90-4ade-a17d-4be95ce05b0d-webhook-cert\") pod \"opendatahub-operator-controller-manager-8545859b7d-zpfhp\" (UID: \"1dc30b58-ad90-4ade-a17d-4be95ce05b0d\") " pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zpfhp" May 21 13:07:14.084348 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:14.084242 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5jsd\" (UniqueName: \"kubernetes.io/projected/1dc30b58-ad90-4ade-a17d-4be95ce05b0d-kube-api-access-q5jsd\") pod \"opendatahub-operator-controller-manager-8545859b7d-zpfhp\" (UID: \"1dc30b58-ad90-4ade-a17d-4be95ce05b0d\") " pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zpfhp" May 21 13:07:14.184919 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:14.184882 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q5jsd\" (UniqueName: \"kubernetes.io/projected/1dc30b58-ad90-4ade-a17d-4be95ce05b0d-kube-api-access-q5jsd\") pod \"opendatahub-operator-controller-manager-8545859b7d-zpfhp\" (UID: \"1dc30b58-ad90-4ade-a17d-4be95ce05b0d\") " pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zpfhp" May 21 13:07:14.184919 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:14.184928 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1dc30b58-ad90-4ade-a17d-4be95ce05b0d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8545859b7d-zpfhp\" (UID: \"1dc30b58-ad90-4ade-a17d-4be95ce05b0d\") " pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zpfhp" May 21 13:07:14.185126 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:14.184949 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1dc30b58-ad90-4ade-a17d-4be95ce05b0d-webhook-cert\") pod \"opendatahub-operator-controller-manager-8545859b7d-zpfhp\" (UID: \"1dc30b58-ad90-4ade-a17d-4be95ce05b0d\") " pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zpfhp" May 21 13:07:14.187288 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:14.187262 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1dc30b58-ad90-4ade-a17d-4be95ce05b0d-webhook-cert\") pod \"opendatahub-operator-controller-manager-8545859b7d-zpfhp\" (UID: \"1dc30b58-ad90-4ade-a17d-4be95ce05b0d\") " pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zpfhp" May 21 13:07:14.187389 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:14.187304 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1dc30b58-ad90-4ade-a17d-4be95ce05b0d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8545859b7d-zpfhp\" (UID: \"1dc30b58-ad90-4ade-a17d-4be95ce05b0d\") " pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zpfhp" May 21 13:07:14.198186 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:14.198159 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5jsd\" (UniqueName: \"kubernetes.io/projected/1dc30b58-ad90-4ade-a17d-4be95ce05b0d-kube-api-access-q5jsd\") pod \"opendatahub-operator-controller-manager-8545859b7d-zpfhp\" (UID: \"1dc30b58-ad90-4ade-a17d-4be95ce05b0d\") " pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zpfhp" May 21 13:07:14.264767 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:14.264709 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zpfhp" May 21 13:07:14.386273 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:14.386247 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8545859b7d-zpfhp"] May 21 13:07:14.389050 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:07:14.389025 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dc30b58_ad90_4ade_a17d_4be95ce05b0d.slice/crio-e9a583bc3b56a75dffd8eba328558b1a7f25a113df2694e992f2543d5a3fbeee WatchSource:0}: Error finding container e9a583bc3b56a75dffd8eba328558b1a7f25a113df2694e992f2543d5a3fbeee: Status 404 returned error can't find the container with id e9a583bc3b56a75dffd8eba328558b1a7f25a113df2694e992f2543d5a3fbeee May 21 13:07:14.595306 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:14.595272 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zpfhp" event={"ID":"1dc30b58-ad90-4ade-a17d-4be95ce05b0d","Type":"ContainerStarted","Data":"e9a583bc3b56a75dffd8eba328558b1a7f25a113df2694e992f2543d5a3fbeee"} May 21 13:07:17.594329 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:17.594304 2561 kubelet.go:1628] "Image garbage collection succeeded" May 21 13:07:17.604081 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:17.604053 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zpfhp" event={"ID":"1dc30b58-ad90-4ade-a17d-4be95ce05b0d","Type":"ContainerStarted","Data":"14a53f9646b5085c8b2a63871779f96bca3c323013912dec20eea4a995f1a84a"} May 21 13:07:17.604191 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:17.604171 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zpfhp" May 21 13:07:17.628926 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:17.628801 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zpfhp" podStartSLOduration=2.196846691 podStartE2EDuration="4.628790833s" podCreationTimestamp="2026-05-21 13:07:13 +0000 UTC" firstStartedPulling="2026-05-21 13:07:14.390617006 +0000 UTC m=+297.245328473" lastFinishedPulling="2026-05-21 13:07:16.822561144 +0000 UTC m=+299.677272615" observedRunningTime="2026-05-21 13:07:17.62649129 +0000 UTC m=+300.481202791" watchObservedRunningTime="2026-05-21 13:07:17.628790833 +0000 UTC m=+300.483502321" May 21 13:07:28.609067 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:28.609027 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8545859b7d-zpfhp" May 21 13:07:35.524329 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:35.524294 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-vqnnp"] May 21 13:07:35.527206 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:35.527191 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-vqnnp" May 21 13:07:35.529765 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:35.529727 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" May 21 13:07:35.529874 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:35.529823 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-pkqx6\"" May 21 13:07:35.535492 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:35.535468 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-vqnnp"] May 21 13:07:35.643107 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:35.643074 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc2dr\" (UniqueName: \"kubernetes.io/projected/90cb3c5f-ed98-4e2b-8367-e5b05788e44a-kube-api-access-vc2dr\") pod \"odh-model-controller-858dbf95b8-vqnnp\" (UID: \"90cb3c5f-ed98-4e2b-8367-e5b05788e44a\") " pod="opendatahub/odh-model-controller-858dbf95b8-vqnnp" May 21 13:07:35.643107 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:35.643108 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90cb3c5f-ed98-4e2b-8367-e5b05788e44a-cert\") pod \"odh-model-controller-858dbf95b8-vqnnp\" (UID: \"90cb3c5f-ed98-4e2b-8367-e5b05788e44a\") " pod="opendatahub/odh-model-controller-858dbf95b8-vqnnp" May 21 13:07:35.744512 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:35.744466 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vc2dr\" (UniqueName: \"kubernetes.io/projected/90cb3c5f-ed98-4e2b-8367-e5b05788e44a-kube-api-access-vc2dr\") pod \"odh-model-controller-858dbf95b8-vqnnp\" (UID: \"90cb3c5f-ed98-4e2b-8367-e5b05788e44a\") " pod="opendatahub/odh-model-controller-858dbf95b8-vqnnp" May 21 13:07:35.744512 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:35.744511 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90cb3c5f-ed98-4e2b-8367-e5b05788e44a-cert\") pod \"odh-model-controller-858dbf95b8-vqnnp\" (UID: \"90cb3c5f-ed98-4e2b-8367-e5b05788e44a\") " pod="opendatahub/odh-model-controller-858dbf95b8-vqnnp" May 21 13:07:35.744749 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:07:35.744641 2561 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 21 13:07:35.744749 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:07:35.744697 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90cb3c5f-ed98-4e2b-8367-e5b05788e44a-cert podName:90cb3c5f-ed98-4e2b-8367-e5b05788e44a nodeName:}" failed. No retries permitted until 2026-05-21 13:07:36.244679549 +0000 UTC m=+319.099391018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/90cb3c5f-ed98-4e2b-8367-e5b05788e44a-cert") pod "odh-model-controller-858dbf95b8-vqnnp" (UID: "90cb3c5f-ed98-4e2b-8367-e5b05788e44a") : secret "odh-model-controller-webhook-cert" not found May 21 13:07:35.753280 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:35.753249 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc2dr\" (UniqueName: \"kubernetes.io/projected/90cb3c5f-ed98-4e2b-8367-e5b05788e44a-kube-api-access-vc2dr\") pod \"odh-model-controller-858dbf95b8-vqnnp\" (UID: \"90cb3c5f-ed98-4e2b-8367-e5b05788e44a\") " pod="opendatahub/odh-model-controller-858dbf95b8-vqnnp" May 21 13:07:36.249827 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:36.249793 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90cb3c5f-ed98-4e2b-8367-e5b05788e44a-cert\") pod \"odh-model-controller-858dbf95b8-vqnnp\" (UID: \"90cb3c5f-ed98-4e2b-8367-e5b05788e44a\") " pod="opendatahub/odh-model-controller-858dbf95b8-vqnnp" May 21 13:07:36.252114 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:36.252086 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90cb3c5f-ed98-4e2b-8367-e5b05788e44a-cert\") pod \"odh-model-controller-858dbf95b8-vqnnp\" (UID: \"90cb3c5f-ed98-4e2b-8367-e5b05788e44a\") " pod="opendatahub/odh-model-controller-858dbf95b8-vqnnp" May 21 13:07:36.437340 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:36.437300 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-vqnnp" May 21 13:07:36.574977 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:36.574953 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-vqnnp"] May 21 13:07:36.578016 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:07:36.577974 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90cb3c5f_ed98_4e2b_8367_e5b05788e44a.slice/crio-cbd5c5bd3a384ea700eded96f9334cf9373febf8a5df80df85705038934c4b94 WatchSource:0}: Error finding container cbd5c5bd3a384ea700eded96f9334cf9373febf8a5df80df85705038934c4b94: Status 404 returned error can't find the container with id cbd5c5bd3a384ea700eded96f9334cf9373febf8a5df80df85705038934c4b94 May 21 13:07:36.579402 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:36.579380 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 13:07:36.660753 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:36.660715 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-vqnnp" event={"ID":"90cb3c5f-ed98-4e2b-8367-e5b05788e44a","Type":"ContainerStarted","Data":"cbd5c5bd3a384ea700eded96f9334cf9373febf8a5df80df85705038934c4b94"} May 21 13:07:39.671423 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:39.671385 2561 generic.go:358] "Generic (PLEG): container finished" podID="90cb3c5f-ed98-4e2b-8367-e5b05788e44a" containerID="4245743fc06cd7a279e20dbbd9f455d91727afc8eff5ab924114e4e396541da9" exitCode=1 May 21 13:07:39.671876 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:39.671484 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-vqnnp" event={"ID":"90cb3c5f-ed98-4e2b-8367-e5b05788e44a","Type":"ContainerDied","Data":"4245743fc06cd7a279e20dbbd9f455d91727afc8eff5ab924114e4e396541da9"} May 21 13:07:39.671876 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:39.671732 2561 scope.go:117] "RemoveContainer" containerID="4245743fc06cd7a279e20dbbd9f455d91727afc8eff5ab924114e4e396541da9" May 21 13:07:40.676758 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:40.676722 2561 generic.go:358] "Generic (PLEG): container finished" podID="90cb3c5f-ed98-4e2b-8367-e5b05788e44a" containerID="caf8977958154ff6d872c28fcd8c9aab353414caada28bea420eb6c69a32d971" exitCode=1 May 21 13:07:40.677150 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:40.676777 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-vqnnp" event={"ID":"90cb3c5f-ed98-4e2b-8367-e5b05788e44a","Type":"ContainerDied","Data":"caf8977958154ff6d872c28fcd8c9aab353414caada28bea420eb6c69a32d971"} May 21 13:07:40.677150 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:40.676813 2561 scope.go:117] "RemoveContainer" containerID="4245743fc06cd7a279e20dbbd9f455d91727afc8eff5ab924114e4e396541da9" May 21 13:07:40.677150 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:40.677065 2561 scope.go:117] "RemoveContainer" containerID="caf8977958154ff6d872c28fcd8c9aab353414caada28bea420eb6c69a32d971" May 21 13:07:40.677271 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:07:40.677234 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-vqnnp_opendatahub(90cb3c5f-ed98-4e2b-8367-e5b05788e44a)\"" pod="opendatahub/odh-model-controller-858dbf95b8-vqnnp" podUID="90cb3c5f-ed98-4e2b-8367-e5b05788e44a" May 21 13:07:41.183478 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:41.183445 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-nmsvn"] May 21 13:07:41.187607 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:41.187589 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-nmsvn" May 21 13:07:41.190890 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:41.190860 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-2wc58\"" May 21 13:07:41.191026 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:41.191007 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" May 21 13:07:41.201793 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:41.201767 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-nmsvn"] May 21 13:07:41.293876 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:41.293842 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r4j2\" (UniqueName: \"kubernetes.io/projected/df26c505-ad27-46e2-beb7-72478f31795c-kube-api-access-5r4j2\") pod \"kserve-controller-manager-856948b99f-nmsvn\" (UID: \"df26c505-ad27-46e2-beb7-72478f31795c\") " pod="opendatahub/kserve-controller-manager-856948b99f-nmsvn" May 21 13:07:41.293876 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:41.293879 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df26c505-ad27-46e2-beb7-72478f31795c-cert\") pod \"kserve-controller-manager-856948b99f-nmsvn\" (UID: \"df26c505-ad27-46e2-beb7-72478f31795c\") " pod="opendatahub/kserve-controller-manager-856948b99f-nmsvn" May 21 13:07:41.395139 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:41.395104 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5r4j2\" (UniqueName: \"kubernetes.io/projected/df26c505-ad27-46e2-beb7-72478f31795c-kube-api-access-5r4j2\") pod \"kserve-controller-manager-856948b99f-nmsvn\" (UID: \"df26c505-ad27-46e2-beb7-72478f31795c\") " pod="opendatahub/kserve-controller-manager-856948b99f-nmsvn" May 21 13:07:41.395291 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:41.395155 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df26c505-ad27-46e2-beb7-72478f31795c-cert\") pod \"kserve-controller-manager-856948b99f-nmsvn\" (UID: \"df26c505-ad27-46e2-beb7-72478f31795c\") " pod="opendatahub/kserve-controller-manager-856948b99f-nmsvn" May 21 13:07:41.395291 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:07:41.395265 2561 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found May 21 13:07:41.395365 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:07:41.395319 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df26c505-ad27-46e2-beb7-72478f31795c-cert podName:df26c505-ad27-46e2-beb7-72478f31795c nodeName:}" failed. No retries permitted until 2026-05-21 13:07:41.895302964 +0000 UTC m=+324.750014432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/df26c505-ad27-46e2-beb7-72478f31795c-cert") pod "kserve-controller-manager-856948b99f-nmsvn" (UID: "df26c505-ad27-46e2-beb7-72478f31795c") : secret "kserve-webhook-server-cert" not found May 21 13:07:41.408319 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:41.408284 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r4j2\" (UniqueName: \"kubernetes.io/projected/df26c505-ad27-46e2-beb7-72478f31795c-kube-api-access-5r4j2\") pod \"kserve-controller-manager-856948b99f-nmsvn\" (UID: \"df26c505-ad27-46e2-beb7-72478f31795c\") " pod="opendatahub/kserve-controller-manager-856948b99f-nmsvn" May 21 13:07:41.680764 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:41.680735 2561 scope.go:117] "RemoveContainer" containerID="caf8977958154ff6d872c28fcd8c9aab353414caada28bea420eb6c69a32d971" May 21 13:07:41.681206 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:07:41.680959 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-vqnnp_opendatahub(90cb3c5f-ed98-4e2b-8367-e5b05788e44a)\"" pod="opendatahub/odh-model-controller-858dbf95b8-vqnnp" podUID="90cb3c5f-ed98-4e2b-8367-e5b05788e44a" May 21 13:07:41.900121 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:41.900083 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df26c505-ad27-46e2-beb7-72478f31795c-cert\") pod \"kserve-controller-manager-856948b99f-nmsvn\" (UID: \"df26c505-ad27-46e2-beb7-72478f31795c\") " pod="opendatahub/kserve-controller-manager-856948b99f-nmsvn" May 21 13:07:41.902564 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:41.902537 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df26c505-ad27-46e2-beb7-72478f31795c-cert\") pod \"kserve-controller-manager-856948b99f-nmsvn\" (UID: \"df26c505-ad27-46e2-beb7-72478f31795c\") " pod="opendatahub/kserve-controller-manager-856948b99f-nmsvn" May 21 13:07:42.098863 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:42.098820 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-nmsvn" May 21 13:07:42.244923 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:42.244894 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-nmsvn"] May 21 13:07:42.248218 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:07:42.248197 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf26c505_ad27_46e2_beb7_72478f31795c.slice/crio-f93a1da0da8b2af619575aee1673cdcc716827d53128785a3b482043fed7f9c3 WatchSource:0}: Error finding container f93a1da0da8b2af619575aee1673cdcc716827d53128785a3b482043fed7f9c3: Status 404 returned error can't find the container with id f93a1da0da8b2af619575aee1673cdcc716827d53128785a3b482043fed7f9c3 May 21 13:07:42.684146 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:42.684110 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-nmsvn" event={"ID":"df26c505-ad27-46e2-beb7-72478f31795c","Type":"ContainerStarted","Data":"f93a1da0da8b2af619575aee1673cdcc716827d53128785a3b482043fed7f9c3"} May 21 13:07:43.243701 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:43.243669 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-577646db99-xxhxc"] May 21 13:07:43.246840 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:43.246815 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-577646db99-xxhxc" May 21 13:07:43.249824 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:43.249801 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 21 13:07:43.249824 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:43.249816 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 21 13:07:43.250250 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:43.250229 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-j5l9h\"" May 21 13:07:43.251231 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:43.251212 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 13:07:43.251317 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:43.251242 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 13:07:43.277917 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:43.277892 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-577646db99-xxhxc"] May 21 13:07:43.312980 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:43.312950 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e31e2dd5-b7fd-437f-8a85-a4e9f4a1536b-tmp\") pod \"kube-auth-proxy-577646db99-xxhxc\" (UID: \"e31e2dd5-b7fd-437f-8a85-a4e9f4a1536b\") " pod="openshift-ingress/kube-auth-proxy-577646db99-xxhxc" May 21 13:07:43.313125 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:43.312997 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrhsl\" (UniqueName: \"kubernetes.io/projected/e31e2dd5-b7fd-437f-8a85-a4e9f4a1536b-kube-api-access-vrhsl\") pod \"kube-auth-proxy-577646db99-xxhxc\" (UID: \"e31e2dd5-b7fd-437f-8a85-a4e9f4a1536b\") " pod="openshift-ingress/kube-auth-proxy-577646db99-xxhxc" May 21 13:07:43.313125 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:43.313051 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e31e2dd5-b7fd-437f-8a85-a4e9f4a1536b-tls-certs\") pod \"kube-auth-proxy-577646db99-xxhxc\" (UID: \"e31e2dd5-b7fd-437f-8a85-a4e9f4a1536b\") " pod="openshift-ingress/kube-auth-proxy-577646db99-xxhxc" May 21 13:07:43.413757 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:43.413712 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vrhsl\" (UniqueName: \"kubernetes.io/projected/e31e2dd5-b7fd-437f-8a85-a4e9f4a1536b-kube-api-access-vrhsl\") pod \"kube-auth-proxy-577646db99-xxhxc\" (UID: \"e31e2dd5-b7fd-437f-8a85-a4e9f4a1536b\") " pod="openshift-ingress/kube-auth-proxy-577646db99-xxhxc" May 21 13:07:43.413955 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:43.413797 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e31e2dd5-b7fd-437f-8a85-a4e9f4a1536b-tls-certs\") pod \"kube-auth-proxy-577646db99-xxhxc\" (UID: \"e31e2dd5-b7fd-437f-8a85-a4e9f4a1536b\") " pod="openshift-ingress/kube-auth-proxy-577646db99-xxhxc" May 21 13:07:43.413955 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:43.413916 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e31e2dd5-b7fd-437f-8a85-a4e9f4a1536b-tmp\") pod \"kube-auth-proxy-577646db99-xxhxc\" (UID: \"e31e2dd5-b7fd-437f-8a85-a4e9f4a1536b\") " pod="openshift-ingress/kube-auth-proxy-577646db99-xxhxc" May 21 13:07:43.416146 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:43.416122 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e31e2dd5-b7fd-437f-8a85-a4e9f4a1536b-tmp\") pod \"kube-auth-proxy-577646db99-xxhxc\" (UID: \"e31e2dd5-b7fd-437f-8a85-a4e9f4a1536b\") " pod="openshift-ingress/kube-auth-proxy-577646db99-xxhxc" May 21 13:07:43.416282 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:43.416263 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e31e2dd5-b7fd-437f-8a85-a4e9f4a1536b-tls-certs\") pod \"kube-auth-proxy-577646db99-xxhxc\" (UID: \"e31e2dd5-b7fd-437f-8a85-a4e9f4a1536b\") " pod="openshift-ingress/kube-auth-proxy-577646db99-xxhxc" May 21 13:07:43.422169 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:43.422146 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrhsl\" (UniqueName: \"kubernetes.io/projected/e31e2dd5-b7fd-437f-8a85-a4e9f4a1536b-kube-api-access-vrhsl\") pod \"kube-auth-proxy-577646db99-xxhxc\" (UID: \"e31e2dd5-b7fd-437f-8a85-a4e9f4a1536b\") " pod="openshift-ingress/kube-auth-proxy-577646db99-xxhxc" May 21 13:07:43.556471 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:43.556388 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-577646db99-xxhxc" May 21 13:07:43.690758 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:07:43.690725 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode31e2dd5_b7fd_437f_8a85_a4e9f4a1536b.slice/crio-1e7b60794d61c7ba1d4bc1f43fdd68e187d5f9dc86d1e450159b1c3a247f3a76 WatchSource:0}: Error finding container 1e7b60794d61c7ba1d4bc1f43fdd68e187d5f9dc86d1e450159b1c3a247f3a76: Status 404 returned error can't find the container with id 1e7b60794d61c7ba1d4bc1f43fdd68e187d5f9dc86d1e450159b1c3a247f3a76 May 21 13:07:43.692615 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:43.692561 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-577646db99-xxhxc"] May 21 13:07:44.693766 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:44.693728 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-577646db99-xxhxc" event={"ID":"e31e2dd5-b7fd-437f-8a85-a4e9f4a1536b","Type":"ContainerStarted","Data":"1e7b60794d61c7ba1d4bc1f43fdd68e187d5f9dc86d1e450159b1c3a247f3a76"} May 21 13:07:46.437935 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:46.437843 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-vqnnp" May 21 13:07:46.438373 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:46.438357 2561 scope.go:117] "RemoveContainer" containerID="caf8977958154ff6d872c28fcd8c9aab353414caada28bea420eb6c69a32d971" May 21 13:07:46.438630 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:07:46.438600 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-vqnnp_opendatahub(90cb3c5f-ed98-4e2b-8367-e5b05788e44a)\"" pod="opendatahub/odh-model-controller-858dbf95b8-vqnnp" podUID="90cb3c5f-ed98-4e2b-8367-e5b05788e44a" May 21 13:07:46.701616 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:46.701512 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-nmsvn" event={"ID":"df26c505-ad27-46e2-beb7-72478f31795c","Type":"ContainerStarted","Data":"8f0e183f8989fe0bff3ba145319db8597a672ed3b229e622130001186f6650f2"} May 21 13:07:46.701772 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:46.701690 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-nmsvn" May 21 13:07:46.723114 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:46.723059 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-nmsvn" podStartSLOduration=1.84625188 podStartE2EDuration="5.723039871s" podCreationTimestamp="2026-05-21 13:07:41 +0000 UTC" firstStartedPulling="2026-05-21 13:07:42.251680635 +0000 UTC m=+325.106392102" lastFinishedPulling="2026-05-21 13:07:46.128468611 +0000 UTC m=+328.983180093" observedRunningTime="2026-05-21 13:07:46.720399996 +0000 UTC m=+329.575111484" watchObservedRunningTime="2026-05-21 13:07:46.723039871 +0000 UTC m=+329.577751363" May 21 13:07:47.705179 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:47.705146 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-577646db99-xxhxc" event={"ID":"e31e2dd5-b7fd-437f-8a85-a4e9f4a1536b","Type":"ContainerStarted","Data":"8c35e9cbe0897d7e41e5bae11178d6e6ce77f5ad3b1f74507d48061acef14649"} May 21 13:07:47.724163 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:47.724115 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-577646db99-xxhxc" podStartSLOduration=1.418578339 podStartE2EDuration="4.72410237s" podCreationTimestamp="2026-05-21 13:07:43 +0000 UTC" firstStartedPulling="2026-05-21 13:07:43.692799046 +0000 UTC m=+326.547510514" lastFinishedPulling="2026-05-21 13:07:46.998323078 +0000 UTC m=+329.853034545" observedRunningTime="2026-05-21 13:07:47.723742195 +0000 UTC m=+330.578453682" watchObservedRunningTime="2026-05-21 13:07:47.72410237 +0000 UTC m=+330.578813892" May 21 13:07:56.437762 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:56.437725 2561 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-vqnnp" May 21 13:07:56.438176 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:56.438102 2561 scope.go:117] "RemoveContainer" containerID="caf8977958154ff6d872c28fcd8c9aab353414caada28bea420eb6c69a32d971" May 21 13:07:57.733531 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:57.733488 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-vqnnp" event={"ID":"90cb3c5f-ed98-4e2b-8367-e5b05788e44a","Type":"ContainerStarted","Data":"5fe18e1e4c01016b00c07bdf647226cce35f43ed5a4788f03c3ba0ecce392562"} May 21 13:07:57.734384 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:57.734356 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-vqnnp" May 21 13:07:57.759051 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:57.759010 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-vqnnp" podStartSLOduration=2.625052222 podStartE2EDuration="22.758999364s" podCreationTimestamp="2026-05-21 13:07:35 +0000 UTC" firstStartedPulling="2026-05-21 13:07:36.579560824 +0000 UTC m=+319.434272295" lastFinishedPulling="2026-05-21 13:07:56.713507965 +0000 UTC m=+339.568219437" observedRunningTime="2026-05-21 13:07:57.757299311 +0000 UTC m=+340.612010799" watchObservedRunningTime="2026-05-21 13:07:57.758999364 +0000 UTC m=+340.613710853" May 21 13:07:58.332944 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:58.332912 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-bpnnk"] May 21 13:07:58.335862 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:58.335844 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-bpnnk" May 21 13:07:58.340637 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:58.340607 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" May 21 13:07:58.340756 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:58.340707 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" May 21 13:07:58.340818 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:58.340761 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-pqhcf\"" May 21 13:07:58.357778 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:58.357754 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-bpnnk"] May 21 13:07:58.433365 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:58.433329 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/cf64d41c-b5a0-41eb-b99a-e92235636c79-operator-config\") pod \"servicemesh-operator3-55f49c5f94-bpnnk\" (UID: \"cf64d41c-b5a0-41eb-b99a-e92235636c79\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-bpnnk" May 21 13:07:58.433509 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:58.433462 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtnpd\" (UniqueName: \"kubernetes.io/projected/cf64d41c-b5a0-41eb-b99a-e92235636c79-kube-api-access-wtnpd\") pod \"servicemesh-operator3-55f49c5f94-bpnnk\" (UID: \"cf64d41c-b5a0-41eb-b99a-e92235636c79\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-bpnnk" May 21 13:07:58.534047 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:58.534017 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/cf64d41c-b5a0-41eb-b99a-e92235636c79-operator-config\") pod \"servicemesh-operator3-55f49c5f94-bpnnk\" (UID: \"cf64d41c-b5a0-41eb-b99a-e92235636c79\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-bpnnk" May 21 13:07:58.534163 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:58.534058 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wtnpd\" (UniqueName: \"kubernetes.io/projected/cf64d41c-b5a0-41eb-b99a-e92235636c79-kube-api-access-wtnpd\") pod \"servicemesh-operator3-55f49c5f94-bpnnk\" (UID: \"cf64d41c-b5a0-41eb-b99a-e92235636c79\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-bpnnk" May 21 13:07:58.536383 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:58.536358 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/cf64d41c-b5a0-41eb-b99a-e92235636c79-operator-config\") pod \"servicemesh-operator3-55f49c5f94-bpnnk\" (UID: \"cf64d41c-b5a0-41eb-b99a-e92235636c79\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-bpnnk" May 21 13:07:58.543531 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:58.543508 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtnpd\" (UniqueName: \"kubernetes.io/projected/cf64d41c-b5a0-41eb-b99a-e92235636c79-kube-api-access-wtnpd\") pod \"servicemesh-operator3-55f49c5f94-bpnnk\" (UID: \"cf64d41c-b5a0-41eb-b99a-e92235636c79\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-bpnnk" May 21 13:07:58.644845 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:58.644822 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-bpnnk" May 21 13:07:58.791724 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:58.791626 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-bpnnk"] May 21 13:07:58.794543 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:07:58.794510 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf64d41c_b5a0_41eb_b99a_e92235636c79.slice/crio-605425e45b697e78959bd72b1f7ae5fce207db2602e9e65272fc4207eb9699b5 WatchSource:0}: Error finding container 605425e45b697e78959bd72b1f7ae5fce207db2602e9e65272fc4207eb9699b5: Status 404 returned error can't find the container with id 605425e45b697e78959bd72b1f7ae5fce207db2602e9e65272fc4207eb9699b5 May 21 13:07:59.740281 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:07:59.740241 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-bpnnk" event={"ID":"cf64d41c-b5a0-41eb-b99a-e92235636c79","Type":"ContainerStarted","Data":"605425e45b697e78959bd72b1f7ae5fce207db2602e9e65272fc4207eb9699b5"} May 21 13:08:02.751754 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:02.751713 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-bpnnk" event={"ID":"cf64d41c-b5a0-41eb-b99a-e92235636c79","Type":"ContainerStarted","Data":"142c4ed09f14d3be4af98fe6a9430d68c5a6436fbb139ab84df08d3e6c03ad35"} May 21 13:08:02.752138 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:02.751825 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-bpnnk" May 21 13:08:02.774685 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:02.774556 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-bpnnk" podStartSLOduration=1.519614903 podStartE2EDuration="4.774542548s" podCreationTimestamp="2026-05-21 13:07:58 +0000 UTC" firstStartedPulling="2026-05-21 13:07:58.797502984 +0000 UTC m=+341.652214452" lastFinishedPulling="2026-05-21 13:08:02.052430627 +0000 UTC m=+344.907142097" observedRunningTime="2026-05-21 13:08:02.773885582 +0000 UTC m=+345.628597073" watchObservedRunningTime="2026-05-21 13:08:02.774542548 +0000 UTC m=+345.629254039" May 21 13:08:08.738631 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:08.738504 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-vqnnp" May 21 13:08:13.756845 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:13.756819 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-bpnnk" May 21 13:08:14.863240 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:14.863211 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d"] May 21 13:08:14.867339 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:14.867319 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d" May 21 13:08:14.869132 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:14.869107 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5fddc3ec-0e00-4816-b929-8e958b4a4396-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-rjv2d\" (UID: \"5fddc3ec-0e00-4816-b929-8e958b4a4396\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d" May 21 13:08:14.869217 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:14.869159 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fddc3ec-0e00-4816-b929-8e958b4a4396-istio-token\") pod \"istiod-openshift-gateway-798958bb55-rjv2d\" (UID: \"5fddc3ec-0e00-4816-b929-8e958b4a4396\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d" May 21 13:08:14.869217 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:14.869186 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5fddc3ec-0e00-4816-b929-8e958b4a4396-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-rjv2d\" (UID: \"5fddc3ec-0e00-4816-b929-8e958b4a4396\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d" May 21 13:08:14.869312 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:14.869216 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fddc3ec-0e00-4816-b929-8e958b4a4396-local-certs\") pod \"istiod-openshift-gateway-798958bb55-rjv2d\" (UID: \"5fddc3ec-0e00-4816-b929-8e958b4a4396\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d" May 21 13:08:14.869312 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:14.869240 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qncrl\" (UniqueName: \"kubernetes.io/projected/5fddc3ec-0e00-4816-b929-8e958b4a4396-kube-api-access-qncrl\") pod \"istiod-openshift-gateway-798958bb55-rjv2d\" (UID: \"5fddc3ec-0e00-4816-b929-8e958b4a4396\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d" May 21 13:08:14.869427 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:14.869318 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5fddc3ec-0e00-4816-b929-8e958b4a4396-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-rjv2d\" (UID: \"5fddc3ec-0e00-4816-b929-8e958b4a4396\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d" May 21 13:08:14.869427 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:14.869343 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5fddc3ec-0e00-4816-b929-8e958b4a4396-cacerts\") pod \"istiod-openshift-gateway-798958bb55-rjv2d\" (UID: \"5fddc3ec-0e00-4816-b929-8e958b4a4396\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d" May 21 13:08:14.884856 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:14.884829 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" May 21 13:08:14.885145 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:14.885129 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 21 13:08:14.886315 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:14.886302 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" May 21 13:08:14.886394 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:14.886322 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" May 21 13:08:14.887591 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:14.887576 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-4m5rl\"" May 21 13:08:14.915631 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:14.915608 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d"] May 21 13:08:14.970306 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:14.970277 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5fddc3ec-0e00-4816-b929-8e958b4a4396-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-rjv2d\" (UID: \"5fddc3ec-0e00-4816-b929-8e958b4a4396\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d" May 21 13:08:14.970414 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:14.970311 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5fddc3ec-0e00-4816-b929-8e958b4a4396-cacerts\") pod \"istiod-openshift-gateway-798958bb55-rjv2d\" (UID: \"5fddc3ec-0e00-4816-b929-8e958b4a4396\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d" May 21 13:08:14.970414 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:14.970362 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5fddc3ec-0e00-4816-b929-8e958b4a4396-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-rjv2d\" (UID: \"5fddc3ec-0e00-4816-b929-8e958b4a4396\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d" May 21 13:08:14.970414 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:14.970407 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fddc3ec-0e00-4816-b929-8e958b4a4396-istio-token\") pod \"istiod-openshift-gateway-798958bb55-rjv2d\" (UID: \"5fddc3ec-0e00-4816-b929-8e958b4a4396\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d" May 21 13:08:14.970552 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:14.970461 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5fddc3ec-0e00-4816-b929-8e958b4a4396-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-rjv2d\" (UID: \"5fddc3ec-0e00-4816-b929-8e958b4a4396\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d" May 21 13:08:14.970552 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:14.970513 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fddc3ec-0e00-4816-b929-8e958b4a4396-local-certs\") pod \"istiod-openshift-gateway-798958bb55-rjv2d\" (UID: \"5fddc3ec-0e00-4816-b929-8e958b4a4396\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d" May 21 13:08:14.970552 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:14.970542 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qncrl\" (UniqueName: \"kubernetes.io/projected/5fddc3ec-0e00-4816-b929-8e958b4a4396-kube-api-access-qncrl\") pod \"istiod-openshift-gateway-798958bb55-rjv2d\" (UID: \"5fddc3ec-0e00-4816-b929-8e958b4a4396\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d" May 21 13:08:14.971233 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:14.971213 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5fddc3ec-0e00-4816-b929-8e958b4a4396-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-rjv2d\" (UID: \"5fddc3ec-0e00-4816-b929-8e958b4a4396\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d" May 21 13:08:14.972837 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:14.972812 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5fddc3ec-0e00-4816-b929-8e958b4a4396-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-rjv2d\" (UID: \"5fddc3ec-0e00-4816-b929-8e958b4a4396\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d" May 21 13:08:14.972939 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:14.972878 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5fddc3ec-0e00-4816-b929-8e958b4a4396-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-rjv2d\" (UID: \"5fddc3ec-0e00-4816-b929-8e958b4a4396\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d" May 21 13:08:14.972998 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:14.972973 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fddc3ec-0e00-4816-b929-8e958b4a4396-local-certs\") pod \"istiod-openshift-gateway-798958bb55-rjv2d\" (UID: \"5fddc3ec-0e00-4816-b929-8e958b4a4396\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d" May 21 13:08:14.973117 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:14.973101 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5fddc3ec-0e00-4816-b929-8e958b4a4396-cacerts\") pod \"istiod-openshift-gateway-798958bb55-rjv2d\" (UID: \"5fddc3ec-0e00-4816-b929-8e958b4a4396\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d" May 21 13:08:14.987766 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:14.987747 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fddc3ec-0e00-4816-b929-8e958b4a4396-istio-token\") pod \"istiod-openshift-gateway-798958bb55-rjv2d\" (UID: \"5fddc3ec-0e00-4816-b929-8e958b4a4396\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d" May 21 13:08:14.990611 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:14.990561 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qncrl\" (UniqueName: \"kubernetes.io/projected/5fddc3ec-0e00-4816-b929-8e958b4a4396-kube-api-access-qncrl\") pod \"istiod-openshift-gateway-798958bb55-rjv2d\" (UID: \"5fddc3ec-0e00-4816-b929-8e958b4a4396\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d" May 21 13:08:15.176351 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:15.176275 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d" May 21 13:08:15.326715 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:15.326690 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d"] May 21 13:08:15.329541 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:08:15.329514 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fddc3ec_0e00_4816_b929_8e958b4a4396.slice/crio-0754655db71dbd8cf4eb2f58d3d6be53d4aaa2449ddf2a645809a1f1336d72e5 WatchSource:0}: Error finding container 0754655db71dbd8cf4eb2f58d3d6be53d4aaa2449ddf2a645809a1f1336d72e5: Status 404 returned error can't find the container with id 0754655db71dbd8cf4eb2f58d3d6be53d4aaa2449ddf2a645809a1f1336d72e5 May 21 13:08:15.792626 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:15.792561 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d" event={"ID":"5fddc3ec-0e00-4816-b929-8e958b4a4396","Type":"ContainerStarted","Data":"0754655db71dbd8cf4eb2f58d3d6be53d4aaa2449ddf2a645809a1f1336d72e5"} May 21 13:08:17.711213 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:17.711184 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-nmsvn" May 21 13:08:17.899582 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:17.899525 2561 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 13:08:17.899702 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:17.899604 2561 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 13:08:18.805048 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:18.805014 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d" event={"ID":"5fddc3ec-0e00-4816-b929-8e958b4a4396","Type":"ContainerStarted","Data":"5111cedb3a1121efdd28d7d03eed192dfa8f66ad24d3d4d889acb742d9802507"} May 21 13:08:18.805536 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:18.805231 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d" May 21 13:08:18.807005 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:18.806971 2561 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-rjv2d container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= May 21 13:08:18.807133 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:18.807024 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d" podUID="5fddc3ec-0e00-4816-b929-8e958b4a4396" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 21 13:08:18.876050 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:18.876006 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d" podStartSLOduration=2.308089698 podStartE2EDuration="4.875992855s" podCreationTimestamp="2026-05-21 13:08:14 +0000 UTC" firstStartedPulling="2026-05-21 13:08:15.331418527 +0000 UTC m=+358.186129994" lastFinishedPulling="2026-05-21 13:08:17.899321681 +0000 UTC m=+360.754033151" observedRunningTime="2026-05-21 13:08:18.872224689 +0000 UTC m=+361.726936177" watchObservedRunningTime="2026-05-21 13:08:18.875992855 +0000 UTC m=+361.730704343" May 21 13:08:19.808854 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:08:19.808823 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rjv2d" May 21 13:09:04.913667 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:04.913631 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xbh57"] May 21 13:09:04.925346 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:04.925315 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xbh57" May 21 13:09:04.932138 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:04.932114 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 13:09:04.933393 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:04.933361 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 13:09:04.933495 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:04.933460 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-75ntr\"" May 21 13:09:04.945794 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:04.945768 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xbh57"] May 21 13:09:05.060651 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:05.060614 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dn9t\" (UniqueName: \"kubernetes.io/projected/cea01841-c627-4f5f-bf05-ae315d507482-kube-api-access-2dn9t\") pod \"limitador-operator-controller-manager-85c4996f8c-xbh57\" (UID: \"cea01841-c627-4f5f-bf05-ae315d507482\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xbh57" May 21 13:09:05.162032 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:05.161999 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2dn9t\" (UniqueName: \"kubernetes.io/projected/cea01841-c627-4f5f-bf05-ae315d507482-kube-api-access-2dn9t\") pod \"limitador-operator-controller-manager-85c4996f8c-xbh57\" (UID: \"cea01841-c627-4f5f-bf05-ae315d507482\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xbh57" May 21 13:09:05.171039 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:05.170983 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dn9t\" (UniqueName: \"kubernetes.io/projected/cea01841-c627-4f5f-bf05-ae315d507482-kube-api-access-2dn9t\") pod \"limitador-operator-controller-manager-85c4996f8c-xbh57\" (UID: \"cea01841-c627-4f5f-bf05-ae315d507482\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xbh57" May 21 13:09:05.234898 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:05.234877 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xbh57" May 21 13:09:05.367536 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:05.367500 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xbh57"] May 21 13:09:05.371041 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:09:05.371013 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcea01841_c627_4f5f_bf05_ae315d507482.slice/crio-6a4480186d9787705104a632af640dcf463be8380a94296cc4da117c12d0df13 WatchSource:0}: Error finding container 6a4480186d9787705104a632af640dcf463be8380a94296cc4da117c12d0df13: Status 404 returned error can't find the container with id 6a4480186d9787705104a632af640dcf463be8380a94296cc4da117c12d0df13 May 21 13:09:05.948477 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:05.948443 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xbh57" event={"ID":"cea01841-c627-4f5f-bf05-ae315d507482","Type":"ContainerStarted","Data":"6a4480186d9787705104a632af640dcf463be8380a94296cc4da117c12d0df13"} May 21 13:09:07.956372 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:07.956335 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xbh57" event={"ID":"cea01841-c627-4f5f-bf05-ae315d507482","Type":"ContainerStarted","Data":"4e8c72f8ac8746b35f198c9a187ab7e692400fb4b0e8a1812c02fb8bb31e8e33"} May 21 13:09:07.956781 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:07.956455 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xbh57" May 21 13:09:07.978920 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:07.978873 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xbh57" podStartSLOduration=1.874381039 podStartE2EDuration="3.978859425s" podCreationTimestamp="2026-05-21 13:09:04 +0000 UTC" firstStartedPulling="2026-05-21 13:09:05.372918627 +0000 UTC m=+408.227630094" lastFinishedPulling="2026-05-21 13:09:07.477396994 +0000 UTC m=+410.332108480" observedRunningTime="2026-05-21 13:09:07.977391962 +0000 UTC m=+410.832103452" watchObservedRunningTime="2026-05-21 13:09:07.978859425 +0000 UTC m=+410.833570914" May 21 13:09:16.758433 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:16.758399 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2"] May 21 13:09:16.760469 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:16.760453 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2" May 21 13:09:16.767289 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:16.767272 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-s5swn\"" May 21 13:09:16.781702 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:16.781678 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2"] May 21 13:09:16.854018 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:16.853987 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5502406-562f-49b5-b219-a5eb97f1de19-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-9t6h2\" (UID: \"e5502406-562f-49b5-b219-a5eb97f1de19\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2" May 21 13:09:16.854157 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:16.854033 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz5z2\" (UniqueName: \"kubernetes.io/projected/e5502406-562f-49b5-b219-a5eb97f1de19-kube-api-access-vz5z2\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-9t6h2\" (UID: \"e5502406-562f-49b5-b219-a5eb97f1de19\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2" May 21 13:09:16.955293 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:16.955267 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5502406-562f-49b5-b219-a5eb97f1de19-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-9t6h2\" (UID: \"e5502406-562f-49b5-b219-a5eb97f1de19\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2" May 21 13:09:16.955403 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:16.955313 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vz5z2\" (UniqueName: \"kubernetes.io/projected/e5502406-562f-49b5-b219-a5eb97f1de19-kube-api-access-vz5z2\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-9t6h2\" (UID: \"e5502406-562f-49b5-b219-a5eb97f1de19\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2" May 21 13:09:16.955719 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:16.955698 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5502406-562f-49b5-b219-a5eb97f1de19-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-9t6h2\" (UID: \"e5502406-562f-49b5-b219-a5eb97f1de19\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2" May 21 13:09:16.968384 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:16.968360 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz5z2\" (UniqueName: \"kubernetes.io/projected/e5502406-562f-49b5-b219-a5eb97f1de19-kube-api-access-vz5z2\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-9t6h2\" (UID: \"e5502406-562f-49b5-b219-a5eb97f1de19\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2" May 21 13:09:17.069501 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:17.069439 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2" May 21 13:09:17.221201 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:17.221167 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2"] May 21 13:09:17.222542 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:09:17.222507 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5502406_562f_49b5_b219_a5eb97f1de19.slice/crio-4760af65c1475f498c7c2f1a86151336563b72bc2664c18321dabb641b03b0a2 WatchSource:0}: Error finding container 4760af65c1475f498c7c2f1a86151336563b72bc2664c18321dabb641b03b0a2: Status 404 returned error can't find the container with id 4760af65c1475f498c7c2f1a86151336563b72bc2664c18321dabb641b03b0a2 May 21 13:09:17.992385 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:17.992338 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2" event={"ID":"e5502406-562f-49b5-b219-a5eb97f1de19","Type":"ContainerStarted","Data":"4760af65c1475f498c7c2f1a86151336563b72bc2664c18321dabb641b03b0a2"} May 21 13:09:18.962294 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:18.962266 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xbh57" May 21 13:09:23.010126 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:23.010091 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2" event={"ID":"e5502406-562f-49b5-b219-a5eb97f1de19","Type":"ContainerStarted","Data":"76ec8eed6683857cf061cda31800e02a0f2a71dbd2825787dca92dc7133e51ca"} May 21 13:09:23.010473 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:23.010197 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2" May 21 13:09:23.031226 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:23.031173 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2" podStartSLOduration=1.4397580269999999 podStartE2EDuration="7.03115666s" podCreationTimestamp="2026-05-21 13:09:16 +0000 UTC" firstStartedPulling="2026-05-21 13:09:17.227076487 +0000 UTC m=+420.081787954" lastFinishedPulling="2026-05-21 13:09:22.818475117 +0000 UTC m=+425.673186587" observedRunningTime="2026-05-21 13:09:23.030237048 +0000 UTC m=+425.884948536" watchObservedRunningTime="2026-05-21 13:09:23.03115666 +0000 UTC m=+425.885868150" May 21 13:09:34.015887 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:34.015855 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2" May 21 13:09:35.734762 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.734690 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2"] May 21 13:09:35.735116 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.734906 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2" podUID="e5502406-562f-49b5-b219-a5eb97f1de19" containerName="manager" containerID="cri-o://76ec8eed6683857cf061cda31800e02a0f2a71dbd2825787dca92dc7133e51ca" gracePeriod=2 May 21 13:09:35.737261 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.737226 2561 status_manager.go:895] "Failed to get status for pod" podUID="e5502406-562f-49b5-b219-a5eb97f1de19" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9t6h2\" is forbidden: User \"system:node:ip-10-0-143-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-142.ec2.internal' and this object" May 21 13:09:35.738492 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.738468 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2"] May 21 13:09:35.759451 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.759423 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tlrll"] May 21 13:09:35.759896 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.759873 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5502406-562f-49b5-b219-a5eb97f1de19" containerName="manager" May 21 13:09:35.759971 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.759896 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5502406-562f-49b5-b219-a5eb97f1de19" containerName="manager" May 21 13:09:35.760014 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.759992 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="e5502406-562f-49b5-b219-a5eb97f1de19" containerName="manager" May 21 13:09:35.762553 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.762533 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tlrll" May 21 13:09:35.764897 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.764875 2561 status_manager.go:895] "Failed to get status for pod" podUID="e5502406-562f-49b5-b219-a5eb97f1de19" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9t6h2\" is forbidden: User \"system:node:ip-10-0-143-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-142.ec2.internal' and this object" May 21 13:09:35.772342 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.772323 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tlrll"] May 21 13:09:35.800475 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.800442 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtb6m\" (UniqueName: \"kubernetes.io/projected/663b7cf1-4b8a-4d35-9348-1ce11bf2c33e-kube-api-access-xtb6m\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tlrll\" (UID: \"663b7cf1-4b8a-4d35-9348-1ce11bf2c33e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tlrll" May 21 13:09:35.800635 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.800582 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/663b7cf1-4b8a-4d35-9348-1ce11bf2c33e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tlrll\" (UID: \"663b7cf1-4b8a-4d35-9348-1ce11bf2c33e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tlrll" May 21 13:09:35.808060 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.808033 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xbh57"] May 21 13:09:35.808265 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.808241 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xbh57" podUID="cea01841-c627-4f5f-bf05-ae315d507482" containerName="manager" containerID="cri-o://4e8c72f8ac8746b35f198c9a187ab7e692400fb4b0e8a1812c02fb8bb31e8e33" gracePeriod=2 May 21 13:09:35.822274 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.822251 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xbh57"] May 21 13:09:35.823481 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.823454 2561 status_manager.go:895] "Failed to get status for pod" podUID="e5502406-562f-49b5-b219-a5eb97f1de19" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9t6h2\" is forbidden: User \"system:node:ip-10-0-143-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-142.ec2.internal' and this object" May 21 13:09:35.845413 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.845079 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qpfzb"] May 21 13:09:35.846127 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.845979 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cea01841-c627-4f5f-bf05-ae315d507482" containerName="manager" May 21 13:09:35.846127 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.846002 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cea01841-c627-4f5f-bf05-ae315d507482" containerName="manager" May 21 13:09:35.846281 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.846172 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="cea01841-c627-4f5f-bf05-ae315d507482" containerName="manager" May 21 13:09:35.851361 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.851338 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qpfzb" May 21 13:09:35.854295 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.854163 2561 status_manager.go:895] "Failed to get status for pod" podUID="e5502406-562f-49b5-b219-a5eb97f1de19" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9t6h2\" is forbidden: User \"system:node:ip-10-0-143-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-142.ec2.internal' and this object" May 21 13:09:35.856849 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.856826 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qpfzb"] May 21 13:09:35.879763 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.879735 2561 status_manager.go:895] "Failed to get status for pod" podUID="cea01841-c627-4f5f-bf05-ae315d507482" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xbh57" err="pods \"limitador-operator-controller-manager-85c4996f8c-xbh57\" is forbidden: User \"system:node:ip-10-0-143-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-142.ec2.internal' and this object" May 21 13:09:35.901176 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.901141 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xtb6m\" (UniqueName: \"kubernetes.io/projected/663b7cf1-4b8a-4d35-9348-1ce11bf2c33e-kube-api-access-xtb6m\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tlrll\" (UID: \"663b7cf1-4b8a-4d35-9348-1ce11bf2c33e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tlrll" May 21 13:09:35.901350 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.901192 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/663b7cf1-4b8a-4d35-9348-1ce11bf2c33e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tlrll\" (UID: \"663b7cf1-4b8a-4d35-9348-1ce11bf2c33e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tlrll" May 21 13:09:35.901350 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.901225 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g2zv\" (UniqueName: \"kubernetes.io/projected/dda030b3-3830-474c-8819-fa83b779f817-kube-api-access-8g2zv\") pod \"limitador-operator-controller-manager-85c4996f8c-qpfzb\" (UID: \"dda030b3-3830-474c-8819-fa83b779f817\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qpfzb" May 21 13:09:35.901633 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.901607 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/663b7cf1-4b8a-4d35-9348-1ce11bf2c33e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tlrll\" (UID: \"663b7cf1-4b8a-4d35-9348-1ce11bf2c33e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tlrll" May 21 13:09:35.917546 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.917523 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtb6m\" (UniqueName: \"kubernetes.io/projected/663b7cf1-4b8a-4d35-9348-1ce11bf2c33e-kube-api-access-xtb6m\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tlrll\" (UID: \"663b7cf1-4b8a-4d35-9348-1ce11bf2c33e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tlrll" May 21 13:09:35.968437 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.968414 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2" May 21 13:09:35.970917 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.970884 2561 status_manager.go:895] "Failed to get status for pod" podUID="cea01841-c627-4f5f-bf05-ae315d507482" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xbh57" err="pods \"limitador-operator-controller-manager-85c4996f8c-xbh57\" is forbidden: User \"system:node:ip-10-0-143-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-142.ec2.internal' and this object" May 21 13:09:35.973023 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:35.973001 2561 status_manager.go:895] "Failed to get status for pod" podUID="e5502406-562f-49b5-b219-a5eb97f1de19" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9t6h2\" is forbidden: User \"system:node:ip-10-0-143-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-142.ec2.internal' and this object" May 21 13:09:36.001981 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.001914 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5502406-562f-49b5-b219-a5eb97f1de19-extensions-socket-volume\") pod \"e5502406-562f-49b5-b219-a5eb97f1de19\" (UID: \"e5502406-562f-49b5-b219-a5eb97f1de19\") " May 21 13:09:36.002103 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.002033 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vz5z2\" (UniqueName: \"kubernetes.io/projected/e5502406-562f-49b5-b219-a5eb97f1de19-kube-api-access-vz5z2\") pod \"e5502406-562f-49b5-b219-a5eb97f1de19\" (UID: \"e5502406-562f-49b5-b219-a5eb97f1de19\") " May 21 13:09:36.002165 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.002143 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8g2zv\" (UniqueName: \"kubernetes.io/projected/dda030b3-3830-474c-8819-fa83b779f817-kube-api-access-8g2zv\") pod \"limitador-operator-controller-manager-85c4996f8c-qpfzb\" (UID: \"dda030b3-3830-474c-8819-fa83b779f817\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qpfzb" May 21 13:09:36.002368 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.002348 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5502406-562f-49b5-b219-a5eb97f1de19-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e5502406-562f-49b5-b219-a5eb97f1de19" (UID: "e5502406-562f-49b5-b219-a5eb97f1de19"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 13:09:36.005599 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.005558 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5502406-562f-49b5-b219-a5eb97f1de19-kube-api-access-vz5z2" (OuterVolumeSpecName: "kube-api-access-vz5z2") pod "e5502406-562f-49b5-b219-a5eb97f1de19" (UID: "e5502406-562f-49b5-b219-a5eb97f1de19"). InnerVolumeSpecName "kube-api-access-vz5z2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:09:36.024190 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.024162 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g2zv\" (UniqueName: \"kubernetes.io/projected/dda030b3-3830-474c-8819-fa83b779f817-kube-api-access-8g2zv\") pod \"limitador-operator-controller-manager-85c4996f8c-qpfzb\" (UID: \"dda030b3-3830-474c-8819-fa83b779f817\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qpfzb" May 21 13:09:36.031443 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.031419 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xbh57" May 21 13:09:36.034622 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.034599 2561 status_manager.go:895] "Failed to get status for pod" podUID="e5502406-562f-49b5-b219-a5eb97f1de19" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9t6h2\" is forbidden: User \"system:node:ip-10-0-143-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-142.ec2.internal' and this object" May 21 13:09:36.036944 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.036926 2561 status_manager.go:895] "Failed to get status for pod" podUID="cea01841-c627-4f5f-bf05-ae315d507482" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xbh57" err="pods \"limitador-operator-controller-manager-85c4996f8c-xbh57\" is forbidden: User \"system:node:ip-10-0-143-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-142.ec2.internal' and this object" May 21 13:09:36.059055 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.059028 2561 generic.go:358] "Generic (PLEG): container finished" podID="cea01841-c627-4f5f-bf05-ae315d507482" containerID="4e8c72f8ac8746b35f198c9a187ab7e692400fb4b0e8a1812c02fb8bb31e8e33" exitCode=0 May 21 13:09:36.059172 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.059085 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xbh57" May 21 13:09:36.059172 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.059136 2561 scope.go:117] "RemoveContainer" containerID="4e8c72f8ac8746b35f198c9a187ab7e692400fb4b0e8a1812c02fb8bb31e8e33" May 21 13:09:36.060421 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.060391 2561 generic.go:358] "Generic (PLEG): container finished" podID="e5502406-562f-49b5-b219-a5eb97f1de19" containerID="76ec8eed6683857cf061cda31800e02a0f2a71dbd2825787dca92dc7133e51ca" exitCode=0 May 21 13:09:36.060507 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.060440 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2" May 21 13:09:36.063691 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.063670 2561 status_manager.go:895] "Failed to get status for pod" podUID="cea01841-c627-4f5f-bf05-ae315d507482" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xbh57" err="pods \"limitador-operator-controller-manager-85c4996f8c-xbh57\" is forbidden: User \"system:node:ip-10-0-143-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-142.ec2.internal' and this object" May 21 13:09:36.066648 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.066619 2561 status_manager.go:895] "Failed to get status for pod" podUID="e5502406-562f-49b5-b219-a5eb97f1de19" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9t6h2\" is forbidden: User \"system:node:ip-10-0-143-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-142.ec2.internal' and this object" May 21 13:09:36.066822 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.066774 2561 scope.go:117] "RemoveContainer" containerID="4e8c72f8ac8746b35f198c9a187ab7e692400fb4b0e8a1812c02fb8bb31e8e33" May 21 13:09:36.067055 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:09:36.067033 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e8c72f8ac8746b35f198c9a187ab7e692400fb4b0e8a1812c02fb8bb31e8e33\": container with ID starting with 4e8c72f8ac8746b35f198c9a187ab7e692400fb4b0e8a1812c02fb8bb31e8e33 not found: ID does not exist" containerID="4e8c72f8ac8746b35f198c9a187ab7e692400fb4b0e8a1812c02fb8bb31e8e33" May 21 13:09:36.067122 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.067068 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e8c72f8ac8746b35f198c9a187ab7e692400fb4b0e8a1812c02fb8bb31e8e33"} err="failed to get container status \"4e8c72f8ac8746b35f198c9a187ab7e692400fb4b0e8a1812c02fb8bb31e8e33\": rpc error: code = NotFound desc = could not find container \"4e8c72f8ac8746b35f198c9a187ab7e692400fb4b0e8a1812c02fb8bb31e8e33\": container with ID starting with 4e8c72f8ac8746b35f198c9a187ab7e692400fb4b0e8a1812c02fb8bb31e8e33 not found: ID does not exist" May 21 13:09:36.067122 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.067093 2561 scope.go:117] "RemoveContainer" containerID="76ec8eed6683857cf061cda31800e02a0f2a71dbd2825787dca92dc7133e51ca" May 21 13:09:36.068946 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.068926 2561 status_manager.go:895] "Failed to get status for pod" podUID="cea01841-c627-4f5f-bf05-ae315d507482" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xbh57" err="pods \"limitador-operator-controller-manager-85c4996f8c-xbh57\" is forbidden: User \"system:node:ip-10-0-143-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-142.ec2.internal' and this object" May 21 13:09:36.071108 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.071084 2561 status_manager.go:895] "Failed to get status for pod" podUID="e5502406-562f-49b5-b219-a5eb97f1de19" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9t6h2\" is forbidden: User \"system:node:ip-10-0-143-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-142.ec2.internal' and this object" May 21 13:09:36.073405 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.073384 2561 status_manager.go:895] "Failed to get status for pod" podUID="cea01841-c627-4f5f-bf05-ae315d507482" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xbh57" err="pods \"limitador-operator-controller-manager-85c4996f8c-xbh57\" is forbidden: User \"system:node:ip-10-0-143-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-142.ec2.internal' and this object" May 21 13:09:36.074120 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.074099 2561 scope.go:117] "RemoveContainer" containerID="76ec8eed6683857cf061cda31800e02a0f2a71dbd2825787dca92dc7133e51ca" May 21 13:09:36.074346 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:09:36.074330 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76ec8eed6683857cf061cda31800e02a0f2a71dbd2825787dca92dc7133e51ca\": container with ID starting with 76ec8eed6683857cf061cda31800e02a0f2a71dbd2825787dca92dc7133e51ca not found: ID does not exist" containerID="76ec8eed6683857cf061cda31800e02a0f2a71dbd2825787dca92dc7133e51ca" May 21 13:09:36.074391 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.074352 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76ec8eed6683857cf061cda31800e02a0f2a71dbd2825787dca92dc7133e51ca"} err="failed to get container status \"76ec8eed6683857cf061cda31800e02a0f2a71dbd2825787dca92dc7133e51ca\": rpc error: code = NotFound desc = could not find container \"76ec8eed6683857cf061cda31800e02a0f2a71dbd2825787dca92dc7133e51ca\": container with ID starting with 76ec8eed6683857cf061cda31800e02a0f2a71dbd2825787dca92dc7133e51ca not found: ID does not exist" May 21 13:09:36.075475 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.075441 2561 status_manager.go:895] "Failed to get status for pod" podUID="e5502406-562f-49b5-b219-a5eb97f1de19" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9t6h2\" is forbidden: User \"system:node:ip-10-0-143-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-142.ec2.internal' and this object" May 21 13:09:36.102777 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.102757 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dn9t\" (UniqueName: \"kubernetes.io/projected/cea01841-c627-4f5f-bf05-ae315d507482-kube-api-access-2dn9t\") pod \"cea01841-c627-4f5f-bf05-ae315d507482\" (UID: \"cea01841-c627-4f5f-bf05-ae315d507482\") " May 21 13:09:36.102963 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.102953 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vz5z2\" (UniqueName: \"kubernetes.io/projected/e5502406-562f-49b5-b219-a5eb97f1de19-kube-api-access-vz5z2\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\"" May 21 13:09:36.103010 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.102966 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5502406-562f-49b5-b219-a5eb97f1de19-extensions-socket-volume\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\"" May 21 13:09:36.104552 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.104533 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cea01841-c627-4f5f-bf05-ae315d507482-kube-api-access-2dn9t" (OuterVolumeSpecName: "kube-api-access-2dn9t") pod "cea01841-c627-4f5f-bf05-ae315d507482" (UID: "cea01841-c627-4f5f-bf05-ae315d507482"). InnerVolumeSpecName "kube-api-access-2dn9t". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:09:36.109666 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.109647 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tlrll" May 21 13:09:36.177928 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.177899 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qpfzb" May 21 13:09:36.205003 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.204962 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dn9t\" (UniqueName: \"kubernetes.io/projected/cea01841-c627-4f5f-bf05-ae315d507482-kube-api-access-2dn9t\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\"" May 21 13:09:36.269450 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.269408 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tlrll"] May 21 13:09:36.273124 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:09:36.273098 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod663b7cf1_4b8a_4d35_9348_1ce11bf2c33e.slice/crio-4f8b8bc85e1bf12f6f8b6b934af21b7be1ef414863db798864b0594db0ca02d3 WatchSource:0}: Error finding container 4f8b8bc85e1bf12f6f8b6b934af21b7be1ef414863db798864b0594db0ca02d3: Status 404 returned error can't find the container with id 4f8b8bc85e1bf12f6f8b6b934af21b7be1ef414863db798864b0594db0ca02d3 May 21 13:09:36.321269 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.321242 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qpfzb"] May 21 13:09:36.324314 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:09:36.324290 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddda030b3_3830_474c_8819_fa83b779f817.slice/crio-d28c642bed0f5faf07c1b01722531496175c45d51ade93f58588f8c29e6800e8 WatchSource:0}: Error finding container d28c642bed0f5faf07c1b01722531496175c45d51ade93f58588f8c29e6800e8: Status 404 returned error can't find the container with id d28c642bed0f5faf07c1b01722531496175c45d51ade93f58588f8c29e6800e8 May 21 13:09:36.372090 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.372056 2561 status_manager.go:895] "Failed to get status for pod" podUID="cea01841-c627-4f5f-bf05-ae315d507482" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xbh57" err="pods \"limitador-operator-controller-manager-85c4996f8c-xbh57\" is forbidden: User \"system:node:ip-10-0-143-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-142.ec2.internal' and this object" May 21 13:09:36.375520 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:36.375485 2561 status_manager.go:895] "Failed to get status for pod" podUID="e5502406-562f-49b5-b219-a5eb97f1de19" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9t6h2\" is forbidden: User \"system:node:ip-10-0-143-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-142.ec2.internal' and this object" May 21 13:09:37.064966 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:37.064876 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qpfzb" event={"ID":"dda030b3-3830-474c-8819-fa83b779f817","Type":"ContainerStarted","Data":"56b1e73570210d4b553db34e481c87af3032a7c4434c37aa7f0952eea37b40cd"} May 21 13:09:37.065465 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:37.065443 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qpfzb" May 21 13:09:37.065558 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:37.065471 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qpfzb" event={"ID":"dda030b3-3830-474c-8819-fa83b779f817","Type":"ContainerStarted","Data":"d28c642bed0f5faf07c1b01722531496175c45d51ade93f58588f8c29e6800e8"} May 21 13:09:37.067711 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:37.067686 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tlrll" event={"ID":"663b7cf1-4b8a-4d35-9348-1ce11bf2c33e","Type":"ContainerStarted","Data":"c3045e822eb7c574ea2ea4c349517b318f74c1b7e5fa382c0df81d9ee201b285"} May 21 13:09:37.067839 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:37.067822 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tlrll" event={"ID":"663b7cf1-4b8a-4d35-9348-1ce11bf2c33e","Type":"ContainerStarted","Data":"4f8b8bc85e1bf12f6f8b6b934af21b7be1ef414863db798864b0594db0ca02d3"} May 21 13:09:37.067946 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:37.067932 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tlrll" May 21 13:09:37.069171 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:37.069137 2561 status_manager.go:895] "Failed to get status for pod" podUID="cea01841-c627-4f5f-bf05-ae315d507482" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xbh57" err="pods \"limitador-operator-controller-manager-85c4996f8c-xbh57\" is forbidden: User \"system:node:ip-10-0-143-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-142.ec2.internal' and this object" May 21 13:09:37.072026 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:37.071996 2561 status_manager.go:895] "Failed to get status for pod" podUID="e5502406-562f-49b5-b219-a5eb97f1de19" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9t6h2\" is forbidden: User \"system:node:ip-10-0-143-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-142.ec2.internal' and this object" May 21 13:09:37.117230 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:37.117182 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qpfzb" podStartSLOduration=2.117168829 podStartE2EDuration="2.117168829s" podCreationTimestamp="2026-05-21 13:09:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 13:09:37.115310189 +0000 UTC m=+439.970021677" watchObservedRunningTime="2026-05-21 13:09:37.117168829 +0000 UTC m=+439.971880317" May 21 13:09:37.179555 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:37.179513 2561 status_manager.go:895] "Failed to get status for pod" podUID="cea01841-c627-4f5f-bf05-ae315d507482" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xbh57" err="pods \"limitador-operator-controller-manager-85c4996f8c-xbh57\" is forbidden: User \"system:node:ip-10-0-143-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-142.ec2.internal' and this object" May 21 13:09:37.181895 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:37.181870 2561 status_manager.go:895] "Failed to get status for pod" podUID="e5502406-562f-49b5-b219-a5eb97f1de19" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9t6h2\" is forbidden: User \"system:node:ip-10-0-143-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-142.ec2.internal' and this object" May 21 13:09:37.691222 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:37.691181 2561 status_manager.go:895] "Failed to get status for pod" podUID="e5502406-562f-49b5-b219-a5eb97f1de19" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-9t6h2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-9t6h2\" is forbidden: User \"system:node:ip-10-0-143-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-142.ec2.internal' and this object" May 21 13:09:37.692101 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:37.692081 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cea01841-c627-4f5f-bf05-ae315d507482" path="/var/lib/kubelet/pods/cea01841-c627-4f5f-bf05-ae315d507482/volumes" May 21 13:09:37.692433 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:37.692417 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5502406-562f-49b5-b219-a5eb97f1de19" path="/var/lib/kubelet/pods/e5502406-562f-49b5-b219-a5eb97f1de19/volumes" May 21 13:09:37.694304 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:37.694284 2561 status_manager.go:895] "Failed to get status for pod" podUID="cea01841-c627-4f5f-bf05-ae315d507482" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xbh57" err="pods \"limitador-operator-controller-manager-85c4996f8c-xbh57\" is forbidden: User \"system:node:ip-10-0-143-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-142.ec2.internal' and this object" May 21 13:09:48.075328 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:48.075294 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tlrll" May 21 13:09:48.075721 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:48.075355 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-qpfzb" May 21 13:09:48.104752 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:09:48.104699 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tlrll" podStartSLOduration=13.10468549 podStartE2EDuration="13.10468549s" podCreationTimestamp="2026-05-21 13:09:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 13:09:37.17656186 +0000 UTC m=+440.031273348" watchObservedRunningTime="2026-05-21 13:09:48.10468549 +0000 UTC m=+450.959396978" May 21 13:10:06.751582 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:06.751546 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tlrll"] May 21 13:10:06.752096 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:06.751895 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tlrll" podUID="663b7cf1-4b8a-4d35-9348-1ce11bf2c33e" containerName="manager" containerID="cri-o://c3045e822eb7c574ea2ea4c349517b318f74c1b7e5fa382c0df81d9ee201b285" gracePeriod=10 May 21 13:10:06.986064 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:06.986043 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tlrll" May 21 13:10:07.039690 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:07.039613 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kqfgw"] May 21 13:10:07.039915 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:07.039902 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="663b7cf1-4b8a-4d35-9348-1ce11bf2c33e" containerName="manager" May 21 13:10:07.039955 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:07.039917 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="663b7cf1-4b8a-4d35-9348-1ce11bf2c33e" containerName="manager" May 21 13:10:07.039985 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:07.039980 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="663b7cf1-4b8a-4d35-9348-1ce11bf2c33e" containerName="manager" May 21 13:10:07.041754 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:07.041740 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kqfgw" May 21 13:10:07.064122 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:07.064092 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kqfgw"] May 21 13:10:07.151199 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:07.151175 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/663b7cf1-4b8a-4d35-9348-1ce11bf2c33e-extensions-socket-volume\") pod \"663b7cf1-4b8a-4d35-9348-1ce11bf2c33e\" (UID: \"663b7cf1-4b8a-4d35-9348-1ce11bf2c33e\") " May 21 13:10:07.151353 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:07.151233 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtb6m\" (UniqueName: \"kubernetes.io/projected/663b7cf1-4b8a-4d35-9348-1ce11bf2c33e-kube-api-access-xtb6m\") pod \"663b7cf1-4b8a-4d35-9348-1ce11bf2c33e\" (UID: \"663b7cf1-4b8a-4d35-9348-1ce11bf2c33e\") " May 21 13:10:07.151353 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:07.151309 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a435f1a-92d5-498e-a8cd-38dfffe2ef51-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-kqfgw\" (UID: \"0a435f1a-92d5-498e-a8cd-38dfffe2ef51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kqfgw" May 21 13:10:07.151353 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:07.151351 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh8l6\" (UniqueName: \"kubernetes.io/projected/0a435f1a-92d5-498e-a8cd-38dfffe2ef51-kube-api-access-bh8l6\") pod \"kuadrant-operator-controller-manager-55c7f4c975-kqfgw\" (UID: \"0a435f1a-92d5-498e-a8cd-38dfffe2ef51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kqfgw" May 21 13:10:07.151533 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:07.151509 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/663b7cf1-4b8a-4d35-9348-1ce11bf2c33e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "663b7cf1-4b8a-4d35-9348-1ce11bf2c33e" (UID: "663b7cf1-4b8a-4d35-9348-1ce11bf2c33e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 13:10:07.153283 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:07.153265 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/663b7cf1-4b8a-4d35-9348-1ce11bf2c33e-kube-api-access-xtb6m" (OuterVolumeSpecName: "kube-api-access-xtb6m") pod "663b7cf1-4b8a-4d35-9348-1ce11bf2c33e" (UID: "663b7cf1-4b8a-4d35-9348-1ce11bf2c33e"). InnerVolumeSpecName "kube-api-access-xtb6m". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:10:07.179465 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:07.179433 2561 generic.go:358] "Generic (PLEG): container finished" podID="663b7cf1-4b8a-4d35-9348-1ce11bf2c33e" containerID="c3045e822eb7c574ea2ea4c349517b318f74c1b7e5fa382c0df81d9ee201b285" exitCode=0 May 21 13:10:07.179556 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:07.179475 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tlrll" event={"ID":"663b7cf1-4b8a-4d35-9348-1ce11bf2c33e","Type":"ContainerDied","Data":"c3045e822eb7c574ea2ea4c349517b318f74c1b7e5fa382c0df81d9ee201b285"} May 21 13:10:07.179556 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:07.179497 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tlrll" event={"ID":"663b7cf1-4b8a-4d35-9348-1ce11bf2c33e","Type":"ContainerDied","Data":"4f8b8bc85e1bf12f6f8b6b934af21b7be1ef414863db798864b0594db0ca02d3"} May 21 13:10:07.179556 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:07.179505 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tlrll" May 21 13:10:07.179556 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:07.179515 2561 scope.go:117] "RemoveContainer" containerID="c3045e822eb7c574ea2ea4c349517b318f74c1b7e5fa382c0df81d9ee201b285" May 21 13:10:07.187188 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:07.187174 2561 scope.go:117] "RemoveContainer" containerID="c3045e822eb7c574ea2ea4c349517b318f74c1b7e5fa382c0df81d9ee201b285" May 21 13:10:07.187435 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:10:07.187415 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3045e822eb7c574ea2ea4c349517b318f74c1b7e5fa382c0df81d9ee201b285\": container with ID starting with c3045e822eb7c574ea2ea4c349517b318f74c1b7e5fa382c0df81d9ee201b285 not found: ID does not exist" containerID="c3045e822eb7c574ea2ea4c349517b318f74c1b7e5fa382c0df81d9ee201b285" May 21 13:10:07.187511 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:07.187449 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3045e822eb7c574ea2ea4c349517b318f74c1b7e5fa382c0df81d9ee201b285"} err="failed to get container status \"c3045e822eb7c574ea2ea4c349517b318f74c1b7e5fa382c0df81d9ee201b285\": rpc error: code = NotFound desc = could not find container \"c3045e822eb7c574ea2ea4c349517b318f74c1b7e5fa382c0df81d9ee201b285\": container with ID starting with c3045e822eb7c574ea2ea4c349517b318f74c1b7e5fa382c0df81d9ee201b285 not found: ID does not exist" May 21 13:10:07.204473 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:07.204453 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tlrll"] May 21 13:10:07.210487 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:07.210467 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tlrll"] May 21 13:10:07.252434 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:07.252411 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bh8l6\" (UniqueName: \"kubernetes.io/projected/0a435f1a-92d5-498e-a8cd-38dfffe2ef51-kube-api-access-bh8l6\") pod \"kuadrant-operator-controller-manager-55c7f4c975-kqfgw\" (UID: \"0a435f1a-92d5-498e-a8cd-38dfffe2ef51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kqfgw" May 21 13:10:07.252509 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:07.252456 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a435f1a-92d5-498e-a8cd-38dfffe2ef51-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-kqfgw\" (UID: \"0a435f1a-92d5-498e-a8cd-38dfffe2ef51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kqfgw" May 21 13:10:07.252509 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:07.252496 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtb6m\" (UniqueName: \"kubernetes.io/projected/663b7cf1-4b8a-4d35-9348-1ce11bf2c33e-kube-api-access-xtb6m\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\"" May 21 13:10:07.252509 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:07.252506 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/663b7cf1-4b8a-4d35-9348-1ce11bf2c33e-extensions-socket-volume\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\"" May 21 13:10:07.252766 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:07.252752 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a435f1a-92d5-498e-a8cd-38dfffe2ef51-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-kqfgw\" (UID: \"0a435f1a-92d5-498e-a8cd-38dfffe2ef51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kqfgw" May 21 13:10:07.261033 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:07.261017 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh8l6\" (UniqueName: \"kubernetes.io/projected/0a435f1a-92d5-498e-a8cd-38dfffe2ef51-kube-api-access-bh8l6\") pod \"kuadrant-operator-controller-manager-55c7f4c975-kqfgw\" (UID: \"0a435f1a-92d5-498e-a8cd-38dfffe2ef51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kqfgw" May 21 13:10:07.351035 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:07.351018 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kqfgw" May 21 13:10:07.474994 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:07.474965 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kqfgw"] May 21 13:10:07.478180 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:10:07.478154 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a435f1a_92d5_498e_a8cd_38dfffe2ef51.slice/crio-51bac5b63aea0d687c0cf1dc47b694dadb42244c7e6e6eefb0e3aa4b2e7de62d WatchSource:0}: Error finding container 51bac5b63aea0d687c0cf1dc47b694dadb42244c7e6e6eefb0e3aa4b2e7de62d: Status 404 returned error can't find the container with id 51bac5b63aea0d687c0cf1dc47b694dadb42244c7e6e6eefb0e3aa4b2e7de62d May 21 13:10:07.692684 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:07.692610 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="663b7cf1-4b8a-4d35-9348-1ce11bf2c33e" path="/var/lib/kubelet/pods/663b7cf1-4b8a-4d35-9348-1ce11bf2c33e/volumes" May 21 13:10:08.185341 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:08.185301 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kqfgw" event={"ID":"0a435f1a-92d5-498e-a8cd-38dfffe2ef51","Type":"ContainerStarted","Data":"f991548169d42f55d665a0f19257056ef0ef7de8bcc25f4935ddf5101655ce49"} May 21 13:10:08.185341 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:08.185348 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kqfgw" event={"ID":"0a435f1a-92d5-498e-a8cd-38dfffe2ef51","Type":"ContainerStarted","Data":"51bac5b63aea0d687c0cf1dc47b694dadb42244c7e6e6eefb0e3aa4b2e7de62d"} May 21 13:10:08.185767 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:08.185443 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kqfgw" May 21 13:10:08.206885 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:08.206844 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kqfgw" podStartSLOduration=1.206832512 podStartE2EDuration="1.206832512s" podCreationTimestamp="2026-05-21 13:10:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 13:10:08.20482759 +0000 UTC m=+471.059539078" watchObservedRunningTime="2026-05-21 13:10:08.206832512 +0000 UTC m=+471.061544000" May 21 13:10:19.190864 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:19.190831 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kqfgw" May 21 13:10:28.487809 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:28.487774 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-4zdf2"] May 21 13:10:28.490696 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:28.490675 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-4zdf2" May 21 13:10:28.493231 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:28.493212 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wb2gs\"" May 21 13:10:28.498073 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:28.498049 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-4zdf2"] May 21 13:10:28.521407 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:28.521355 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p278m\" (UniqueName: \"kubernetes.io/projected/a602a40a-9ec9-43df-a284-bd2929a56d25-kube-api-access-p278m\") pod \"authorino-7498df8756-4zdf2\" (UID: \"a602a40a-9ec9-43df-a284-bd2929a56d25\") " pod="kuadrant-system/authorino-7498df8756-4zdf2" May 21 13:10:28.621838 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:28.621800 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p278m\" (UniqueName: \"kubernetes.io/projected/a602a40a-9ec9-43df-a284-bd2929a56d25-kube-api-access-p278m\") pod \"authorino-7498df8756-4zdf2\" (UID: \"a602a40a-9ec9-43df-a284-bd2929a56d25\") " pod="kuadrant-system/authorino-7498df8756-4zdf2" May 21 13:10:28.632676 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:28.632649 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p278m\" (UniqueName: \"kubernetes.io/projected/a602a40a-9ec9-43df-a284-bd2929a56d25-kube-api-access-p278m\") pod \"authorino-7498df8756-4zdf2\" (UID: \"a602a40a-9ec9-43df-a284-bd2929a56d25\") " pod="kuadrant-system/authorino-7498df8756-4zdf2" May 21 13:10:28.800263 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:28.800180 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-4zdf2" May 21 13:10:28.919865 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:28.919787 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-4zdf2"] May 21 13:10:28.922519 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:10:28.922490 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda602a40a_9ec9_43df_a284_bd2929a56d25.slice/crio-183eb6412c86abf9cf1365d0c59aa6f67102a1ee3e6adf6fd233be16f27e2e45 WatchSource:0}: Error finding container 183eb6412c86abf9cf1365d0c59aa6f67102a1ee3e6adf6fd233be16f27e2e45: Status 404 returned error can't find the container with id 183eb6412c86abf9cf1365d0c59aa6f67102a1ee3e6adf6fd233be16f27e2e45 May 21 13:10:29.252468 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:29.252430 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-4zdf2" event={"ID":"a602a40a-9ec9-43df-a284-bd2929a56d25","Type":"ContainerStarted","Data":"183eb6412c86abf9cf1365d0c59aa6f67102a1ee3e6adf6fd233be16f27e2e45"} May 21 13:10:33.267754 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:33.267717 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-4zdf2" event={"ID":"a602a40a-9ec9-43df-a284-bd2929a56d25","Type":"ContainerStarted","Data":"1cb602a3440f3f36d3859f1a2a728503adcc04293a89e5f8a5f793386cf05db5"} May 21 13:10:33.284900 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:10:33.284852 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-4zdf2" podStartSLOduration=1.568374962 podStartE2EDuration="5.284839291s" podCreationTimestamp="2026-05-21 13:10:28 +0000 UTC" firstStartedPulling="2026-05-21 13:10:28.92574984 +0000 UTC m=+491.780461308" lastFinishedPulling="2026-05-21 13:10:32.642214169 +0000 UTC m=+495.496925637" observedRunningTime="2026-05-21 13:10:33.282676256 +0000 UTC m=+496.137387757" watchObservedRunningTime="2026-05-21 13:10:33.284839291 +0000 UTC m=+496.139550778" May 21 13:11:01.973883 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:01.973853 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f5d677b57-bd4mk"] May 21 13:11:01.978670 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:01.978652 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f5d677b57-bd4mk" May 21 13:11:01.981224 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:01.981206 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" May 21 13:11:01.987303 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:01.987274 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f5d677b57-bd4mk"] May 21 13:11:02.079335 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:02.079311 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/39f1e5ac-d15d-40be-b2fd-36ea76768fbe-tls-cert\") pod \"authorino-f5d677b57-bd4mk\" (UID: \"39f1e5ac-d15d-40be-b2fd-36ea76768fbe\") " pod="kuadrant-system/authorino-f5d677b57-bd4mk" May 21 13:11:02.079477 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:02.079360 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mchfv\" (UniqueName: \"kubernetes.io/projected/39f1e5ac-d15d-40be-b2fd-36ea76768fbe-kube-api-access-mchfv\") pod \"authorino-f5d677b57-bd4mk\" (UID: \"39f1e5ac-d15d-40be-b2fd-36ea76768fbe\") " pod="kuadrant-system/authorino-f5d677b57-bd4mk" May 21 13:11:02.180538 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:02.180497 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mchfv\" (UniqueName: \"kubernetes.io/projected/39f1e5ac-d15d-40be-b2fd-36ea76768fbe-kube-api-access-mchfv\") pod \"authorino-f5d677b57-bd4mk\" (UID: \"39f1e5ac-d15d-40be-b2fd-36ea76768fbe\") " pod="kuadrant-system/authorino-f5d677b57-bd4mk" May 21 13:11:02.180703 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:02.180563 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/39f1e5ac-d15d-40be-b2fd-36ea76768fbe-tls-cert\") pod \"authorino-f5d677b57-bd4mk\" (UID: \"39f1e5ac-d15d-40be-b2fd-36ea76768fbe\") " pod="kuadrant-system/authorino-f5d677b57-bd4mk" May 21 13:11:02.182864 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:02.182844 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/39f1e5ac-d15d-40be-b2fd-36ea76768fbe-tls-cert\") pod \"authorino-f5d677b57-bd4mk\" (UID: \"39f1e5ac-d15d-40be-b2fd-36ea76768fbe\") " pod="kuadrant-system/authorino-f5d677b57-bd4mk" May 21 13:11:02.190071 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:02.190051 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mchfv\" (UniqueName: \"kubernetes.io/projected/39f1e5ac-d15d-40be-b2fd-36ea76768fbe-kube-api-access-mchfv\") pod \"authorino-f5d677b57-bd4mk\" (UID: \"39f1e5ac-d15d-40be-b2fd-36ea76768fbe\") " pod="kuadrant-system/authorino-f5d677b57-bd4mk" May 21 13:11:02.287928 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:02.287871 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f5d677b57-bd4mk" May 21 13:11:02.412808 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:02.412642 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f5d677b57-bd4mk"] May 21 13:11:02.415690 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:11:02.415665 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39f1e5ac_d15d_40be_b2fd_36ea76768fbe.slice/crio-0d6bc32631857a3e5947dd287cf050e7c2347b44d41568c5b6066055f8a2d2b2 WatchSource:0}: Error finding container 0d6bc32631857a3e5947dd287cf050e7c2347b44d41568c5b6066055f8a2d2b2: Status 404 returned error can't find the container with id 0d6bc32631857a3e5947dd287cf050e7c2347b44d41568c5b6066055f8a2d2b2 May 21 13:11:03.362727 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:03.362690 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f5d677b57-bd4mk" event={"ID":"39f1e5ac-d15d-40be-b2fd-36ea76768fbe","Type":"ContainerStarted","Data":"96087a620392a4d0133b7414566323f45d5eef428b19e9cccd263f7c531eb103"} May 21 13:11:03.362727 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:03.362726 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f5d677b57-bd4mk" event={"ID":"39f1e5ac-d15d-40be-b2fd-36ea76768fbe","Type":"ContainerStarted","Data":"0d6bc32631857a3e5947dd287cf050e7c2347b44d41568c5b6066055f8a2d2b2"} May 21 13:11:03.380801 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:03.380758 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f5d677b57-bd4mk" podStartSLOduration=2.039763554 podStartE2EDuration="2.380744971s" podCreationTimestamp="2026-05-21 13:11:01 +0000 UTC" firstStartedPulling="2026-05-21 13:11:02.4168903 +0000 UTC m=+525.271601768" lastFinishedPulling="2026-05-21 13:11:02.757871701 +0000 UTC m=+525.612583185" observedRunningTime="2026-05-21 13:11:03.378766416 +0000 UTC m=+526.233477905" watchObservedRunningTime="2026-05-21 13:11:03.380744971 +0000 UTC m=+526.235456487" May 21 13:11:03.404925 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:03.404889 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-4zdf2"] May 21 13:11:03.405112 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:03.405089 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-4zdf2" podUID="a602a40a-9ec9-43df-a284-bd2929a56d25" containerName="authorino" containerID="cri-o://1cb602a3440f3f36d3859f1a2a728503adcc04293a89e5f8a5f793386cf05db5" gracePeriod=30 May 21 13:11:03.650818 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:03.650784 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-4zdf2" May 21 13:11:03.793204 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:03.793170 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p278m\" (UniqueName: \"kubernetes.io/projected/a602a40a-9ec9-43df-a284-bd2929a56d25-kube-api-access-p278m\") pod \"a602a40a-9ec9-43df-a284-bd2929a56d25\" (UID: \"a602a40a-9ec9-43df-a284-bd2929a56d25\") " May 21 13:11:03.795224 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:03.795198 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a602a40a-9ec9-43df-a284-bd2929a56d25-kube-api-access-p278m" (OuterVolumeSpecName: "kube-api-access-p278m") pod "a602a40a-9ec9-43df-a284-bd2929a56d25" (UID: "a602a40a-9ec9-43df-a284-bd2929a56d25"). InnerVolumeSpecName "kube-api-access-p278m". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:11:03.894128 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:03.894062 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p278m\" (UniqueName: \"kubernetes.io/projected/a602a40a-9ec9-43df-a284-bd2929a56d25-kube-api-access-p278m\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\"" May 21 13:11:04.366532 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:04.366502 2561 generic.go:358] "Generic (PLEG): container finished" podID="a602a40a-9ec9-43df-a284-bd2929a56d25" containerID="1cb602a3440f3f36d3859f1a2a728503adcc04293a89e5f8a5f793386cf05db5" exitCode=0 May 21 13:11:04.366967 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:04.366547 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-4zdf2" May 21 13:11:04.366967 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:04.366617 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-4zdf2" event={"ID":"a602a40a-9ec9-43df-a284-bd2929a56d25","Type":"ContainerDied","Data":"1cb602a3440f3f36d3859f1a2a728503adcc04293a89e5f8a5f793386cf05db5"} May 21 13:11:04.366967 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:04.366655 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-4zdf2" event={"ID":"a602a40a-9ec9-43df-a284-bd2929a56d25","Type":"ContainerDied","Data":"183eb6412c86abf9cf1365d0c59aa6f67102a1ee3e6adf6fd233be16f27e2e45"} May 21 13:11:04.366967 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:04.366670 2561 scope.go:117] "RemoveContainer" containerID="1cb602a3440f3f36d3859f1a2a728503adcc04293a89e5f8a5f793386cf05db5" May 21 13:11:04.374368 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:04.374350 2561 scope.go:117] "RemoveContainer" containerID="1cb602a3440f3f36d3859f1a2a728503adcc04293a89e5f8a5f793386cf05db5" May 21 13:11:04.374665 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:11:04.374648 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cb602a3440f3f36d3859f1a2a728503adcc04293a89e5f8a5f793386cf05db5\": container with ID starting with 1cb602a3440f3f36d3859f1a2a728503adcc04293a89e5f8a5f793386cf05db5 not found: ID does not exist" containerID="1cb602a3440f3f36d3859f1a2a728503adcc04293a89e5f8a5f793386cf05db5" May 21 13:11:04.374729 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:04.374672 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cb602a3440f3f36d3859f1a2a728503adcc04293a89e5f8a5f793386cf05db5"} err="failed to get container status \"1cb602a3440f3f36d3859f1a2a728503adcc04293a89e5f8a5f793386cf05db5\": rpc error: code = NotFound desc = could not find container \"1cb602a3440f3f36d3859f1a2a728503adcc04293a89e5f8a5f793386cf05db5\": container with ID starting with 1cb602a3440f3f36d3859f1a2a728503adcc04293a89e5f8a5f793386cf05db5 not found: ID does not exist" May 21 13:11:04.386369 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:04.386325 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-4zdf2"] May 21 13:11:04.388048 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:04.388031 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-4zdf2"] May 21 13:11:05.692909 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:05.692834 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a602a40a-9ec9-43df-a284-bd2929a56d25" path="/var/lib/kubelet/pods/a602a40a-9ec9-43df-a284-bd2929a56d25/volumes" May 21 13:11:54.260973 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:54.260940 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-68df9d8dd8-zzg26"] May 21 13:11:54.261462 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:54.261222 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a602a40a-9ec9-43df-a284-bd2929a56d25" containerName="authorino" May 21 13:11:54.261462 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:54.261233 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a602a40a-9ec9-43df-a284-bd2929a56d25" containerName="authorino" May 21 13:11:54.261462 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:54.261298 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="a602a40a-9ec9-43df-a284-bd2929a56d25" containerName="authorino" May 21 13:11:54.263130 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:54.263116 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-68df9d8dd8-zzg26" May 21 13:11:54.265896 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:54.265874 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 21 13:11:54.266370 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:54.266348 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-nxpgj\"" May 21 13:11:54.266535 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:54.266522 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" May 21 13:11:54.273046 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:54.273027 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3300aca5-4567-4ef1-aeaa-5ed0d63cd4ac-maas-api-tls\") pod \"maas-api-68df9d8dd8-zzg26\" (UID: \"3300aca5-4567-4ef1-aeaa-5ed0d63cd4ac\") " pod="opendatahub/maas-api-68df9d8dd8-zzg26" May 21 13:11:54.273130 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:54.273078 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78nxr\" (UniqueName: \"kubernetes.io/projected/3300aca5-4567-4ef1-aeaa-5ed0d63cd4ac-kube-api-access-78nxr\") pod \"maas-api-68df9d8dd8-zzg26\" (UID: \"3300aca5-4567-4ef1-aeaa-5ed0d63cd4ac\") " pod="opendatahub/maas-api-68df9d8dd8-zzg26" May 21 13:11:54.275321 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:54.275304 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-68df9d8dd8-zzg26"] May 21 13:11:54.374411 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:54.374381 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-78nxr\" (UniqueName: \"kubernetes.io/projected/3300aca5-4567-4ef1-aeaa-5ed0d63cd4ac-kube-api-access-78nxr\") pod \"maas-api-68df9d8dd8-zzg26\" (UID: \"3300aca5-4567-4ef1-aeaa-5ed0d63cd4ac\") " pod="opendatahub/maas-api-68df9d8dd8-zzg26" May 21 13:11:54.374601 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:54.374432 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3300aca5-4567-4ef1-aeaa-5ed0d63cd4ac-maas-api-tls\") pod \"maas-api-68df9d8dd8-zzg26\" (UID: \"3300aca5-4567-4ef1-aeaa-5ed0d63cd4ac\") " pod="opendatahub/maas-api-68df9d8dd8-zzg26" May 21 13:11:54.374601 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:11:54.374521 2561 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found May 21 13:11:54.374601 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:11:54.374600 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3300aca5-4567-4ef1-aeaa-5ed0d63cd4ac-maas-api-tls podName:3300aca5-4567-4ef1-aeaa-5ed0d63cd4ac nodeName:}" failed. No retries permitted until 2026-05-21 13:11:54.874579529 +0000 UTC m=+577.729291015 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3300aca5-4567-4ef1-aeaa-5ed0d63cd4ac-maas-api-tls") pod "maas-api-68df9d8dd8-zzg26" (UID: "3300aca5-4567-4ef1-aeaa-5ed0d63cd4ac") : secret "maas-api-serving-cert" not found May 21 13:11:54.383905 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:54.383878 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78nxr\" (UniqueName: \"kubernetes.io/projected/3300aca5-4567-4ef1-aeaa-5ed0d63cd4ac-kube-api-access-78nxr\") pod \"maas-api-68df9d8dd8-zzg26\" (UID: \"3300aca5-4567-4ef1-aeaa-5ed0d63cd4ac\") " pod="opendatahub/maas-api-68df9d8dd8-zzg26" May 21 13:11:54.613711 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:54.613676 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-8szb4"] May 21 13:11:54.615751 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:54.615736 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-8szb4" May 21 13:11:54.618390 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:54.618371 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" May 21 13:11:54.619167 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:54.619151 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-tc65x\"" May 21 13:11:54.627898 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:54.627876 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-8szb4"] May 21 13:11:54.677814 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:54.677791 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vsfc\" (UniqueName: \"kubernetes.io/projected/4c4d6a1a-b28f-480c-966d-3ef554815948-kube-api-access-5vsfc\") pod \"payload-processing-58b6c8fdc7-8szb4\" (UID: \"4c4d6a1a-b28f-480c-966d-3ef554815948\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-8szb4" May 21 13:11:54.778204 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:54.778172 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vsfc\" (UniqueName: \"kubernetes.io/projected/4c4d6a1a-b28f-480c-966d-3ef554815948-kube-api-access-5vsfc\") pod \"payload-processing-58b6c8fdc7-8szb4\" (UID: \"4c4d6a1a-b28f-480c-966d-3ef554815948\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-8szb4" May 21 13:11:54.786486 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:54.786454 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vsfc\" (UniqueName: \"kubernetes.io/projected/4c4d6a1a-b28f-480c-966d-3ef554815948-kube-api-access-5vsfc\") pod \"payload-processing-58b6c8fdc7-8szb4\" (UID: \"4c4d6a1a-b28f-480c-966d-3ef554815948\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-8szb4" May 21 13:11:54.879252 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:54.879175 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3300aca5-4567-4ef1-aeaa-5ed0d63cd4ac-maas-api-tls\") pod \"maas-api-68df9d8dd8-zzg26\" (UID: \"3300aca5-4567-4ef1-aeaa-5ed0d63cd4ac\") " pod="opendatahub/maas-api-68df9d8dd8-zzg26" May 21 13:11:54.881546 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:54.881527 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3300aca5-4567-4ef1-aeaa-5ed0d63cd4ac-maas-api-tls\") pod \"maas-api-68df9d8dd8-zzg26\" (UID: \"3300aca5-4567-4ef1-aeaa-5ed0d63cd4ac\") " pod="opendatahub/maas-api-68df9d8dd8-zzg26" May 21 13:11:54.925428 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:54.925380 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-8szb4" May 21 13:11:55.054479 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:55.054456 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-8szb4"] May 21 13:11:55.056787 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:11:55.056758 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c4d6a1a_b28f_480c_966d_3ef554815948.slice/crio-f3b838cfd6930beb319db3c183e585098dc180de609645dae7fc4b18118d6072 WatchSource:0}: Error finding container f3b838cfd6930beb319db3c183e585098dc180de609645dae7fc4b18118d6072: Status 404 returned error can't find the container with id f3b838cfd6930beb319db3c183e585098dc180de609645dae7fc4b18118d6072 May 21 13:11:55.173539 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:55.173485 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-68df9d8dd8-zzg26" May 21 13:11:55.299190 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:55.299163 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-68df9d8dd8-zzg26"] May 21 13:11:55.301731 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:11:55.301702 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3300aca5_4567_4ef1_aeaa_5ed0d63cd4ac.slice/crio-5b6823779fd6ecf689c09a435e8f9c2910c7a82662e95d65fd9717da8c968816 WatchSource:0}: Error finding container 5b6823779fd6ecf689c09a435e8f9c2910c7a82662e95d65fd9717da8c968816: Status 404 returned error can't find the container with id 5b6823779fd6ecf689c09a435e8f9c2910c7a82662e95d65fd9717da8c968816 May 21 13:11:55.533785 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:55.533698 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-8szb4" event={"ID":"4c4d6a1a-b28f-480c-966d-3ef554815948","Type":"ContainerStarted","Data":"f3b838cfd6930beb319db3c183e585098dc180de609645dae7fc4b18118d6072"} May 21 13:11:55.534856 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:55.534832 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-68df9d8dd8-zzg26" event={"ID":"3300aca5-4567-4ef1-aeaa-5ed0d63cd4ac","Type":"ContainerStarted","Data":"5b6823779fd6ecf689c09a435e8f9c2910c7a82662e95d65fd9717da8c968816"} May 21 13:11:56.540857 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:56.540815 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-8szb4" event={"ID":"4c4d6a1a-b28f-480c-966d-3ef554815948","Type":"ContainerStarted","Data":"331082841f19813252e5b0d3168979ed8d6717c3180a8c612e3f102a8fcd6708"} May 21 13:11:56.541286 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:56.541006 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-8szb4" May 21 13:11:56.561600 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:56.561515 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-8szb4" podStartSLOduration=1.251736887 podStartE2EDuration="2.561498284s" podCreationTimestamp="2026-05-21 13:11:54 +0000 UTC" firstStartedPulling="2026-05-21 13:11:55.058406368 +0000 UTC m=+577.913117837" lastFinishedPulling="2026-05-21 13:11:56.368167757 +0000 UTC m=+579.222879234" observedRunningTime="2026-05-21 13:11:56.559676811 +0000 UTC m=+579.414388301" watchObservedRunningTime="2026-05-21 13:11:56.561498284 +0000 UTC m=+579.416209775" May 21 13:11:58.549322 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:58.549289 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-68df9d8dd8-zzg26" event={"ID":"3300aca5-4567-4ef1-aeaa-5ed0d63cd4ac","Type":"ContainerStarted","Data":"3b2fd1479f6b79ca60402ff590cef7aff38a59d912e7c85144183bde8a552a89"} May 21 13:11:58.549716 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:58.549445 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-68df9d8dd8-zzg26" May 21 13:11:58.565798 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:11:58.565759 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-68df9d8dd8-zzg26" podStartSLOduration=2.300139732 podStartE2EDuration="4.565717936s" podCreationTimestamp="2026-05-21 13:11:54 +0000 UTC" firstStartedPulling="2026-05-21 13:11:55.303072193 +0000 UTC m=+578.157783660" lastFinishedPulling="2026-05-21 13:11:57.56865038 +0000 UTC m=+580.423361864" observedRunningTime="2026-05-21 13:11:58.564638478 +0000 UTC m=+581.419349967" watchObservedRunningTime="2026-05-21 13:11:58.565717936 +0000 UTC m=+581.420429426" May 21 13:12:04.558210 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:04.558180 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-68df9d8dd8-zzg26" May 21 13:12:07.545740 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:07.545706 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-8szb4" May 21 13:12:17.175070 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:17.175032 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz"] May 21 13:12:17.177496 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:17.177473 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz" May 21 13:12:17.180933 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:17.180909 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 13:12:17.182158 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:17.182138 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" May 21 13:12:17.182244 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:17.182171 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 13:12:17.182299 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:17.182171 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-g2h66\"" May 21 13:12:17.196957 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:17.196935 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz"] May 21 13:12:17.259177 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:17.259152 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14470b82-d3d6-400e-8572-f8b97b08e785-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz\" (UID: \"14470b82-d3d6-400e-8572-f8b97b08e785\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz" May 21 13:12:17.259313 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:17.259182 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14470b82-d3d6-400e-8572-f8b97b08e785-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz\" (UID: \"14470b82-d3d6-400e-8572-f8b97b08e785\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz" May 21 13:12:17.259313 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:17.259202 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/14470b82-d3d6-400e-8572-f8b97b08e785-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz\" (UID: \"14470b82-d3d6-400e-8572-f8b97b08e785\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz" May 21 13:12:17.259313 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:17.259223 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql5lz\" (UniqueName: \"kubernetes.io/projected/14470b82-d3d6-400e-8572-f8b97b08e785-kube-api-access-ql5lz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz\" (UID: \"14470b82-d3d6-400e-8572-f8b97b08e785\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz" May 21 13:12:17.259313 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:17.259283 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14470b82-d3d6-400e-8572-f8b97b08e785-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz\" (UID: \"14470b82-d3d6-400e-8572-f8b97b08e785\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz" May 21 13:12:17.259451 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:17.259336 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14470b82-d3d6-400e-8572-f8b97b08e785-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz\" (UID: \"14470b82-d3d6-400e-8572-f8b97b08e785\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz" May 21 13:12:17.360648 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:17.360618 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14470b82-d3d6-400e-8572-f8b97b08e785-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz\" (UID: \"14470b82-d3d6-400e-8572-f8b97b08e785\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz" May 21 13:12:17.360648 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:17.360653 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14470b82-d3d6-400e-8572-f8b97b08e785-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz\" (UID: \"14470b82-d3d6-400e-8572-f8b97b08e785\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz" May 21 13:12:17.360849 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:17.360677 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/14470b82-d3d6-400e-8572-f8b97b08e785-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz\" (UID: \"14470b82-d3d6-400e-8572-f8b97b08e785\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz" May 21 13:12:17.360849 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:17.360701 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ql5lz\" (UniqueName: \"kubernetes.io/projected/14470b82-d3d6-400e-8572-f8b97b08e785-kube-api-access-ql5lz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz\" (UID: \"14470b82-d3d6-400e-8572-f8b97b08e785\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz" May 21 13:12:17.360849 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:17.360720 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14470b82-d3d6-400e-8572-f8b97b08e785-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz\" (UID: \"14470b82-d3d6-400e-8572-f8b97b08e785\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz" May 21 13:12:17.360849 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:17.360746 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14470b82-d3d6-400e-8572-f8b97b08e785-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz\" (UID: \"14470b82-d3d6-400e-8572-f8b97b08e785\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz" May 21 13:12:17.361135 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:17.361113 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14470b82-d3d6-400e-8572-f8b97b08e785-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz\" (UID: \"14470b82-d3d6-400e-8572-f8b97b08e785\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz" May 21 13:12:17.361193 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:17.361161 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/14470b82-d3d6-400e-8572-f8b97b08e785-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz\" (UID: \"14470b82-d3d6-400e-8572-f8b97b08e785\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz" May 21 13:12:17.361234 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:17.361206 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14470b82-d3d6-400e-8572-f8b97b08e785-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz\" (UID: \"14470b82-d3d6-400e-8572-f8b97b08e785\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz" May 21 13:12:17.362931 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:17.362914 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14470b82-d3d6-400e-8572-f8b97b08e785-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz\" (UID: \"14470b82-d3d6-400e-8572-f8b97b08e785\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz" May 21 13:12:17.363321 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:17.363300 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14470b82-d3d6-400e-8572-f8b97b08e785-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz\" (UID: \"14470b82-d3d6-400e-8572-f8b97b08e785\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz" May 21 13:12:17.370987 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:17.370941 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql5lz\" (UniqueName: \"kubernetes.io/projected/14470b82-d3d6-400e-8572-f8b97b08e785-kube-api-access-ql5lz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz\" (UID: \"14470b82-d3d6-400e-8572-f8b97b08e785\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz" May 21 13:12:17.491008 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:17.490932 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz" May 21 13:12:17.646005 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:17.636522 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz"] May 21 13:12:17.646005 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:12:17.638493 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14470b82_d3d6_400e_8572_f8b97b08e785.slice/crio-ce52e170cd28e904dc35fc16ec2c400515b08da9ee726be2745929680613e5cb WatchSource:0}: Error finding container ce52e170cd28e904dc35fc16ec2c400515b08da9ee726be2745929680613e5cb: Status 404 returned error can't find the container with id ce52e170cd28e904dc35fc16ec2c400515b08da9ee726be2745929680613e5cb May 21 13:12:18.614908 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:18.614868 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz" event={"ID":"14470b82-d3d6-400e-8572-f8b97b08e785","Type":"ContainerStarted","Data":"ce52e170cd28e904dc35fc16ec2c400515b08da9ee726be2745929680613e5cb"} May 21 13:12:23.638211 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:23.638166 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz" event={"ID":"14470b82-d3d6-400e-8572-f8b97b08e785","Type":"ContainerStarted","Data":"86f3a0a33e44c63c2332d42a0baf776ddf73f670aa3e9ac053a2f83ac6364e6f"} May 21 13:12:24.807682 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:24.807653 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-bnwhp"] May 21 13:12:24.810878 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:24.810854 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bnwhp" May 21 13:12:24.813541 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:24.813521 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 21 13:12:24.822929 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:24.822909 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-bnwhp"] May 21 13:12:24.934857 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:24.934815 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68kkz\" (UniqueName: \"kubernetes.io/projected/7db4c9c4-0c8f-4246-83ff-5fabb93c5df0-kube-api-access-68kkz\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bnwhp\" (UID: \"7db4c9c4-0c8f-4246-83ff-5fabb93c5df0\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bnwhp" May 21 13:12:24.935026 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:24.934889 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7db4c9c4-0c8f-4246-83ff-5fabb93c5df0-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bnwhp\" (UID: \"7db4c9c4-0c8f-4246-83ff-5fabb93c5df0\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bnwhp" May 21 13:12:24.935026 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:24.934921 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7db4c9c4-0c8f-4246-83ff-5fabb93c5df0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bnwhp\" (UID: \"7db4c9c4-0c8f-4246-83ff-5fabb93c5df0\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bnwhp" May 21 13:12:24.935026 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:24.934967 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7db4c9c4-0c8f-4246-83ff-5fabb93c5df0-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bnwhp\" (UID: \"7db4c9c4-0c8f-4246-83ff-5fabb93c5df0\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bnwhp" May 21 13:12:24.935026 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:24.935001 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7db4c9c4-0c8f-4246-83ff-5fabb93c5df0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bnwhp\" (UID: \"7db4c9c4-0c8f-4246-83ff-5fabb93c5df0\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bnwhp" May 21 13:12:24.935177 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:24.935061 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7db4c9c4-0c8f-4246-83ff-5fabb93c5df0-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bnwhp\" (UID: \"7db4c9c4-0c8f-4246-83ff-5fabb93c5df0\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bnwhp" May 21 13:12:25.035471 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:25.035434 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-68kkz\" (UniqueName: \"kubernetes.io/projected/7db4c9c4-0c8f-4246-83ff-5fabb93c5df0-kube-api-access-68kkz\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bnwhp\" (UID: \"7db4c9c4-0c8f-4246-83ff-5fabb93c5df0\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bnwhp" May 21 13:12:25.035658 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:25.035478 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7db4c9c4-0c8f-4246-83ff-5fabb93c5df0-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bnwhp\" (UID: \"7db4c9c4-0c8f-4246-83ff-5fabb93c5df0\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bnwhp" May 21 13:12:25.035658 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:25.035497 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7db4c9c4-0c8f-4246-83ff-5fabb93c5df0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bnwhp\" (UID: \"7db4c9c4-0c8f-4246-83ff-5fabb93c5df0\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bnwhp" May 21 13:12:25.035658 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:25.035539 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7db4c9c4-0c8f-4246-83ff-5fabb93c5df0-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bnwhp\" (UID: \"7db4c9c4-0c8f-4246-83ff-5fabb93c5df0\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bnwhp" May 21 13:12:25.035658 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:25.035560 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7db4c9c4-0c8f-4246-83ff-5fabb93c5df0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bnwhp\" (UID: \"7db4c9c4-0c8f-4246-83ff-5fabb93c5df0\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bnwhp" May 21 13:12:25.035867 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:25.035671 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7db4c9c4-0c8f-4246-83ff-5fabb93c5df0-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bnwhp\" (UID: \"7db4c9c4-0c8f-4246-83ff-5fabb93c5df0\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bnwhp" May 21 13:12:25.035940 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:25.035912 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7db4c9c4-0c8f-4246-83ff-5fabb93c5df0-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bnwhp\" (UID: \"7db4c9c4-0c8f-4246-83ff-5fabb93c5df0\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bnwhp" May 21 13:12:25.035940 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:25.035930 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7db4c9c4-0c8f-4246-83ff-5fabb93c5df0-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bnwhp\" (UID: \"7db4c9c4-0c8f-4246-83ff-5fabb93c5df0\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bnwhp" May 21 13:12:25.036125 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:25.036109 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7db4c9c4-0c8f-4246-83ff-5fabb93c5df0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bnwhp\" (UID: \"7db4c9c4-0c8f-4246-83ff-5fabb93c5df0\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bnwhp" May 21 13:12:25.038166 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:25.038142 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7db4c9c4-0c8f-4246-83ff-5fabb93c5df0-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bnwhp\" (UID: \"7db4c9c4-0c8f-4246-83ff-5fabb93c5df0\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bnwhp" May 21 13:12:25.040088 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:25.040063 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7db4c9c4-0c8f-4246-83ff-5fabb93c5df0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bnwhp\" (UID: \"7db4c9c4-0c8f-4246-83ff-5fabb93c5df0\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bnwhp" May 21 13:12:25.048628 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:25.048605 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68kkz\" (UniqueName: \"kubernetes.io/projected/7db4c9c4-0c8f-4246-83ff-5fabb93c5df0-kube-api-access-68kkz\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-bnwhp\" (UID: \"7db4c9c4-0c8f-4246-83ff-5fabb93c5df0\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bnwhp" May 21 13:12:25.122975 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:25.122878 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bnwhp" May 21 13:12:25.269603 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:25.266277 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-bnwhp"] May 21 13:12:25.274756 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:12:25.274721 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7db4c9c4_0c8f_4246_83ff_5fabb93c5df0.slice/crio-4a9bd05428d2c03e40b6206acbbe95e10feb22f7fa247faa51e2a6a6a1ce8d7f WatchSource:0}: Error finding container 4a9bd05428d2c03e40b6206acbbe95e10feb22f7fa247faa51e2a6a6a1ce8d7f: Status 404 returned error can't find the container with id 4a9bd05428d2c03e40b6206acbbe95e10feb22f7fa247faa51e2a6a6a1ce8d7f May 21 13:12:25.646625 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:25.646554 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bnwhp" event={"ID":"7db4c9c4-0c8f-4246-83ff-5fabb93c5df0","Type":"ContainerStarted","Data":"8c770d3dccc5639493ee146d7f2547cc4c71ec2cd87fec23f27134bd1b43d93c"} May 21 13:12:25.646625 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:25.646631 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bnwhp" event={"ID":"7db4c9c4-0c8f-4246-83ff-5fabb93c5df0","Type":"ContainerStarted","Data":"4a9bd05428d2c03e40b6206acbbe95e10feb22f7fa247faa51e2a6a6a1ce8d7f"} May 21 13:12:28.657933 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:28.657903 2561 generic.go:358] "Generic (PLEG): container finished" podID="14470b82-d3d6-400e-8572-f8b97b08e785" containerID="86f3a0a33e44c63c2332d42a0baf776ddf73f670aa3e9ac053a2f83ac6364e6f" exitCode=0 May 21 13:12:28.658283 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:28.657960 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz" event={"ID":"14470b82-d3d6-400e-8572-f8b97b08e785","Type":"ContainerDied","Data":"86f3a0a33e44c63c2332d42a0baf776ddf73f670aa3e9ac053a2f83ac6364e6f"} May 21 13:12:30.666527 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:30.666472 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz" event={"ID":"14470b82-d3d6-400e-8572-f8b97b08e785","Type":"ContainerStarted","Data":"80e5ff89c252413c5bcf17afbc786f0d96b685cc37b6467f11c27904ad9f72a9"} May 21 13:12:30.667847 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:30.667825 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz" May 21 13:12:30.689248 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:30.689198 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz" podStartSLOduration=1.2526933470000001 podStartE2EDuration="13.689182347s" podCreationTimestamp="2026-05-21 13:12:17 +0000 UTC" firstStartedPulling="2026-05-21 13:12:17.640195421 +0000 UTC m=+600.494906890" lastFinishedPulling="2026-05-21 13:12:30.076684405 +0000 UTC m=+612.931395890" observedRunningTime="2026-05-21 13:12:30.688231544 +0000 UTC m=+613.542943032" watchObservedRunningTime="2026-05-21 13:12:30.689182347 +0000 UTC m=+613.543893836" May 21 13:12:31.672720 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:31.672681 2561 generic.go:358] "Generic (PLEG): container finished" podID="7db4c9c4-0c8f-4246-83ff-5fabb93c5df0" containerID="8c770d3dccc5639493ee146d7f2547cc4c71ec2cd87fec23f27134bd1b43d93c" exitCode=0 May 21 13:12:31.673303 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:31.673273 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bnwhp" event={"ID":"7db4c9c4-0c8f-4246-83ff-5fabb93c5df0","Type":"ContainerDied","Data":"8c770d3dccc5639493ee146d7f2547cc4c71ec2cd87fec23f27134bd1b43d93c"} May 21 13:12:32.679159 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:32.679126 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bnwhp" event={"ID":"7db4c9c4-0c8f-4246-83ff-5fabb93c5df0","Type":"ContainerStarted","Data":"aa4f3c446f18ea43eac266c12041176b88a57ef7801d3f383d4564a377f23b0b"} May 21 13:12:32.679674 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:32.679340 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bnwhp" May 21 13:12:32.701110 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:32.701068 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bnwhp" podStartSLOduration=8.386424359 podStartE2EDuration="8.701055783s" podCreationTimestamp="2026-05-21 13:12:24 +0000 UTC" firstStartedPulling="2026-05-21 13:12:31.674185298 +0000 UTC m=+614.528896771" lastFinishedPulling="2026-05-21 13:12:31.988816727 +0000 UTC m=+614.843528195" observedRunningTime="2026-05-21 13:12:32.699963696 +0000 UTC m=+615.554675186" watchObservedRunningTime="2026-05-21 13:12:32.701055783 +0000 UTC m=+615.555767272" May 21 13:12:41.686558 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:41.686485 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz" May 21 13:12:43.696494 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:12:43.696466 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-bnwhp" May 21 13:13:36.638111 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:13:36.638076 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f5d677b57-bd4mk"] May 21 13:13:36.638696 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:13:36.638334 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f5d677b57-bd4mk" podUID="39f1e5ac-d15d-40be-b2fd-36ea76768fbe" containerName="authorino" containerID="cri-o://96087a620392a4d0133b7414566323f45d5eef428b19e9cccd263f7c531eb103" gracePeriod=30 May 21 13:13:36.870739 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:13:36.870717 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f5d677b57-bd4mk" May 21 13:13:36.884581 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:13:36.884547 2561 generic.go:358] "Generic (PLEG): container finished" podID="39f1e5ac-d15d-40be-b2fd-36ea76768fbe" containerID="96087a620392a4d0133b7414566323f45d5eef428b19e9cccd263f7c531eb103" exitCode=0 May 21 13:13:36.884684 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:13:36.884607 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f5d677b57-bd4mk" May 21 13:13:36.884727 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:13:36.884608 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f5d677b57-bd4mk" event={"ID":"39f1e5ac-d15d-40be-b2fd-36ea76768fbe","Type":"ContainerDied","Data":"96087a620392a4d0133b7414566323f45d5eef428b19e9cccd263f7c531eb103"} May 21 13:13:36.884727 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:13:36.884707 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f5d677b57-bd4mk" event={"ID":"39f1e5ac-d15d-40be-b2fd-36ea76768fbe","Type":"ContainerDied","Data":"0d6bc32631857a3e5947dd287cf050e7c2347b44d41568c5b6066055f8a2d2b2"} May 21 13:13:36.884727 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:13:36.884724 2561 scope.go:117] "RemoveContainer" containerID="96087a620392a4d0133b7414566323f45d5eef428b19e9cccd263f7c531eb103" May 21 13:13:36.896228 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:13:36.896196 2561 scope.go:117] "RemoveContainer" containerID="96087a620392a4d0133b7414566323f45d5eef428b19e9cccd263f7c531eb103" May 21 13:13:36.896489 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:13:36.896467 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96087a620392a4d0133b7414566323f45d5eef428b19e9cccd263f7c531eb103\": container with ID starting with 96087a620392a4d0133b7414566323f45d5eef428b19e9cccd263f7c531eb103 not found: ID does not exist" containerID="96087a620392a4d0133b7414566323f45d5eef428b19e9cccd263f7c531eb103" May 21 13:13:36.896583 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:13:36.896503 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96087a620392a4d0133b7414566323f45d5eef428b19e9cccd263f7c531eb103"} err="failed to get container status \"96087a620392a4d0133b7414566323f45d5eef428b19e9cccd263f7c531eb103\": rpc error: code = NotFound desc = could not find container \"96087a620392a4d0133b7414566323f45d5eef428b19e9cccd263f7c531eb103\": container with ID starting with 96087a620392a4d0133b7414566323f45d5eef428b19e9cccd263f7c531eb103 not found: ID does not exist" May 21 13:13:36.992809 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:13:36.992780 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/39f1e5ac-d15d-40be-b2fd-36ea76768fbe-tls-cert\") pod \"39f1e5ac-d15d-40be-b2fd-36ea76768fbe\" (UID: \"39f1e5ac-d15d-40be-b2fd-36ea76768fbe\") " May 21 13:13:36.992987 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:13:36.992815 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mchfv\" (UniqueName: \"kubernetes.io/projected/39f1e5ac-d15d-40be-b2fd-36ea76768fbe-kube-api-access-mchfv\") pod \"39f1e5ac-d15d-40be-b2fd-36ea76768fbe\" (UID: \"39f1e5ac-d15d-40be-b2fd-36ea76768fbe\") " May 21 13:13:36.994718 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:13:36.994697 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39f1e5ac-d15d-40be-b2fd-36ea76768fbe-kube-api-access-mchfv" (OuterVolumeSpecName: "kube-api-access-mchfv") pod "39f1e5ac-d15d-40be-b2fd-36ea76768fbe" (UID: "39f1e5ac-d15d-40be-b2fd-36ea76768fbe"). InnerVolumeSpecName "kube-api-access-mchfv". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:13:37.003938 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:13:37.003911 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39f1e5ac-d15d-40be-b2fd-36ea76768fbe-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "39f1e5ac-d15d-40be-b2fd-36ea76768fbe" (UID: "39f1e5ac-d15d-40be-b2fd-36ea76768fbe"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 21 13:13:37.093394 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:13:37.093355 2561 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/39f1e5ac-d15d-40be-b2fd-36ea76768fbe-tls-cert\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\"" May 21 13:13:37.093394 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:13:37.093393 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mchfv\" (UniqueName: \"kubernetes.io/projected/39f1e5ac-d15d-40be-b2fd-36ea76768fbe-kube-api-access-mchfv\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\"" May 21 13:13:37.240019 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:13:37.239985 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f5d677b57-bd4mk"] May 21 13:13:37.250476 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:13:37.250446 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f5d677b57-bd4mk"] May 21 13:13:37.692051 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:13:37.692023 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39f1e5ac-d15d-40be-b2fd-36ea76768fbe" path="/var/lib/kubelet/pods/39f1e5ac-d15d-40be-b2fd-36ea76768fbe/volumes" May 21 13:25:24.474551 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:25:24.474515 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kqfgw"] May 21 13:25:24.477076 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:25:24.474778 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kqfgw" podUID="0a435f1a-92d5-498e-a8cd-38dfffe2ef51" containerName="manager" containerID="cri-o://f991548169d42f55d665a0f19257056ef0ef7de8bcc25f4935ddf5101655ce49" gracePeriod=10 May 21 13:25:24.826962 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:25:24.826941 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kqfgw" May 21 13:25:24.932205 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:25:24.932175 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bh8l6\" (UniqueName: \"kubernetes.io/projected/0a435f1a-92d5-498e-a8cd-38dfffe2ef51-kube-api-access-bh8l6\") pod \"0a435f1a-92d5-498e-a8cd-38dfffe2ef51\" (UID: \"0a435f1a-92d5-498e-a8cd-38dfffe2ef51\") " May 21 13:25:24.932401 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:25:24.932237 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a435f1a-92d5-498e-a8cd-38dfffe2ef51-extensions-socket-volume\") pod \"0a435f1a-92d5-498e-a8cd-38dfffe2ef51\" (UID: \"0a435f1a-92d5-498e-a8cd-38dfffe2ef51\") " May 21 13:25:24.932621 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:25:24.932597 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a435f1a-92d5-498e-a8cd-38dfffe2ef51-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0a435f1a-92d5-498e-a8cd-38dfffe2ef51" (UID: "0a435f1a-92d5-498e-a8cd-38dfffe2ef51"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 13:25:24.934168 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:25:24.934139 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a435f1a-92d5-498e-a8cd-38dfffe2ef51-kube-api-access-bh8l6" (OuterVolumeSpecName: "kube-api-access-bh8l6") pod "0a435f1a-92d5-498e-a8cd-38dfffe2ef51" (UID: "0a435f1a-92d5-498e-a8cd-38dfffe2ef51"). InnerVolumeSpecName "kube-api-access-bh8l6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 13:25:25.033274 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:25:25.033195 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bh8l6\" (UniqueName: \"kubernetes.io/projected/0a435f1a-92d5-498e-a8cd-38dfffe2ef51-kube-api-access-bh8l6\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\"" May 21 13:25:25.033274 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:25:25.033221 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a435f1a-92d5-498e-a8cd-38dfffe2ef51-extensions-socket-volume\") on node \"ip-10-0-143-142.ec2.internal\" DevicePath \"\"" May 21 13:25:25.259017 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:25:25.258984 2561 generic.go:358] "Generic (PLEG): container finished" podID="0a435f1a-92d5-498e-a8cd-38dfffe2ef51" containerID="f991548169d42f55d665a0f19257056ef0ef7de8bcc25f4935ddf5101655ce49" exitCode=0 May 21 13:25:25.259176 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:25:25.259027 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kqfgw" event={"ID":"0a435f1a-92d5-498e-a8cd-38dfffe2ef51","Type":"ContainerDied","Data":"f991548169d42f55d665a0f19257056ef0ef7de8bcc25f4935ddf5101655ce49"} May 21 13:25:25.259176 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:25:25.259044 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kqfgw" May 21 13:25:25.259176 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:25:25.259060 2561 scope.go:117] "RemoveContainer" containerID="f991548169d42f55d665a0f19257056ef0ef7de8bcc25f4935ddf5101655ce49" May 21 13:25:25.259176 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:25:25.259050 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kqfgw" event={"ID":"0a435f1a-92d5-498e-a8cd-38dfffe2ef51","Type":"ContainerDied","Data":"51bac5b63aea0d687c0cf1dc47b694dadb42244c7e6e6eefb0e3aa4b2e7de62d"} May 21 13:25:25.267521 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:25:25.267504 2561 scope.go:117] "RemoveContainer" containerID="f991548169d42f55d665a0f19257056ef0ef7de8bcc25f4935ddf5101655ce49" May 21 13:25:25.267779 ip-10-0-143-142 kubenswrapper[2561]: E0521 13:25:25.267761 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f991548169d42f55d665a0f19257056ef0ef7de8bcc25f4935ddf5101655ce49\": container with ID starting with f991548169d42f55d665a0f19257056ef0ef7de8bcc25f4935ddf5101655ce49 not found: ID does not exist" containerID="f991548169d42f55d665a0f19257056ef0ef7de8bcc25f4935ddf5101655ce49" May 21 13:25:25.267837 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:25:25.267787 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f991548169d42f55d665a0f19257056ef0ef7de8bcc25f4935ddf5101655ce49"} err="failed to get container status \"f991548169d42f55d665a0f19257056ef0ef7de8bcc25f4935ddf5101655ce49\": rpc error: code = NotFound desc = could not find container \"f991548169d42f55d665a0f19257056ef0ef7de8bcc25f4935ddf5101655ce49\": container with ID starting with f991548169d42f55d665a0f19257056ef0ef7de8bcc25f4935ddf5101655ce49 not found: ID does not exist" May 21 13:25:25.279598 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:25:25.279554 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kqfgw"] May 21 13:25:25.284266 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:25:25.284216 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kqfgw"] May 21 13:25:25.692153 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:25:25.692122 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a435f1a-92d5-498e-a8cd-38dfffe2ef51" path="/var/lib/kubelet/pods/0a435f1a-92d5-498e-a8cd-38dfffe2ef51/volumes" May 21 13:26:30.563874 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:26:30.563841 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wd7t"] May 21 13:26:30.564252 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:26:30.564146 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a435f1a-92d5-498e-a8cd-38dfffe2ef51" containerName="manager" May 21 13:26:30.564252 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:26:30.564156 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a435f1a-92d5-498e-a8cd-38dfffe2ef51" containerName="manager" May 21 13:26:30.564252 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:26:30.564163 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39f1e5ac-d15d-40be-b2fd-36ea76768fbe" containerName="authorino" May 21 13:26:30.564252 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:26:30.564168 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="39f1e5ac-d15d-40be-b2fd-36ea76768fbe" containerName="authorino" May 21 13:26:30.564252 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:26:30.564226 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="0a435f1a-92d5-498e-a8cd-38dfffe2ef51" containerName="manager" May 21 13:26:30.564252 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:26:30.564236 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="39f1e5ac-d15d-40be-b2fd-36ea76768fbe" containerName="authorino" May 21 13:26:30.567134 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:26:30.567117 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wd7t" May 21 13:26:30.570075 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:26:30.570053 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-s5swn\"" May 21 13:26:30.581898 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:26:30.581877 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wd7t"] May 21 13:26:30.662695 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:26:30.662657 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mmzd\" (UniqueName: \"kubernetes.io/projected/2fb3d19d-0ae5-4dbd-a098-6bb181783a4b-kube-api-access-2mmzd\") pod \"kuadrant-operator-controller-manager-55c7f4c975-5wd7t\" (UID: \"2fb3d19d-0ae5-4dbd-a098-6bb181783a4b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wd7t" May 21 13:26:30.662695 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:26:30.662697 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fb3d19d-0ae5-4dbd-a098-6bb181783a4b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-5wd7t\" (UID: \"2fb3d19d-0ae5-4dbd-a098-6bb181783a4b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wd7t" May 21 13:26:30.763312 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:26:30.763279 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2mmzd\" (UniqueName: \"kubernetes.io/projected/2fb3d19d-0ae5-4dbd-a098-6bb181783a4b-kube-api-access-2mmzd\") pod \"kuadrant-operator-controller-manager-55c7f4c975-5wd7t\" (UID: \"2fb3d19d-0ae5-4dbd-a098-6bb181783a4b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wd7t" May 21 13:26:30.763312 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:26:30.763315 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fb3d19d-0ae5-4dbd-a098-6bb181783a4b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-5wd7t\" (UID: \"2fb3d19d-0ae5-4dbd-a098-6bb181783a4b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wd7t" May 21 13:26:30.763704 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:26:30.763686 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fb3d19d-0ae5-4dbd-a098-6bb181783a4b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-5wd7t\" (UID: \"2fb3d19d-0ae5-4dbd-a098-6bb181783a4b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wd7t" May 21 13:26:30.777014 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:26:30.776989 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mmzd\" (UniqueName: \"kubernetes.io/projected/2fb3d19d-0ae5-4dbd-a098-6bb181783a4b-kube-api-access-2mmzd\") pod \"kuadrant-operator-controller-manager-55c7f4c975-5wd7t\" (UID: \"2fb3d19d-0ae5-4dbd-a098-6bb181783a4b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wd7t" May 21 13:26:30.876681 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:26:30.876651 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wd7t" May 21 13:26:31.013661 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:26:31.013633 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wd7t"] May 21 13:26:31.016375 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:26:31.016349 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fb3d19d_0ae5_4dbd_a098_6bb181783a4b.slice/crio-4e59f2b452233ce14632c8535c1f7a08e2e19a0f0fb10cc6f5cfb96b6adae2dc WatchSource:0}: Error finding container 4e59f2b452233ce14632c8535c1f7a08e2e19a0f0fb10cc6f5cfb96b6adae2dc: Status 404 returned error can't find the container with id 4e59f2b452233ce14632c8535c1f7a08e2e19a0f0fb10cc6f5cfb96b6adae2dc May 21 13:26:31.018771 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:26:31.018755 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 13:26:31.483735 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:26:31.483701 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wd7t" event={"ID":"2fb3d19d-0ae5-4dbd-a098-6bb181783a4b","Type":"ContainerStarted","Data":"f82dd1bbe45af501ea3d6a4d9076b0d29528dbd8ee07aa9bf207b66c55f52081"} May 21 13:26:31.483735 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:26:31.483740 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wd7t" event={"ID":"2fb3d19d-0ae5-4dbd-a098-6bb181783a4b","Type":"ContainerStarted","Data":"4e59f2b452233ce14632c8535c1f7a08e2e19a0f0fb10cc6f5cfb96b6adae2dc"} May 21 13:26:31.483958 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:26:31.483818 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wd7t" May 21 13:26:31.508530 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:26:31.508485 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wd7t" podStartSLOduration=1.508472899 podStartE2EDuration="1.508472899s" podCreationTimestamp="2026-05-21 13:26:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 13:26:31.506066079 +0000 UTC m=+1454.360777570" watchObservedRunningTime="2026-05-21 13:26:31.508472899 +0000 UTC m=+1454.363184388" May 21 13:26:42.489028 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:26:42.488993 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-5wd7t" May 21 13:36:15.620730 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:15.620697 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-nmsvn_df26c505-ad27-46e2-beb7-72478f31795c/manager/0.log" May 21 13:36:15.797170 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:15.797147 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-68df9d8dd8-zzg26_3300aca5-4567-4ef1-aeaa-5ed0d63cd4ac/maas-api/0.log" May 21 13:36:16.336694 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:16.336668 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-vqnnp_90cb3c5f-ed98-4e2b-8367-e5b05788e44a/manager/2.log" May 21 13:36:16.674666 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:16.674643 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8545859b7d-zpfhp_1dc30b58-ad90-4ade-a17d-4be95ce05b0d/manager/0.log" May 21 13:36:19.230033 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:19.230005 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-5wd7t_2fb3d19d-0ae5-4dbd-a098-6bb181783a4b/manager/0.log" May 21 13:36:19.521177 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:19.521068 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-qpfzb_dda030b3-3830-474c-8819-fa83b779f817/manager/0.log" May 21 13:36:20.022308 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:20.022277 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-rjv2d_5fddc3ec-0e00-4816-b929-8e958b4a4396/discovery/0.log" May 21 13:36:20.260732 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:20.260703 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-577646db99-xxhxc_e31e2dd5-b7fd-437f-8a85-a4e9f4a1536b/kube-auth-proxy/0.log" May 21 13:36:20.508881 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:20.508853 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-8szb4_4c4d6a1a-b28f-480c-966d-3ef554815948/payload-processing/0.log" May 21 13:36:21.343807 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:21.343779 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-bnwhp_7db4c9c4-0c8f-4246-83ff-5fabb93c5df0/storage-initializer/0.log" May 21 13:36:21.368098 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:21.368076 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-bnwhp_7db4c9c4-0c8f-4246-83ff-5fabb93c5df0/main/0.log" May 21 13:36:21.499412 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:21.499388 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz_14470b82-d3d6-400e-8572-f8b97b08e785/storage-initializer/0.log" May 21 13:36:21.519294 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:21.519272 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccb5lhz_14470b82-d3d6-400e-8572-f8b97b08e785/main/0.log" May 21 13:36:29.347671 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:29.347636 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wpjmn_8621c605-ffd6-4f1c-8279-33031fef7e8f/global-pull-secret-syncer/0.log" May 21 13:36:29.496813 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:29.496779 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-z99cs_c90f9ff1-662a-4aeb-8c12-ec54ec6c9eb0/konnectivity-agent/0.log" May 21 13:36:29.607775 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:29.607697 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-142.ec2.internal_a38ea9a58019d421754c06e634aaf4f8/haproxy/0.log" May 21 13:36:34.962820 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:34.962790 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-5wd7t_2fb3d19d-0ae5-4dbd-a098-6bb181783a4b/manager/0.log" May 21 13:36:35.098787 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:35.098758 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-qpfzb_dda030b3-3830-474c-8819-fa83b779f817/manager/0.log" May 21 13:36:36.994063 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:36.994007 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jp4z9_ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4/node-exporter/0.log" May 21 13:36:37.046067 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:37.046039 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jp4z9_ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4/kube-rbac-proxy/0.log" May 21 13:36:37.099325 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:37.099299 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jp4z9_ca2ae8aa-4309-4f0a-9c3b-4836a117e5c4/init-textfile/0.log" May 21 13:36:37.568520 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:37.568492 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pn2g5/perf-node-gather-daemonset-7lxtf"] May 21 13:36:37.571819 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:37.571803 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-7lxtf" May 21 13:36:37.577986 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:37.577875 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pn2g5\"/\"kube-root-ca.crt\"" May 21 13:36:37.579046 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:37.579013 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pn2g5\"/\"openshift-service-ca.crt\"" May 21 13:36:37.579046 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:37.579033 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pn2g5\"/\"default-dockercfg-dz7nz\"" May 21 13:36:37.598036 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:37.598014 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pn2g5/perf-node-gather-daemonset-7lxtf"] May 21 13:36:37.656295 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:37.656266 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c-podres\") pod \"perf-node-gather-daemonset-7lxtf\" (UID: \"bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-7lxtf" May 21 13:36:37.656433 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:37.656339 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c-sys\") pod \"perf-node-gather-daemonset-7lxtf\" (UID: \"bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-7lxtf" May 21 13:36:37.656433 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:37.656383 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td9qg\" (UniqueName: \"kubernetes.io/projected/bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c-kube-api-access-td9qg\") pod \"perf-node-gather-daemonset-7lxtf\" (UID: \"bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-7lxtf" May 21 13:36:37.656433 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:37.656406 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c-proc\") pod \"perf-node-gather-daemonset-7lxtf\" (UID: \"bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-7lxtf" May 21 13:36:37.656536 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:37.656496 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c-lib-modules\") pod \"perf-node-gather-daemonset-7lxtf\" (UID: \"bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-7lxtf" May 21 13:36:37.757542 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:37.757513 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c-podres\") pod \"perf-node-gather-daemonset-7lxtf\" (UID: \"bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-7lxtf" May 21 13:36:37.757710 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:37.757551 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c-sys\") pod \"perf-node-gather-daemonset-7lxtf\" (UID: \"bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-7lxtf" May 21 13:36:37.757710 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:37.757592 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-td9qg\" (UniqueName: \"kubernetes.io/projected/bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c-kube-api-access-td9qg\") pod \"perf-node-gather-daemonset-7lxtf\" (UID: \"bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-7lxtf" May 21 13:36:37.757710 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:37.757609 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c-proc\") pod \"perf-node-gather-daemonset-7lxtf\" (UID: \"bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-7lxtf" May 21 13:36:37.757710 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:37.757651 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c-lib-modules\") pod \"perf-node-gather-daemonset-7lxtf\" (UID: \"bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-7lxtf" May 21 13:36:37.757710 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:37.757671 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c-podres\") pod \"perf-node-gather-daemonset-7lxtf\" (UID: \"bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-7lxtf" May 21 13:36:37.757710 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:37.757690 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c-sys\") pod \"perf-node-gather-daemonset-7lxtf\" (UID: \"bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-7lxtf" May 21 13:36:37.757926 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:37.757725 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c-proc\") pod \"perf-node-gather-daemonset-7lxtf\" (UID: \"bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-7lxtf" May 21 13:36:37.757926 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:37.757765 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c-lib-modules\") pod \"perf-node-gather-daemonset-7lxtf\" (UID: \"bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-7lxtf" May 21 13:36:37.767230 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:37.767203 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-td9qg\" (UniqueName: \"kubernetes.io/projected/bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c-kube-api-access-td9qg\") pod \"perf-node-gather-daemonset-7lxtf\" (UID: \"bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c\") " pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-7lxtf" May 21 13:36:37.882000 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:37.881975 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-7lxtf" May 21 13:36:38.016895 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:38.016850 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pn2g5/perf-node-gather-daemonset-7lxtf"] May 21 13:36:38.019938 ip-10-0-143-142 kubenswrapper[2561]: W0521 13:36:38.019908 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbf08ae82_ecf6_423d_b88b_3b7b9dc45c4c.slice/crio-479042e8250e4006bd28f47bc60bf001de77a59337359e0154e3325ff63eee2f WatchSource:0}: Error finding container 479042e8250e4006bd28f47bc60bf001de77a59337359e0154e3325ff63eee2f: Status 404 returned error can't find the container with id 479042e8250e4006bd28f47bc60bf001de77a59337359e0154e3325ff63eee2f May 21 13:36:38.021677 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:38.021656 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 13:36:38.523217 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:38.523184 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-7lxtf" event={"ID":"bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c","Type":"ContainerStarted","Data":"d3a03f718d5d0fd2cb926a84c0faa12103d449188901b4ab9ddc332ab3a134db"} May 21 13:36:38.523217 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:38.523218 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-7lxtf" event={"ID":"bf08ae82-ecf6-423d-b88b-3b7b9dc45c4c","Type":"ContainerStarted","Data":"479042e8250e4006bd28f47bc60bf001de77a59337359e0154e3325ff63eee2f"} May 21 13:36:38.523405 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:38.523294 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-7lxtf" May 21 13:36:38.542639 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:38.542597 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-7lxtf" podStartSLOduration=1.542553334 podStartE2EDuration="1.542553334s" podCreationTimestamp="2026-05-21 13:36:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 13:36:38.541070853 +0000 UTC m=+2061.395782341" watchObservedRunningTime="2026-05-21 13:36:38.542553334 +0000 UTC m=+2061.397264823" May 21 13:36:39.004525 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:39.004494 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-qps6z_1602ae60-f2e5-40c7-ac65-56a27fde007a/networking-console-plugin/0.log" May 21 13:36:41.416176 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:41.416153 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9cl59_26c9dda0-e679-4ac2-bab6-7df9f5f26703/dns/0.log" May 21 13:36:41.444320 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:41.444292 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9cl59_26c9dda0-e679-4ac2-bab6-7df9f5f26703/kube-rbac-proxy/0.log" May 21 13:36:41.671080 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:41.671015 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9zcrx_3a149808-cb2d-482b-8d99-7e2d58b6b997/dns-node-resolver/0.log" May 21 13:36:42.317537 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:42.317507 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hts48_d6095d2c-d51f-42aa-9514-91273a5b74a7/node-ca/0.log" May 21 13:36:43.317715 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:43.317675 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-rjv2d_5fddc3ec-0e00-4816-b929-8e958b4a4396/discovery/0.log" May 21 13:36:43.369417 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:43.369393 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-577646db99-xxhxc_e31e2dd5-b7fd-437f-8a85-a4e9f4a1536b/kube-auth-proxy/0.log" May 21 13:36:43.506829 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:43.506795 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-8szb4_4c4d6a1a-b28f-480c-966d-3ef554815948/payload-processing/0.log" May 21 13:36:44.258332 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:44.258306 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r7bq5_5efbaa38-37d0-454b-9599-c194f169cd39/serve-healthcheck-canary/0.log" May 21 13:36:44.537702 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:44.537634 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pn2g5/perf-node-gather-daemonset-7lxtf" May 21 13:36:45.055820 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:45.055791 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pfcxz_9b82e57e-bc5f-405a-b589-f2fab982c427/kube-rbac-proxy/0.log" May 21 13:36:45.090767 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:45.090746 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pfcxz_9b82e57e-bc5f-405a-b589-f2fab982c427/exporter/0.log" May 21 13:36:45.124151 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:45.124123 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pfcxz_9b82e57e-bc5f-405a-b589-f2fab982c427/extractor/0.log" May 21 13:36:47.518172 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:47.518143 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-nmsvn_df26c505-ad27-46e2-beb7-72478f31795c/manager/0.log" May 21 13:36:47.551415 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:47.551390 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-68df9d8dd8-zzg26_3300aca5-4567-4ef1-aeaa-5ed0d63cd4ac/maas-api/0.log" May 21 13:36:47.712034 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:47.712008 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-vqnnp_90cb3c5f-ed98-4e2b-8367-e5b05788e44a/manager/1.log" May 21 13:36:47.721752 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:47.721728 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-vqnnp_90cb3c5f-ed98-4e2b-8367-e5b05788e44a/manager/2.log" May 21 13:36:47.796911 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:47.796887 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8545859b7d-zpfhp_1dc30b58-ad90-4ade-a17d-4be95ce05b0d/manager/0.log" May 21 13:36:53.816453 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:53.816427 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-7bmnm_f545c6e3-e3f4-4c9d-8cff-230fc949f3bc/migrator/0.log" May 21 13:36:53.849120 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:53.849096 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-7bmnm_f545c6e3-e3f4-4c9d-8cff-230fc949f3bc/graceful-termination/0.log" May 21 13:36:54.268202 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:54.268175 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-8rd5h_de80e51e-6c75-4dab-a690-14b4eb31eb99/kube-storage-version-migrator-operator/1.log" May 21 13:36:54.269008 ip-10-0-143-142 kubenswrapper[2561]: I0521 13:36:54.268992 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-8rd5h_de80e51e-6c75-4dab-a690-14b4eb31eb99/kube-storage-version-migrator-operator/0.log"