May 21 14:54:32.574331 ip-10-0-137-49 systemd[1]: Starting Kubernetes Kubelet... May 21 14:54:33.052963 ip-10-0-137-49 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 14:54:33.052963 ip-10-0-137-49 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 21 14:54:33.052963 ip-10-0-137-49 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 14:54:33.052963 ip-10-0-137-49 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 21 14:54:33.052963 ip-10-0-137-49 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 21 14:54:33.056452 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.056346 2557 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 21 14:54:33.061578 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061543 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:54:33.061578 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061572 2557 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:54:33.061578 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061576 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:54:33.061578 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061579 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:54:33.061578 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061582 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:54:33.061578 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061585 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:54:33.061578 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061588 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:54:33.061578 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061591 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:54:33.061578 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061593 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:54:33.061922 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061597 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:54:33.061922 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061600 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:54:33.061922 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061604 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:54:33.061922 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061608 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:54:33.061922 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061611 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:54:33.061922 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061614 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:54:33.061922 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061617 2557 feature_gate.go:328] unrecognized feature gate: Example May 21 14:54:33.061922 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061619 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:54:33.061922 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061622 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:54:33.061922 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061625 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:54:33.061922 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061627 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:54:33.061922 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061630 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:54:33.061922 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061633 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:54:33.061922 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061635 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:54:33.061922 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061638 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:54:33.061922 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061640 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:54:33.061922 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061644 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:54:33.061922 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061646 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:54:33.061922 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061649 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:54:33.061922 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061651 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:54:33.062432 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061654 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:54:33.062432 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061657 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:54:33.062432 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061661 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:54:33.062432 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061666 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:54:33.062432 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061671 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:54:33.062432 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061673 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:54:33.062432 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061678 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:54:33.062432 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061680 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:54:33.062432 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061683 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:54:33.062432 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061686 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:54:33.062432 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061689 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:54:33.062432 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061692 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:54:33.062432 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061695 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:54:33.062432 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061699 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:54:33.062432 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061702 2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:54:33.062432 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061704 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:54:33.062432 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061710 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:54:33.062432 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061713 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:54:33.062432 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061716 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:54:33.062898 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061719 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:54:33.062898 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061722 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:54:33.062898 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061725 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:54:33.062898 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061727 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:54:33.062898 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061730 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:54:33.062898 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061733 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:54:33.062898 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061735 2557 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:54:33.062898 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061738 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:54:33.062898 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061741 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:54:33.062898 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061743 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:54:33.062898 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061746 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:54:33.062898 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061748 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:54:33.062898 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061751 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:54:33.062898 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061754 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:54:33.062898 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061757 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:54:33.062898 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061759 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:54:33.062898 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061762 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:54:33.062898 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061764 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:54:33.062898 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061767 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:54:33.062898 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061770 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:54:33.063404 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061773 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:54:33.063404 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061776 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:54:33.063404 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061779 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:54:33.063404 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061781 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:54:33.063404 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061791 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:54:33.063404 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061796 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:54:33.063404 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061800 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:54:33.063404 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061802 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:54:33.063404 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061805 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:54:33.063404 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061808 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:54:33.063404 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061812 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:54:33.063404 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061814 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:54:33.063404 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061817 2557 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:54:33.063404 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061820 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:54:33.063404 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061823 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:54:33.063404 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061825 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:54:33.063404 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061828 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:54:33.063404 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.061831 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:54:33.063404 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062297 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:54:33.063404 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062303 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:54:33.063884 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062306 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:54:33.063884 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062310 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:54:33.063884 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062312 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:54:33.063884 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062315 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:54:33.063884 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062318 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:54:33.063884 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062321 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:54:33.063884 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062324 2557 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:54:33.063884 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062329 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:54:33.063884 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062332 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:54:33.063884 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062335 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:54:33.063884 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062338 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:54:33.063884 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062341 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:54:33.063884 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062344 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:54:33.063884 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062346 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:54:33.063884 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062349 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:54:33.063884 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062351 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:54:33.063884 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062354 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:54:33.063884 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062357 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:54:33.063884 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062361 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:54:33.064368 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062364 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:54:33.064368 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062367 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:54:33.064368 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062369 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:54:33.064368 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062372 2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:54:33.064368 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062375 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:54:33.064368 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062378 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:54:33.064368 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062381 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:54:33.064368 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062384 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:54:33.064368 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062387 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:54:33.064368 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062390 2557 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:54:33.064368 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062393 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:54:33.064368 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062396 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:54:33.064368 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062399 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:54:33.064368 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062402 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:54:33.064368 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062404 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:54:33.064368 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062407 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:54:33.064368 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062410 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:54:33.064368 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062412 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:54:33.064368 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062415 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:54:33.064846 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062418 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:54:33.064846 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062421 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:54:33.064846 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062423 2557 feature_gate.go:328] unrecognized feature gate: Example May 21 14:54:33.064846 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062426 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:54:33.064846 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062429 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:54:33.064846 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062431 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:54:33.064846 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062434 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:54:33.064846 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062437 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:54:33.064846 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062440 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:54:33.064846 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062442 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:54:33.064846 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062445 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:54:33.064846 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062448 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:54:33.064846 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062452 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:54:33.064846 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062455 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:54:33.064846 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062458 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:54:33.064846 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062460 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:54:33.064846 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062463 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:54:33.064846 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062466 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:54:33.064846 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062468 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:54:33.064846 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062471 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:54:33.065358 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062474 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:54:33.065358 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062477 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:54:33.065358 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062479 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:54:33.065358 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062482 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:54:33.065358 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062484 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:54:33.065358 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062487 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:54:33.065358 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062489 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:54:33.065358 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062492 2557 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:54:33.065358 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062494 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:54:33.065358 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062497 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:54:33.065358 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062499 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:54:33.065358 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062502 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:54:33.065358 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062505 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:54:33.065358 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062508 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:54:33.065358 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062510 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:54:33.065358 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062513 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:54:33.065358 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062515 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:54:33.065358 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062518 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:54:33.065358 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062520 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:54:33.065358 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062523 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:54:33.065856 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062525 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:54:33.065856 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062528 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:54:33.065856 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062530 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:54:33.065856 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062533 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:54:33.065856 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062535 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:54:33.065856 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.062538 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:54:33.065856 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063239 2557 flags.go:64] FLAG: --address="0.0.0.0" May 21 14:54:33.065856 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063251 2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 21 14:54:33.065856 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063259 2557 flags.go:64] FLAG: --anonymous-auth="true" May 21 14:54:33.065856 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063264 2557 flags.go:64] FLAG: --application-metrics-count-limit="100" May 21 14:54:33.065856 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063270 2557 flags.go:64] FLAG: --authentication-token-webhook="false" May 21 14:54:33.065856 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063274 2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 21 14:54:33.065856 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063280 2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 21 14:54:33.065856 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063290 2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 21 14:54:33.065856 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063293 2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 21 14:54:33.065856 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063297 2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 21 14:54:33.065856 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063301 2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 21 14:54:33.065856 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063305 2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 21 14:54:33.065856 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063308 2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 21 14:54:33.065856 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063311 2557 flags.go:64] FLAG: --cgroup-root="" May 21 14:54:33.065856 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063314 2557 flags.go:64] FLAG: --cgroups-per-qos="true" May 21 14:54:33.065856 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063317 2557 flags.go:64] FLAG: --client-ca-file="" May 21 14:54:33.065856 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063321 2557 flags.go:64] FLAG: --cloud-config="" May 21 14:54:33.066469 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063324 2557 flags.go:64] FLAG: --cloud-provider="external" May 21 14:54:33.066469 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063326 2557 flags.go:64] FLAG: --cluster-dns="[]" May 21 14:54:33.066469 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063331 2557 flags.go:64] FLAG: --cluster-domain="" May 21 14:54:33.066469 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063334 2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 21 14:54:33.066469 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063337 2557 flags.go:64] FLAG: --config-dir="" May 21 14:54:33.066469 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063340 2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 21 14:54:33.066469 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063344 2557 flags.go:64] FLAG: --container-log-max-files="5" May 21 14:54:33.066469 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063348 2557 flags.go:64] FLAG: --container-log-max-size="10Mi" May 21 14:54:33.066469 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063352 2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 21 14:54:33.066469 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063355 2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 21 14:54:33.066469 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063358 2557 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 21 14:54:33.066469 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063362 2557 flags.go:64] FLAG: --contention-profiling="false" May 21 14:54:33.066469 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063365 2557 flags.go:64] FLAG: --cpu-cfs-quota="true" May 21 14:54:33.066469 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063368 2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 21 14:54:33.066469 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063372 2557 flags.go:64] FLAG: --cpu-manager-policy="none" May 21 14:54:33.066469 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063375 2557 flags.go:64] FLAG: --cpu-manager-policy-options="" May 21 14:54:33.066469 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063380 2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 21 14:54:33.066469 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063383 2557 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 21 14:54:33.066469 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063386 2557 flags.go:64] FLAG: --enable-debugging-handlers="true" May 21 14:54:33.066469 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063389 2557 flags.go:64] FLAG: --enable-load-reader="false" May 21 14:54:33.066469 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063393 2557 flags.go:64] FLAG: --enable-server="true" May 21 14:54:33.066469 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063396 2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 21 14:54:33.066469 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063401 2557 flags.go:64] FLAG: --event-burst="100" May 21 14:54:33.066469 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063405 2557 flags.go:64] FLAG: --event-qps="50" May 21 14:54:33.066469 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063408 2557 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 21 14:54:33.067112 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063412 2557 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 21 14:54:33.067112 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063415 2557 flags.go:64] FLAG: --eviction-hard="" May 21 14:54:33.067112 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063420 2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 21 14:54:33.067112 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063423 2557 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 21 14:54:33.067112 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063427 2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 21 14:54:33.067112 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063430 2557 flags.go:64] FLAG: --eviction-soft="" May 21 14:54:33.067112 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063433 2557 flags.go:64] FLAG: --eviction-soft-grace-period="" May 21 14:54:33.067112 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063436 2557 flags.go:64] FLAG: --exit-on-lock-contention="false" May 21 14:54:33.067112 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063439 2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 21 14:54:33.067112 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063442 2557 flags.go:64] FLAG: --experimental-mounter-path="" May 21 14:54:33.067112 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063445 2557 flags.go:64] FLAG: --fail-cgroupv1="false" May 21 14:54:33.067112 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063449 2557 flags.go:64] FLAG: --fail-swap-on="true" May 21 14:54:33.067112 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063452 2557 flags.go:64] FLAG: --feature-gates="" May 21 14:54:33.067112 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063457 2557 flags.go:64] FLAG: --file-check-frequency="20s" May 21 14:54:33.067112 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063460 2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 21 14:54:33.067112 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063464 2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 21 14:54:33.067112 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063468 2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 21 14:54:33.067112 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063471 2557 flags.go:64] FLAG: --healthz-port="10248" May 21 14:54:33.067112 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063474 2557 flags.go:64] FLAG: --help="false" May 21 14:54:33.067112 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063478 2557 flags.go:64] FLAG: --hostname-override="ip-10-0-137-49.ec2.internal" May 21 14:54:33.067112 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063481 2557 flags.go:64] FLAG: --housekeeping-interval="10s" May 21 14:54:33.067112 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063484 2557 flags.go:64] FLAG: --http-check-frequency="20s" May 21 14:54:33.067112 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063487 2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 21 14:54:33.067708 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063491 2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 21 14:54:33.067708 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063494 2557 flags.go:64] FLAG: --image-gc-high-threshold="85" May 21 14:54:33.067708 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063497 2557 flags.go:64] FLAG: --image-gc-low-threshold="80" May 21 14:54:33.067708 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063500 2557 flags.go:64] FLAG: --image-service-endpoint="" May 21 14:54:33.067708 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063503 2557 flags.go:64] FLAG: --kernel-memcg-notification="false" May 21 14:54:33.067708 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063507 2557 flags.go:64] FLAG: --kube-api-burst="100" May 21 14:54:33.067708 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063510 2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 21 14:54:33.067708 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063513 2557 flags.go:64] FLAG: --kube-api-qps="50" May 21 14:54:33.067708 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063516 2557 flags.go:64] FLAG: --kube-reserved="" May 21 14:54:33.067708 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063520 2557 flags.go:64] FLAG: --kube-reserved-cgroup="" May 21 14:54:33.067708 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063523 2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 21 14:54:33.067708 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063526 2557 flags.go:64] FLAG: --kubelet-cgroups="" May 21 14:54:33.067708 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063529 2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 21 14:54:33.067708 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063532 2557 flags.go:64] FLAG: --lock-file="" May 21 14:54:33.067708 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063535 2557 flags.go:64] FLAG: --log-cadvisor-usage="false" May 21 14:54:33.067708 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063538 2557 flags.go:64] FLAG: --log-flush-frequency="5s" May 21 14:54:33.067708 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063541 2557 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 21 14:54:33.067708 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063548 2557 flags.go:64] FLAG: --log-json-split-stream="false" May 21 14:54:33.067708 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063551 2557 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 21 14:54:33.067708 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063554 2557 flags.go:64] FLAG: --log-text-split-stream="false" May 21 14:54:33.067708 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063557 2557 flags.go:64] FLAG: --logging-format="text" May 21 14:54:33.067708 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063560 2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 21 14:54:33.067708 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063564 2557 flags.go:64] FLAG: --make-iptables-util-chains="true" May 21 14:54:33.067708 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063567 2557 flags.go:64] FLAG: --manifest-url="" May 21 14:54:33.068297 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063570 2557 flags.go:64] FLAG: --manifest-url-header="" May 21 14:54:33.068297 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063576 2557 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 21 14:54:33.068297 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063582 2557 flags.go:64] FLAG: --max-open-files="1000000" May 21 14:54:33.068297 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063587 2557 flags.go:64] FLAG: --max-pods="110" May 21 14:54:33.068297 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063590 2557 flags.go:64] FLAG: --maximum-dead-containers="-1" May 21 14:54:33.068297 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063593 2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 21 14:54:33.068297 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063596 2557 flags.go:64] FLAG: --memory-manager-policy="None" May 21 14:54:33.068297 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063599 2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 21 14:54:33.068297 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063602 2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 21 14:54:33.068297 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063606 2557 flags.go:64] FLAG: --node-ip="0.0.0.0" May 21 14:54:33.068297 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063609 2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 21 14:54:33.068297 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063617 2557 flags.go:64] FLAG: --node-status-max-images="50" May 21 14:54:33.068297 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063621 2557 flags.go:64] FLAG: --node-status-update-frequency="10s" May 21 14:54:33.068297 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063624 2557 flags.go:64] FLAG: --oom-score-adj="-999" May 21 14:54:33.068297 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063629 2557 flags.go:64] FLAG: --pod-cidr="" May 21 14:54:33.068297 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063632 2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 21 14:54:33.068297 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063638 2557 flags.go:64] FLAG: --pod-manifest-path="" May 21 14:54:33.068297 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063641 2557 flags.go:64] FLAG: --pod-max-pids="-1" May 21 14:54:33.068297 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063644 2557 flags.go:64] FLAG: --pods-per-core="0" May 21 14:54:33.068297 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063647 2557 flags.go:64] FLAG: --port="10250" May 21 14:54:33.068297 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063650 2557 flags.go:64] FLAG: --protect-kernel-defaults="false" May 21 14:54:33.068297 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063653 2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07d82018d8e2b9392" May 21 14:54:33.068297 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063657 2557 flags.go:64] FLAG: --qos-reserved="" May 21 14:54:33.068297 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063660 2557 flags.go:64] FLAG: --read-only-port="10255" May 21 14:54:33.068864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063663 2557 flags.go:64] FLAG: --register-node="true" May 21 14:54:33.068864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063666 2557 flags.go:64] FLAG: --register-schedulable="true" May 21 14:54:33.068864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063669 2557 flags.go:64] FLAG: --register-with-taints="" May 21 14:54:33.068864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063674 2557 flags.go:64] FLAG: --registry-burst="10" May 21 14:54:33.068864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063677 2557 flags.go:64] FLAG: --registry-qps="5" May 21 14:54:33.068864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063680 2557 flags.go:64] FLAG: --reserved-cpus="" May 21 14:54:33.068864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063683 2557 flags.go:64] FLAG: --reserved-memory="" May 21 14:54:33.068864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063688 2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 21 14:54:33.068864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063691 2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 21 14:54:33.068864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063694 2557 flags.go:64] FLAG: --rotate-certificates="false" May 21 14:54:33.068864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063699 2557 flags.go:64] FLAG: --rotate-server-certificates="false" May 21 14:54:33.068864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063703 2557 flags.go:64] FLAG: --runonce="false" May 21 14:54:33.068864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063706 2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 21 14:54:33.068864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063709 2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 21 14:54:33.068864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063712 2557 flags.go:64] FLAG: --seccomp-default="false" May 21 14:54:33.068864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063715 2557 flags.go:64] FLAG: --serialize-image-pulls="true" May 21 14:54:33.068864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063718 2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 21 14:54:33.068864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063721 2557 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 21 14:54:33.068864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063725 2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 21 14:54:33.068864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063728 2557 flags.go:64] FLAG: --storage-driver-password="root" May 21 14:54:33.068864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063731 2557 flags.go:64] FLAG: --storage-driver-secure="false" May 21 14:54:33.068864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063734 2557 flags.go:64] FLAG: --storage-driver-table="stats" May 21 14:54:33.068864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063737 2557 flags.go:64] FLAG: --storage-driver-user="root" May 21 14:54:33.068864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063741 2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 21 14:54:33.068864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063744 2557 flags.go:64] FLAG: --sync-frequency="1m0s" May 21 14:54:33.068864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063747 2557 flags.go:64] FLAG: --system-cgroups="" May 21 14:54:33.069557 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063750 2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 21 14:54:33.069557 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063755 2557 flags.go:64] FLAG: --system-reserved-cgroup="" May 21 14:54:33.069557 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063758 2557 flags.go:64] FLAG: --tls-cert-file="" May 21 14:54:33.069557 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063761 2557 flags.go:64] FLAG: --tls-cipher-suites="[]" May 21 14:54:33.069557 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063765 2557 flags.go:64] FLAG: --tls-min-version="" May 21 14:54:33.069557 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063768 2557 flags.go:64] FLAG: --tls-private-key-file="" May 21 14:54:33.069557 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063771 2557 flags.go:64] FLAG: --topology-manager-policy="none" May 21 14:54:33.069557 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063774 2557 flags.go:64] FLAG: --topology-manager-policy-options="" May 21 14:54:33.069557 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063777 2557 flags.go:64] FLAG: --topology-manager-scope="container" May 21 14:54:33.069557 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063780 2557 flags.go:64] FLAG: --v="2" May 21 14:54:33.069557 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063785 2557 flags.go:64] FLAG: --version="false" May 21 14:54:33.069557 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063790 2557 flags.go:64] FLAG: --vmodule="" May 21 14:54:33.069557 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063794 2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 21 14:54:33.069557 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.063798 2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 21 14:54:33.069557 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.063915 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:54:33.069557 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.063919 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:54:33.069557 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.063923 2557 feature_gate.go:328] unrecognized feature gate: Example May 21 14:54:33.069557 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.063926 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:54:33.069557 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.063929 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:54:33.069557 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.063932 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:54:33.069557 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.063935 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:54:33.069557 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.063938 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:54:33.069557 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.063941 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:54:33.070170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.063943 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:54:33.070170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.063947 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:54:33.070170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.063949 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:54:33.070170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.063954 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:54:33.070170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.063958 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:54:33.070170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.063961 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:54:33.070170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.063964 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:54:33.070170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.063968 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:54:33.070170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.063970 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:54:33.070170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.063973 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:54:33.070170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.063991 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:54:33.070170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.063994 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:54:33.070170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.063997 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:54:33.070170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064000 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:54:33.070170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064003 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:54:33.070170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064006 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:54:33.070170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064008 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:54:33.070170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064011 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:54:33.070170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064014 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:54:33.070650 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064021 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:54:33.070650 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064025 2557 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:54:33.070650 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064028 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:54:33.070650 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064031 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:54:33.070650 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064035 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:54:33.070650 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064038 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:54:33.070650 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064041 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:54:33.070650 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064044 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:54:33.070650 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064047 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:54:33.070650 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064050 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:54:33.070650 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064052 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:54:33.070650 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064055 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:54:33.070650 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064058 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:54:33.070650 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064060 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:54:33.070650 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064063 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:54:33.070650 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064065 2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:54:33.070650 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064068 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:54:33.070650 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064071 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:54:33.070650 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064073 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:54:33.070650 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064076 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:54:33.071170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064078 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:54:33.071170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064082 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:54:33.071170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064085 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:54:33.071170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064088 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:54:33.071170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064091 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:54:33.071170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064093 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:54:33.071170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064096 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:54:33.071170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064098 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:54:33.071170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064102 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:54:33.071170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064105 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:54:33.071170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064107 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:54:33.071170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064110 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:54:33.071170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064114 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:54:33.071170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064117 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:54:33.071170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064120 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:54:33.071170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064122 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:54:33.071170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064125 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:54:33.071170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064128 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:54:33.071170 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064131 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:54:33.071654 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064134 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:54:33.071654 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064136 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:54:33.071654 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064139 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:54:33.071654 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064142 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:54:33.071654 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064145 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:54:33.071654 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064147 2557 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:54:33.071654 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064150 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:54:33.071654 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064152 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:54:33.071654 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064155 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:54:33.071654 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064158 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:54:33.071654 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064160 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:54:33.071654 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064163 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:54:33.071654 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064166 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:54:33.071654 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064168 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:54:33.071654 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064171 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:54:33.071654 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064174 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:54:33.071654 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064176 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:54:33.071654 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064179 2557 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:54:33.071654 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.064182 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:54:33.072145 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.064192 2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 14:54:33.072145 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.070950 2557 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 21 14:54:33.072145 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.070973 2557 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 21 14:54:33.072145 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071045 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:54:33.072145 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071050 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:54:33.072145 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071054 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:54:33.072145 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071057 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:54:33.072145 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071061 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:54:33.072145 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071064 2557 feature_gate.go:328] unrecognized feature gate: Example May 21 14:54:33.072145 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071067 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:54:33.072145 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071070 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:54:33.072145 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071073 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:54:33.072145 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071076 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:54:33.072145 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071080 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:54:33.072145 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071083 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:54:33.072555 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071086 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:54:33.072555 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071089 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:54:33.072555 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071092 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:54:33.072555 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071095 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:54:33.072555 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071098 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:54:33.072555 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071101 2557 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:54:33.072555 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071104 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:54:33.072555 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071106 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:54:33.072555 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071109 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:54:33.072555 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071112 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:54:33.072555 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071115 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:54:33.072555 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071117 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:54:33.072555 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071120 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:54:33.072555 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071123 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:54:33.072555 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071126 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:54:33.072555 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071129 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:54:33.072555 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071131 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:54:33.072555 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071134 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:54:33.072555 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071136 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:54:33.072555 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071140 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:54:33.073076 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071143 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:54:33.073076 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071146 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:54:33.073076 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071150 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:54:33.073076 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071155 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:54:33.073076 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071158 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:54:33.073076 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071161 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:54:33.073076 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071163 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:54:33.073076 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071166 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:54:33.073076 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071168 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:54:33.073076 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071171 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:54:33.073076 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071174 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:54:33.073076 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071177 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:54:33.073076 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071180 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:54:33.073076 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071182 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:54:33.073076 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071185 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:54:33.073076 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071188 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:54:33.073076 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071191 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:54:33.073076 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071193 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:54:33.073076 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071196 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:54:33.073076 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071199 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:54:33.073575 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071201 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:54:33.073575 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071204 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:54:33.073575 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071206 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:54:33.073575 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071209 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:54:33.073575 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071211 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:54:33.073575 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071214 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:54:33.073575 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071217 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:54:33.073575 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071220 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:54:33.073575 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071223 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:54:33.073575 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071225 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:54:33.073575 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071227 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:54:33.073575 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071231 2557 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:54:33.073575 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071235 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:54:33.073575 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071237 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:54:33.073575 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071240 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:54:33.073575 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071244 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:54:33.073575 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071248 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:54:33.073575 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071251 2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:54:33.073575 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071254 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:54:33.074110 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071257 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:54:33.074110 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071260 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:54:33.074110 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071263 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:54:33.074110 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071266 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:54:33.074110 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071268 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:54:33.074110 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071271 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:54:33.074110 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071274 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:54:33.074110 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071276 2557 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:54:33.074110 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071279 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:54:33.074110 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071282 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:54:33.074110 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071284 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:54:33.074110 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071287 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:54:33.074110 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071289 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:54:33.074110 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071292 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:54:33.074110 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071295 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:54:33.074110 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.071300 2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 14:54:33.074521 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071407 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 21 14:54:33.074521 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071411 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 21 14:54:33.074521 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071414 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 21 14:54:33.074521 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071416 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 21 14:54:33.074521 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071420 2557 feature_gate.go:328] unrecognized feature gate: Example2 May 21 14:54:33.074521 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071422 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 21 14:54:33.074521 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071426 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 21 14:54:33.074521 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071430 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 21 14:54:33.074521 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071434 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 21 14:54:33.074521 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071437 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 21 14:54:33.074521 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071441 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 21 14:54:33.074521 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071444 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 21 14:54:33.074521 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071446 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 21 14:54:33.074521 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071449 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 21 14:54:33.074521 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071452 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 21 14:54:33.074521 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071455 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 21 14:54:33.074521 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071458 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 21 14:54:33.074521 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071461 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 21 14:54:33.074521 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071463 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 21 14:54:33.075043 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071466 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 21 14:54:33.075043 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071468 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 21 14:54:33.075043 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071471 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 21 14:54:33.075043 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071473 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores May 21 14:54:33.075043 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071476 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 21 14:54:33.075043 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071478 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 21 14:54:33.075043 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071481 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 21 14:54:33.075043 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071483 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 21 14:54:33.075043 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071485 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 21 14:54:33.075043 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071488 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 21 14:54:33.075043 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071491 2557 feature_gate.go:328] unrecognized feature gate: NewOLM May 21 14:54:33.075043 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071493 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 21 14:54:33.075043 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071496 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 21 14:54:33.075043 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071499 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 21 14:54:33.075043 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071501 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 21 14:54:33.075043 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071504 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 21 14:54:33.075043 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071506 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 21 14:54:33.075043 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071509 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 21 14:54:33.075043 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071512 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 21 14:54:33.075043 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071514 2557 feature_gate.go:328] unrecognized feature gate: DualReplica May 21 14:54:33.075560 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071517 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 21 14:54:33.075560 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071520 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 21 14:54:33.075560 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071523 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 21 14:54:33.075560 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071525 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 21 14:54:33.075560 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071528 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability May 21 14:54:33.075560 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071531 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 21 14:54:33.075560 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071533 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 21 14:54:33.075560 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071535 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 21 14:54:33.075560 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071538 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 21 14:54:33.075560 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071540 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 21 14:54:33.075560 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071543 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 21 14:54:33.075560 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071545 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 21 14:54:33.075560 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071548 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 21 14:54:33.075560 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071550 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 21 14:54:33.075560 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071553 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 21 14:54:33.075560 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071556 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 21 14:54:33.075560 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071558 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 21 14:54:33.075560 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071561 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 21 14:54:33.075560 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071563 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 21 14:54:33.075560 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071566 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 21 14:54:33.076315 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071568 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 21 14:54:33.076315 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071571 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 21 14:54:33.076315 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071573 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 21 14:54:33.076315 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071576 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 21 14:54:33.076315 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071578 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 21 14:54:33.076315 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071581 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 21 14:54:33.076315 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071584 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 21 14:54:33.076315 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071586 2557 feature_gate.go:328] unrecognized feature gate: Example May 21 14:54:33.076315 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071588 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 21 14:54:33.076315 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071591 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 21 14:54:33.076315 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071593 2557 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 21 14:54:33.076315 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071596 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 21 14:54:33.076315 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071599 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 21 14:54:33.076315 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071602 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 21 14:54:33.076315 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071604 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages May 21 14:54:33.076315 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071607 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 21 14:54:33.076315 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071610 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 21 14:54:33.076315 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071613 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 21 14:54:33.076315 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071616 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 21 14:54:33.076315 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071619 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 21 14:54:33.076855 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071622 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 21 14:54:33.076855 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071624 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 21 14:54:33.076855 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071627 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 21 14:54:33.076855 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071629 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 21 14:54:33.076855 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071632 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 21 14:54:33.076855 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071634 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 21 14:54:33.076855 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:33.071637 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 21 14:54:33.076855 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.071642 2557 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 21 14:54:33.076855 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.072424 2557 server.go:962] "Client rotation is on, will bootstrap in background" May 21 14:54:33.076855 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.074584 2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 21 14:54:33.076855 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.075553 2557 server.go:1019] "Starting client certificate rotation" May 21 14:54:33.076855 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.075667 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 14:54:33.076855 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.075723 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 21 14:54:33.100435 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.100406 2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 14:54:33.102404 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.102376 2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 21 14:54:33.122517 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.122486 2557 log.go:25] "Validated CRI v1 runtime API" May 21 14:54:33.128348 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.128322 2557 log.go:25] "Validated CRI v1 image API" May 21 14:54:33.130702 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.130681 2557 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 21 14:54:33.133803 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.133776 2557 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 14:54:33.136699 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.136677 2557 fs.go:135] Filesystem UUIDs: map[38b90875-97e6-48dd-8f3c-cb4060bd469f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d85d704b-b414-4a49-85f1-615960d7de18:/dev/nvme0n1p3] May 21 14:54:33.136773 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.136700 2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 21 14:54:33.141365 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.141111 2557 manager.go:217] Machine: {Timestamp:2026-05-21 14:54:33.140578877 +0000 UTC m=+0.436454788 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100744 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c54878d607a775c5a5798b4413b3f SystemUUID:ec2c5487-8d60-7a77-5c5a-5798b4413b3f BootID:ab91ca11-d25e-44e9-967a-5c065d12a135 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:99:cf:61:ac:fb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:99:cf:61:ac:fb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:5e:fd:af:fa:be Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 21 14:54:33.141910 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.141897 2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 21 14:54:33.142025 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.142012 2557 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 21 14:54:33.144033 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.144000 2557 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 21 14:54:33.144232 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.144032 2557 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-49.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 21 14:54:33.144315 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.144244 2557 topology_manager.go:138] "Creating topology manager with none policy" May 21 14:54:33.144315 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.144257 2557 container_manager_linux.go:306] "Creating device plugin manager" May 21 14:54:33.144315 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.144268 2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 14:54:33.146306 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.146287 2557 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 21 14:54:33.148146 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.148127 2557 state_mem.go:36] "Initialized new in-memory state store" May 21 14:54:33.148313 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.148301 2557 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 21 14:54:33.150606 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.150592 2557 kubelet.go:491] "Attempting to sync node with API server" May 21 14:54:33.150670 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.150621 2557 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 21 14:54:33.150670 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.150640 2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 21 14:54:33.150670 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.150656 2557 kubelet.go:397] "Adding apiserver pod source" May 21 14:54:33.150799 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.150671 2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 21 14:54:33.152039 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.152025 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 14:54:33.152127 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.152049 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 21 14:54:33.152458 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.152438 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rmzwh" May 21 14:54:33.155218 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.155196 2557 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 21 14:54:33.157684 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.157671 2557 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 21 14:54:33.158849 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.158837 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 21 14:54:33.158892 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.158859 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 21 14:54:33.158892 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.158867 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 21 14:54:33.158892 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.158873 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 21 14:54:33.158988 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.158882 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 21 14:54:33.158988 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.158927 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 21 14:54:33.158988 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.158932 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 21 14:54:33.158988 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.158938 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 21 14:54:33.158988 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.158945 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 21 14:54:33.158988 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.158950 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 21 14:54:33.158988 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.158962 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 21 14:54:33.159183 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.159166 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rmzwh" May 21 14:54:33.159230 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.159206 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 21 14:54:33.160166 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.160152 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 21 14:54:33.160166 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.160167 2557 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 21 14:54:33.161723 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:33.161698 2557 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 21 14:54:33.161820 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:33.161699 2557 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-49.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 21 14:54:33.164485 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.164472 2557 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 21 14:54:33.164543 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.164510 2557 server.go:1295] "Started kubelet" May 21 14:54:33.164645 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.164619 2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 21 14:54:33.164806 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.164603 2557 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 21 14:54:33.164862 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.164829 2557 server_v1.go:47] "podresources" method="list" useActivePods=true May 21 14:54:33.165284 ip-10-0-137-49 systemd[1]: Started Kubernetes Kubelet. May 21 14:54:33.166435 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.166420 2557 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 21 14:54:33.168646 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.168621 2557 server.go:317] "Adding debug handlers to kubelet server" May 21 14:54:33.172558 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.172540 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 21 14:54:33.173120 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.173106 2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 21 14:54:33.173268 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.173248 2557 volume_manager.go:295] "The desired_state_of_world populator starts" May 21 14:54:33.173268 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.173266 2557 volume_manager.go:297] "Starting Kubelet Volume Manager" May 21 14:54:33.173414 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.173296 2557 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 21 14:54:33.173414 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.173398 2557 reconstruct.go:97] "Volume reconstruction finished" May 21 14:54:33.173414 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.173407 2557 reconciler.go:26] "Reconciler: start to sync state" May 21 14:54:33.173917 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.173891 2557 factory.go:55] Registering systemd factory May 21 14:54:33.174027 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.173941 2557 factory.go:223] Registration of the systemd container factory successfully May 21 14:54:33.174125 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:33.174034 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-49.ec2.internal\" not found" May 21 14:54:33.175865 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.175844 2557 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:54:33.176530 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.176515 2557 factory.go:153] Registering CRI-O factory May 21 14:54:33.176630 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.176619 2557 factory.go:223] Registration of the crio container factory successfully May 21 14:54:33.176769 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.176757 2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 21 14:54:33.176871 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.176851 2557 factory.go:103] Registering Raw factory May 21 14:54:33.176991 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.176881 2557 manager.go:1196] Started watching for new ooms in manager May 21 14:54:33.177227 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.177201 2557 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-49.ec2.internal" not found May 21 14:54:33.177466 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.177452 2557 manager.go:319] Starting recovery of all containers May 21 14:54:33.178564 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:33.178517 2557 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-49.ec2.internal\" not found" node="ip-10-0-137-49.ec2.internal" May 21 14:54:33.179838 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:33.179807 2557 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 21 14:54:33.186962 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.186947 2557 manager.go:324] Recovery completed May 21 14:54:33.191512 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.191500 2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:54:33.192805 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.192792 2557 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-49.ec2.internal" not found May 21 14:54:33.193410 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.193396 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-49.ec2.internal" event="NodeHasSufficientMemory" May 21 14:54:33.193458 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.193425 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-49.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:54:33.193458 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.193437 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-49.ec2.internal" event="NodeHasSufficientPID" May 21 14:54:33.193864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.193848 2557 cpu_manager.go:222] "Starting CPU manager" policy="none" May 21 14:54:33.193864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.193862 2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 21 14:54:33.194037 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.193882 2557 state_mem.go:36] "Initialized new in-memory state store" May 21 14:54:33.196516 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.196499 2557 policy_none.go:49] "None policy: Start" May 21 14:54:33.196590 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.196522 2557 memory_manager.go:186] "Starting memorymanager" policy="None" May 21 14:54:33.196590 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.196533 2557 state_mem.go:35] "Initializing new in-memory state store" May 21 14:54:33.232633 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.232614 2557 manager.go:341] "Starting Device Plugin manager" May 21 14:54:33.244939 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:33.232657 2557 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 21 14:54:33.244939 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.232667 2557 server.go:85] "Starting device plugin registration server" May 21 14:54:33.244939 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.232932 2557 eviction_manager.go:189] "Eviction manager: starting control loop" May 21 14:54:33.244939 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.232943 2557 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 21 14:54:33.244939 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.233035 2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 21 14:54:33.244939 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.233112 2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 21 14:54:33.244939 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.233120 2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 21 14:54:33.244939 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:33.234044 2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 21 14:54:33.244939 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:33.234110 2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-49.ec2.internal\" not found" May 21 14:54:33.248229 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.248207 2557 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-137-49.ec2.internal" not found May 21 14:54:33.300254 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.300204 2557 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 21 14:54:33.301499 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.301482 2557 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 21 14:54:33.301569 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.301509 2557 status_manager.go:230] "Starting to sync pod status with apiserver" May 21 14:54:33.301569 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.301535 2557 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 21 14:54:33.301569 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.301544 2557 kubelet.go:2451] "Starting kubelet main sync loop" May 21 14:54:33.301707 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:33.301592 2557 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 21 14:54:33.305638 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.305577 2557 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:54:33.333852 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.333809 2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:54:33.335097 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.335079 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-49.ec2.internal" event="NodeHasSufficientMemory" May 21 14:54:33.335217 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.335118 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-49.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:54:33.335217 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.335133 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-49.ec2.internal" event="NodeHasSufficientPID" May 21 14:54:33.335217 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.335163 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-49.ec2.internal" May 21 14:54:33.344734 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.344704 2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-49.ec2.internal" May 21 14:54:33.344734 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:33.344737 2557 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-49.ec2.internal\": node \"ip-10-0-137-49.ec2.internal\" not found" May 21 14:54:33.361554 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:33.361518 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-49.ec2.internal\" not found" May 21 14:54:33.402309 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.402254 2557 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-49.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-49.ec2.internal"] May 21 14:54:33.402391 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.402364 2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:54:33.403804 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.403786 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-49.ec2.internal" event="NodeHasSufficientMemory" May 21 14:54:33.403867 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.403819 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-49.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:54:33.403867 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.403829 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-49.ec2.internal" event="NodeHasSufficientPID" May 21 14:54:33.405112 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.405100 2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:54:33.405242 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.405228 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-49.ec2.internal" May 21 14:54:33.405282 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.405259 2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:54:33.405842 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.405819 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-49.ec2.internal" event="NodeHasSufficientMemory" May 21 14:54:33.405928 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.405853 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-49.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:54:33.405928 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.405821 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-49.ec2.internal" event="NodeHasSufficientMemory" May 21 14:54:33.405928 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.405886 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-49.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:54:33.405928 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.405864 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-49.ec2.internal" event="NodeHasSufficientPID" May 21 14:54:33.405928 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.405910 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-49.ec2.internal" event="NodeHasSufficientPID" May 21 14:54:33.407218 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.407204 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-49.ec2.internal" May 21 14:54:33.407262 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.407230 2557 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 21 14:54:33.407902 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.407886 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-49.ec2.internal" event="NodeHasSufficientMemory" May 21 14:54:33.407997 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.407919 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-49.ec2.internal" event="NodeHasNoDiskPressure" May 21 14:54:33.407997 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.407935 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-49.ec2.internal" event="NodeHasSufficientPID" May 21 14:54:33.425639 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:33.425615 2557 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-49.ec2.internal\" not found" node="ip-10-0-137-49.ec2.internal" May 21 14:54:33.429141 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:33.429126 2557 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-49.ec2.internal\" not found" node="ip-10-0-137-49.ec2.internal" May 21 14:54:33.462541 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:33.462513 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-49.ec2.internal\" not found" May 21 14:54:33.475525 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.475495 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/424ec5f97454f8128494aaae5c30ac05-config\") pod \"kube-apiserver-proxy-ip-10-0-137-49.ec2.internal\" (UID: \"424ec5f97454f8128494aaae5c30ac05\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-49.ec2.internal" May 21 14:54:33.475607 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.475528 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c5aee6b7c8b52c009d017aa2d3454cd4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-49.ec2.internal\" (UID: \"c5aee6b7c8b52c009d017aa2d3454cd4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-49.ec2.internal" May 21 14:54:33.475607 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.475548 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5aee6b7c8b52c009d017aa2d3454cd4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-49.ec2.internal\" (UID: \"c5aee6b7c8b52c009d017aa2d3454cd4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-49.ec2.internal" May 21 14:54:33.562808 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:33.562719 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-49.ec2.internal\" not found" May 21 14:54:33.576166 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.576136 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/424ec5f97454f8128494aaae5c30ac05-config\") pod \"kube-apiserver-proxy-ip-10-0-137-49.ec2.internal\" (UID: \"424ec5f97454f8128494aaae5c30ac05\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-49.ec2.internal" May 21 14:54:33.576238 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.576174 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c5aee6b7c8b52c009d017aa2d3454cd4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-49.ec2.internal\" (UID: \"c5aee6b7c8b52c009d017aa2d3454cd4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-49.ec2.internal" May 21 14:54:33.576238 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.576202 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5aee6b7c8b52c009d017aa2d3454cd4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-49.ec2.internal\" (UID: \"c5aee6b7c8b52c009d017aa2d3454cd4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-49.ec2.internal" May 21 14:54:33.576301 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.576244 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/424ec5f97454f8128494aaae5c30ac05-config\") pod \"kube-apiserver-proxy-ip-10-0-137-49.ec2.internal\" (UID: \"424ec5f97454f8128494aaae5c30ac05\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-49.ec2.internal" May 21 14:54:33.576301 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.576258 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c5aee6b7c8b52c009d017aa2d3454cd4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-49.ec2.internal\" (UID: \"c5aee6b7c8b52c009d017aa2d3454cd4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-49.ec2.internal" May 21 14:54:33.576361 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.576301 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c5aee6b7c8b52c009d017aa2d3454cd4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-49.ec2.internal\" (UID: \"c5aee6b7c8b52c009d017aa2d3454cd4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-49.ec2.internal" May 21 14:54:33.663612 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:33.663578 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-49.ec2.internal\" not found" May 21 14:54:33.728069 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.728047 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-49.ec2.internal" May 21 14:54:33.731790 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:33.731774 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-49.ec2.internal" May 21 14:54:33.764575 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:33.764545 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-49.ec2.internal\" not found" May 21 14:54:33.865136 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:33.865035 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-49.ec2.internal\" not found" May 21 14:54:33.965585 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:33.965546 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-49.ec2.internal\" not found" May 21 14:54:34.066157 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:34.066104 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-49.ec2.internal\" not found" May 21 14:54:34.075365 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:34.075339 2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 21 14:54:34.075520 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:34.075502 2557 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 14:54:34.075563 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:34.075538 2557 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 21 14:54:34.161195 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:34.161124 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 14:49:33 +0000 UTC" deadline="2027-12-28 11:51:57.685084337 +0000 UTC" May 21 14:54:34.161195 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:34.161159 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14060h57m23.523927513s" May 21 14:54:34.166218 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:34.166193 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-49.ec2.internal\" not found" May 21 14:54:34.173376 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:34.173354 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 21 14:54:34.190816 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:34.190779 2557 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 21 14:54:34.231224 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:34.231194 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tb82g" May 21 14:54:34.240177 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:34.240147 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tb82g" May 21 14:54:34.266883 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:34.266852 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-49.ec2.internal\" not found" May 21 14:54:34.284307 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:34.284270 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5aee6b7c8b52c009d017aa2d3454cd4.slice/crio-1df3b0b7cc0b58da834b1a0aa17bab8cb6c3e47292efedd4825962100a30a5ad WatchSource:0}: Error finding container 1df3b0b7cc0b58da834b1a0aa17bab8cb6c3e47292efedd4825962100a30a5ad: Status 404 returned error can't find the container with id 1df3b0b7cc0b58da834b1a0aa17bab8cb6c3e47292efedd4825962100a30a5ad May 21 14:54:34.284521 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:34.284504 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod424ec5f97454f8128494aaae5c30ac05.slice/crio-a56b25a134464e3f65819dfeaa45637924af96a4f21bd3968c12b9c9536b609b WatchSource:0}: Error finding container a56b25a134464e3f65819dfeaa45637924af96a4f21bd3968c12b9c9536b609b: Status 404 returned error can't find the container with id a56b25a134464e3f65819dfeaa45637924af96a4f21bd3968c12b9c9536b609b May 21 14:54:34.288320 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:34.288302 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 14:54:34.305398 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:34.305347 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-49.ec2.internal" event={"ID":"424ec5f97454f8128494aaae5c30ac05","Type":"ContainerStarted","Data":"a56b25a134464e3f65819dfeaa45637924af96a4f21bd3968c12b9c9536b609b"} May 21 14:54:34.306360 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:34.306337 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-49.ec2.internal" event={"ID":"c5aee6b7c8b52c009d017aa2d3454cd4","Type":"ContainerStarted","Data":"1df3b0b7cc0b58da834b1a0aa17bab8cb6c3e47292efedd4825962100a30a5ad"} May 21 14:54:34.367571 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:34.367522 2557 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-137-49.ec2.internal\" not found" May 21 14:54:34.378347 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:34.378327 2557 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:54:34.380614 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:34.380597 2557 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:54:34.473783 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:34.473691 2557 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-49.ec2.internal" May 21 14:54:34.491466 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:34.491434 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 14:54:34.492513 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:34.492493 2557 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-49.ec2.internal" May 21 14:54:34.499817 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:34.499797 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 21 14:54:34.881838 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:34.881742 2557 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:54:35.146480 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.146360 2557 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 21 14:54:35.152461 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.152426 2557 apiserver.go:52] "Watching apiserver" May 21 14:54:35.162618 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.162582 2557 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 21 14:54:35.163715 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.163681 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-9tsp2","openshift-dns/node-resolver-5tqsh","openshift-multus/multus-additional-cni-plugins-hsxn8","openshift-multus/multus-nbh7v","openshift-multus/network-metrics-daemon-qtgkj","kube-system/konnectivity-agent-v85zc","kube-system/kube-apiserver-proxy-ip-10-0-137-49.ec2.internal","openshift-image-registry/node-ca-w4lgs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-49.ec2.internal","openshift-network-diagnostics/network-check-target-gdtjn","openshift-network-operator/iptables-alerter-9qd82","openshift-ovn-kubernetes/ovnkube-node-2qjxf","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hch2b"] May 21 14:54:35.166434 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.166409 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:54:35.166572 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:35.166504 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdtjn" podUID="b3b95b77-0eda-4a70-8a69-8eac95eefb8e" May 21 14:54:35.167461 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.167434 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5tqsh" May 21 14:54:35.168515 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.168494 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hsxn8" May 21 14:54:35.168624 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.168579 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nbh7v" May 21 14:54:35.169863 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.169821 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wtbtp\"" May 21 14:54:35.169863 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.169821 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 21 14:54:35.170087 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.169891 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 21 14:54:35.170634 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.170557 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:54:35.171403 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:35.170939 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtgkj" podUID="4a47bc04-1f5f-4dc4-824a-5fa35b392b73" May 21 14:54:35.171403 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.171034 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 21 14:54:35.171561 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.171512 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 21 14:54:35.171561 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.171527 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 21 14:54:35.172170 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.171606 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 21 14:54:35.172170 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.171848 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 21 14:54:35.172170 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.172107 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wt22x\"" May 21 14:54:35.172521 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.172498 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-w988r\"" May 21 14:54:35.173526 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.172840 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 21 14:54:35.173624 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.173599 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v85zc" May 21 14:54:35.175460 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.175444 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w4lgs" May 21 14:54:35.176284 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.176260 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 21 14:54:35.177156 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.177138 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.177409 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.177265 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sbsfw\"" May 21 14:54:35.177409 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.177265 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 21 14:54:35.178045 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.177916 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 21 14:54:35.178045 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.177934 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rgg6w\"" May 21 14:54:35.178045 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.178034 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 21 14:54:35.178334 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.178319 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 21 14:54:35.178501 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.178476 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9qd82" May 21 14:54:35.179410 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.179388 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 21 14:54:35.179556 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.179538 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 21 14:54:35.179683 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.179664 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dffv4\"" May 21 14:54:35.179738 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.179702 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.180781 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.180763 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 21 14:54:35.180872 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.180788 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 21 14:54:35.180931 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.180897 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hch2b" May 21 14:54:35.181365 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.181346 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-n4xn6\"" May 21 14:54:35.181482 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.181380 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 21 14:54:35.181864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.181846 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 21 14:54:35.182147 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.182128 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 21 14:54:35.182246 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.182129 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-57qjz\"" May 21 14:54:35.182246 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.182206 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 21 14:54:35.182532 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.182515 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 21 14:54:35.182607 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.182544 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 21 14:54:35.182716 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.182700 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 21 14:54:35.182906 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.182886 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 21 14:54:35.183358 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.183341 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 21 14:54:35.183470 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.183454 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qk7jg\"" May 21 14:54:35.183725 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.183710 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 21 14:54:35.186050 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.185932 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/460bd20d-6a98-47e3-9a2a-a1438b7cc63c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hsxn8\" (UID: \"460bd20d-6a98-47e3-9a2a-a1438b7cc63c\") " pod="openshift-multus/multus-additional-cni-plugins-hsxn8" May 21 14:54:35.186050 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.185965 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b257c\" (UniqueName: \"kubernetes.io/projected/460bd20d-6a98-47e3-9a2a-a1438b7cc63c-kube-api-access-b257c\") pod \"multus-additional-cni-plugins-hsxn8\" (UID: \"460bd20d-6a98-47e3-9a2a-a1438b7cc63c\") " pod="openshift-multus/multus-additional-cni-plugins-hsxn8" May 21 14:54:35.186050 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186013 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw5sd\" (UniqueName: \"kubernetes.io/projected/4a47bc04-1f5f-4dc4-824a-5fa35b392b73-kube-api-access-tw5sd\") pod \"network-metrics-daemon-qtgkj\" (UID: \"4a47bc04-1f5f-4dc4-824a-5fa35b392b73\") " pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:54:35.186217 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186058 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bd5269e8-4aa4-489a-a650-e45b4f8a99d7-konnectivity-ca\") pod \"konnectivity-agent-v85zc\" (UID: \"bd5269e8-4aa4-489a-a650-e45b4f8a99d7\") " pod="kube-system/konnectivity-agent-v85zc" May 21 14:54:35.186217 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186118 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/575ad37b-aef2-41aa-8c72-53f7a515aa96-hosts-file\") pod \"node-resolver-5tqsh\" (UID: \"575ad37b-aef2-41aa-8c72-53f7a515aa96\") " pod="openshift-dns/node-resolver-5tqsh" May 21 14:54:35.186217 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186138 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/575ad37b-aef2-41aa-8c72-53f7a515aa96-tmp-dir\") pod \"node-resolver-5tqsh\" (UID: \"575ad37b-aef2-41aa-8c72-53f7a515aa96\") " pod="openshift-dns/node-resolver-5tqsh" May 21 14:54:35.186217 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186162 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/460bd20d-6a98-47e3-9a2a-a1438b7cc63c-cnibin\") pod \"multus-additional-cni-plugins-hsxn8\" (UID: \"460bd20d-6a98-47e3-9a2a-a1438b7cc63c\") " pod="openshift-multus/multus-additional-cni-plugins-hsxn8" May 21 14:54:35.186217 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186187 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/460bd20d-6a98-47e3-9a2a-a1438b7cc63c-cni-binary-copy\") pod \"multus-additional-cni-plugins-hsxn8\" (UID: \"460bd20d-6a98-47e3-9a2a-a1438b7cc63c\") " pod="openshift-multus/multus-additional-cni-plugins-hsxn8" May 21 14:54:35.186217 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186214 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njs8j\" (UniqueName: \"kubernetes.io/projected/a6293d82-33a8-4156-998f-c0ed8232df8c-kube-api-access-njs8j\") pod \"node-ca-w4lgs\" (UID: \"a6293d82-33a8-4156-998f-c0ed8232df8c\") " pod="openshift-image-registry/node-ca-w4lgs" May 21 14:54:35.186511 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186239 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-host-run-k8s-cni-cncf-io\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.186511 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186261 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-host-run-netns\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.186511 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186286 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a47bc04-1f5f-4dc4-824a-5fa35b392b73-metrics-certs\") pod \"network-metrics-daemon-qtgkj\" (UID: \"4a47bc04-1f5f-4dc4-824a-5fa35b392b73\") " pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:54:35.186511 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186315 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-hostroot\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.186511 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186355 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m66x\" (UniqueName: \"kubernetes.io/projected/4a5605b1-be58-4e18-85a7-35718abc3e2f-kube-api-access-2m66x\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.186511 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186396 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/460bd20d-6a98-47e3-9a2a-a1438b7cc63c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hsxn8\" (UID: \"460bd20d-6a98-47e3-9a2a-a1438b7cc63c\") " pod="openshift-multus/multus-additional-cni-plugins-hsxn8" May 21 14:54:35.186511 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186432 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a5605b1-be58-4e18-85a7-35718abc3e2f-cni-binary-copy\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.186511 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186455 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-host-var-lib-cni-bin\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.186511 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186479 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4a5605b1-be58-4e18-85a7-35718abc3e2f-multus-daemon-config\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.186511 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186500 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-etc-kubernetes\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.186966 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186520 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-cnibin\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.186966 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186539 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6293d82-33a8-4156-998f-c0ed8232df8c-host\") pod \"node-ca-w4lgs\" (UID: \"a6293d82-33a8-4156-998f-c0ed8232df8c\") " pod="openshift-image-registry/node-ca-w4lgs" May 21 14:54:35.186966 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186566 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-host-run-multus-certs\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.186966 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186592 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bd5269e8-4aa4-489a-a650-e45b4f8a99d7-agent-certs\") pod \"konnectivity-agent-v85zc\" (UID: \"bd5269e8-4aa4-489a-a650-e45b4f8a99d7\") " pod="kube-system/konnectivity-agent-v85zc" May 21 14:54:35.186966 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186618 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a6293d82-33a8-4156-998f-c0ed8232df8c-serviceca\") pod \"node-ca-w4lgs\" (UID: \"a6293d82-33a8-4156-998f-c0ed8232df8c\") " pod="openshift-image-registry/node-ca-w4lgs" May 21 14:54:35.186966 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186642 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-multus-cni-dir\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.186966 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186665 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-host-var-lib-kubelet\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.186966 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186688 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-multus-conf-dir\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.186966 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186727 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/460bd20d-6a98-47e3-9a2a-a1438b7cc63c-system-cni-dir\") pod \"multus-additional-cni-plugins-hsxn8\" (UID: \"460bd20d-6a98-47e3-9a2a-a1438b7cc63c\") " pod="openshift-multus/multus-additional-cni-plugins-hsxn8" May 21 14:54:35.186966 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186756 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/460bd20d-6a98-47e3-9a2a-a1438b7cc63c-os-release\") pod \"multus-additional-cni-plugins-hsxn8\" (UID: \"460bd20d-6a98-47e3-9a2a-a1438b7cc63c\") " pod="openshift-multus/multus-additional-cni-plugins-hsxn8" May 21 14:54:35.186966 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186811 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z64gd\" (UniqueName: \"kubernetes.io/projected/b3b95b77-0eda-4a70-8a69-8eac95eefb8e-kube-api-access-z64gd\") pod \"network-check-target-gdtjn\" (UID: \"b3b95b77-0eda-4a70-8a69-8eac95eefb8e\") " pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:54:35.186966 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186843 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-multus-socket-dir-parent\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.186966 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186867 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-host-var-lib-cni-multus\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.186966 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186890 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-system-cni-dir\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.186966 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186915 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-os-release\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.186966 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.186941 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg9mt\" (UniqueName: \"kubernetes.io/projected/575ad37b-aef2-41aa-8c72-53f7a515aa96-kube-api-access-cg9mt\") pod \"node-resolver-5tqsh\" (UID: \"575ad37b-aef2-41aa-8c72-53f7a515aa96\") " pod="openshift-dns/node-resolver-5tqsh" May 21 14:54:35.187711 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.187022 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/460bd20d-6a98-47e3-9a2a-a1438b7cc63c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hsxn8\" (UID: \"460bd20d-6a98-47e3-9a2a-a1438b7cc63c\") " pod="openshift-multus/multus-additional-cni-plugins-hsxn8" May 21 14:54:35.241086 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.241048 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 14:49:34 +0000 UTC" deadline="2027-12-21 00:24:27.589536906 +0000 UTC" May 21 14:54:35.241086 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.241081 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13881h29m52.348458326s" May 21 14:54:35.274152 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.274116 2557 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 21 14:54:35.287408 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.287367 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-host-kubelet\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.287408 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.287410 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-host-slash\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.287644 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.287435 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-run-openvswitch\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.287644 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.287465 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/460bd20d-6a98-47e3-9a2a-a1438b7cc63c-system-cni-dir\") pod \"multus-additional-cni-plugins-hsxn8\" (UID: \"460bd20d-6a98-47e3-9a2a-a1438b7cc63c\") " pod="openshift-multus/multus-additional-cni-plugins-hsxn8" May 21 14:54:35.287644 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.287487 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z64gd\" (UniqueName: \"kubernetes.io/projected/b3b95b77-0eda-4a70-8a69-8eac95eefb8e-kube-api-access-z64gd\") pod \"network-check-target-gdtjn\" (UID: \"b3b95b77-0eda-4a70-8a69-8eac95eefb8e\") " pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:54:35.287644 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.287512 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-multus-socket-dir-parent\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.287644 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.287538 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-etc-systemd\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.287644 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.287573 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/460bd20d-6a98-47e3-9a2a-a1438b7cc63c-system-cni-dir\") pod \"multus-additional-cni-plugins-hsxn8\" (UID: \"460bd20d-6a98-47e3-9a2a-a1438b7cc63c\") " pod="openshift-multus/multus-additional-cni-plugins-hsxn8" May 21 14:54:35.287644 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.287579 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-system-cni-dir\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.287942 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.287652 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cg9mt\" (UniqueName: \"kubernetes.io/projected/575ad37b-aef2-41aa-8c72-53f7a515aa96-kube-api-access-cg9mt\") pod \"node-resolver-5tqsh\" (UID: \"575ad37b-aef2-41aa-8c72-53f7a515aa96\") " pod="openshift-dns/node-resolver-5tqsh" May 21 14:54:35.287942 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.287673 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-multus-socket-dir-parent\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.287942 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.287682 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b257c\" (UniqueName: \"kubernetes.io/projected/460bd20d-6a98-47e3-9a2a-a1438b7cc63c-kube-api-access-b257c\") pod \"multus-additional-cni-plugins-hsxn8\" (UID: \"460bd20d-6a98-47e3-9a2a-a1438b7cc63c\") " pod="openshift-multus/multus-additional-cni-plugins-hsxn8" May 21 14:54:35.287942 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.287684 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-system-cni-dir\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.287942 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.287714 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tw5sd\" (UniqueName: \"kubernetes.io/projected/4a47bc04-1f5f-4dc4-824a-5fa35b392b73-kube-api-access-tw5sd\") pod \"network-metrics-daemon-qtgkj\" (UID: \"4a47bc04-1f5f-4dc4-824a-5fa35b392b73\") " pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:54:35.287942 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.287739 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bd5269e8-4aa4-489a-a650-e45b4f8a99d7-konnectivity-ca\") pod \"konnectivity-agent-v85zc\" (UID: \"bd5269e8-4aa4-489a-a650-e45b4f8a99d7\") " pod="kube-system/konnectivity-agent-v85zc" May 21 14:54:35.287942 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.287762 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-njs8j\" (UniqueName: \"kubernetes.io/projected/a6293d82-33a8-4156-998f-c0ed8232df8c-kube-api-access-njs8j\") pod \"node-ca-w4lgs\" (UID: \"a6293d82-33a8-4156-998f-c0ed8232df8c\") " pod="openshift-image-registry/node-ca-w4lgs" May 21 14:54:35.287942 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.287788 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/575ad37b-aef2-41aa-8c72-53f7a515aa96-hosts-file\") pod \"node-resolver-5tqsh\" (UID: \"575ad37b-aef2-41aa-8c72-53f7a515aa96\") " pod="openshift-dns/node-resolver-5tqsh" May 21 14:54:35.287942 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.287812 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/575ad37b-aef2-41aa-8c72-53f7a515aa96-tmp-dir\") pod \"node-resolver-5tqsh\" (UID: \"575ad37b-aef2-41aa-8c72-53f7a515aa96\") " pod="openshift-dns/node-resolver-5tqsh" May 21 14:54:35.287942 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.287835 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/460bd20d-6a98-47e3-9a2a-a1438b7cc63c-cnibin\") pod \"multus-additional-cni-plugins-hsxn8\" (UID: \"460bd20d-6a98-47e3-9a2a-a1438b7cc63c\") " pod="openshift-multus/multus-additional-cni-plugins-hsxn8" May 21 14:54:35.287942 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.287858 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2m66x\" (UniqueName: \"kubernetes.io/projected/4a5605b1-be58-4e18-85a7-35718abc3e2f-kube-api-access-2m66x\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.287942 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.287887 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-sys\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.287942 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.287911 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-systemd-units\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.287942 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.287923 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/460bd20d-6a98-47e3-9a2a-a1438b7cc63c-cnibin\") pod \"multus-additional-cni-plugins-hsxn8\" (UID: \"460bd20d-6a98-47e3-9a2a-a1438b7cc63c\") " pod="openshift-multus/multus-additional-cni-plugins-hsxn8" May 21 14:54:35.287942 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.287935 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-etc-sysctl-d\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.288694 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288007 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/819725de-9223-4f73-a7c2-f5abe8d0a725-etc-selinux\") pod \"aws-ebs-csi-driver-node-hch2b\" (UID: \"819725de-9223-4f73-a7c2-f5abe8d0a725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hch2b" May 21 14:54:35.288694 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288040 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjrk7\" (UniqueName: \"kubernetes.io/projected/819725de-9223-4f73-a7c2-f5abe8d0a725-kube-api-access-hjrk7\") pod \"aws-ebs-csi-driver-node-hch2b\" (UID: \"819725de-9223-4f73-a7c2-f5abe8d0a725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hch2b" May 21 14:54:35.288694 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288081 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a5605b1-be58-4e18-85a7-35718abc3e2f-cni-binary-copy\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.288694 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288105 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-etc-sysctl-conf\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.288694 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288121 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/575ad37b-aef2-41aa-8c72-53f7a515aa96-hosts-file\") pod \"node-resolver-5tqsh\" (UID: \"575ad37b-aef2-41aa-8c72-53f7a515aa96\") " pod="openshift-dns/node-resolver-5tqsh" May 21 14:54:35.288694 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288128 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-lib-modules\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.288694 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288169 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84caccde-ac51-463e-ba82-ccc6e54ee9dc-tmp\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.288694 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288185 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/575ad37b-aef2-41aa-8c72-53f7a515aa96-tmp-dir\") pod \"node-resolver-5tqsh\" (UID: \"575ad37b-aef2-41aa-8c72-53f7a515aa96\") " pod="openshift-dns/node-resolver-5tqsh" May 21 14:54:35.288694 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288196 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-node-log\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.288694 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288221 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/819725de-9223-4f73-a7c2-f5abe8d0a725-sys-fs\") pod \"aws-ebs-csi-driver-node-hch2b\" (UID: \"819725de-9223-4f73-a7c2-f5abe8d0a725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hch2b" May 21 14:54:35.288694 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288245 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-etc-sysconfig\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.288694 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288265 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-run\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.288694 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288285 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/893775ba-09a6-4fd3-912b-23ffa1f601b6-host-slash\") pod \"iptables-alerter-9qd82\" (UID: \"893775ba-09a6-4fd3-912b-23ffa1f601b6\") " pod="openshift-network-operator/iptables-alerter-9qd82" May 21 14:54:35.288694 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288308 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bd5269e8-4aa4-489a-a650-e45b4f8a99d7-agent-certs\") pod \"konnectivity-agent-v85zc\" (UID: \"bd5269e8-4aa4-489a-a650-e45b4f8a99d7\") " pod="kube-system/konnectivity-agent-v85zc" May 21 14:54:35.288694 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288332 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a6293d82-33a8-4156-998f-c0ed8232df8c-serviceca\") pod \"node-ca-w4lgs\" (UID: \"a6293d82-33a8-4156-998f-c0ed8232df8c\") " pod="openshift-image-registry/node-ca-w4lgs" May 21 14:54:35.288694 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288357 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-host-run-netns\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.288694 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288383 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-host-var-lib-kubelet\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.289497 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288415 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bd5269e8-4aa4-489a-a650-e45b4f8a99d7-konnectivity-ca\") pod \"konnectivity-agent-v85zc\" (UID: \"bd5269e8-4aa4-489a-a650-e45b4f8a99d7\") " pod="kube-system/konnectivity-agent-v85zc" May 21 14:54:35.289497 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288431 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-multus-conf-dir\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.289497 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288466 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-host-var-lib-kubelet\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.289497 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288514 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/84caccde-ac51-463e-ba82-ccc6e54ee9dc-etc-tuned\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.289497 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288568 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/893775ba-09a6-4fd3-912b-23ffa1f601b6-iptables-alerter-script\") pod \"iptables-alerter-9qd82\" (UID: \"893775ba-09a6-4fd3-912b-23ffa1f601b6\") " pod="openshift-network-operator/iptables-alerter-9qd82" May 21 14:54:35.289497 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288607 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-multus-conf-dir\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.289497 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288656 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a5605b1-be58-4e18-85a7-35718abc3e2f-cni-binary-copy\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.289497 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288662 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-etc-openvswitch\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.289497 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288666 2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 21 14:54:35.289497 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288695 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.289497 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288730 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/819725de-9223-4f73-a7c2-f5abe8d0a725-registration-dir\") pod \"aws-ebs-csi-driver-node-hch2b\" (UID: \"819725de-9223-4f73-a7c2-f5abe8d0a725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hch2b" May 21 14:54:35.289497 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288760 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/460bd20d-6a98-47e3-9a2a-a1438b7cc63c-os-release\") pod \"multus-additional-cni-plugins-hsxn8\" (UID: \"460bd20d-6a98-47e3-9a2a-a1438b7cc63c\") " pod="openshift-multus/multus-additional-cni-plugins-hsxn8" May 21 14:54:35.289497 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288785 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-host-var-lib-cni-multus\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.289497 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288805 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-etc-kubernetes\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.289497 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288830 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/04d69156-db3f-4353-ada5-f84ea0fadc0c-ovn-node-metrics-cert\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.289497 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288847 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/460bd20d-6a98-47e3-9a2a-a1438b7cc63c-os-release\") pod \"multus-additional-cni-plugins-hsxn8\" (UID: \"460bd20d-6a98-47e3-9a2a-a1438b7cc63c\") " pod="openshift-multus/multus-additional-cni-plugins-hsxn8" May 21 14:54:35.289497 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288856 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/819725de-9223-4f73-a7c2-f5abe8d0a725-socket-dir\") pod \"aws-ebs-csi-driver-node-hch2b\" (UID: \"819725de-9223-4f73-a7c2-f5abe8d0a725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hch2b" May 21 14:54:35.290286 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288856 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a6293d82-33a8-4156-998f-c0ed8232df8c-serviceca\") pod \"node-ca-w4lgs\" (UID: \"a6293d82-33a8-4156-998f-c0ed8232df8c\") " pod="openshift-image-registry/node-ca-w4lgs" May 21 14:54:35.290286 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288897 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-os-release\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.290286 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288875 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-host-var-lib-cni-multus\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.290286 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288924 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/460bd20d-6a98-47e3-9a2a-a1438b7cc63c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hsxn8\" (UID: \"460bd20d-6a98-47e3-9a2a-a1438b7cc63c\") " pod="openshift-multus/multus-additional-cni-plugins-hsxn8" May 21 14:54:35.290286 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288963 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-os-release\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.290286 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.288965 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/460bd20d-6a98-47e3-9a2a-a1438b7cc63c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hsxn8\" (UID: \"460bd20d-6a98-47e3-9a2a-a1438b7cc63c\") " pod="openshift-multus/multus-additional-cni-plugins-hsxn8" May 21 14:54:35.290286 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.289025 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-host-run-k8s-cni-cncf-io\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.290286 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.289048 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/460bd20d-6a98-47e3-9a2a-a1438b7cc63c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hsxn8\" (UID: \"460bd20d-6a98-47e3-9a2a-a1438b7cc63c\") " pod="openshift-multus/multus-additional-cni-plugins-hsxn8" May 21 14:54:35.290286 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.289051 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-host-run-netns\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.290286 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.289085 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/04d69156-db3f-4353-ada5-f84ea0fadc0c-ovnkube-script-lib\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.290286 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.289090 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-host-run-k8s-cni-cncf-io\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.290286 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.289109 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/819725de-9223-4f73-a7c2-f5abe8d0a725-device-dir\") pod \"aws-ebs-csi-driver-node-hch2b\" (UID: \"819725de-9223-4f73-a7c2-f5abe8d0a725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hch2b" May 21 14:54:35.290286 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.289136 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/460bd20d-6a98-47e3-9a2a-a1438b7cc63c-cni-binary-copy\") pod \"multus-additional-cni-plugins-hsxn8\" (UID: \"460bd20d-6a98-47e3-9a2a-a1438b7cc63c\") " pod="openshift-multus/multus-additional-cni-plugins-hsxn8" May 21 14:54:35.290286 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.289134 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-host-run-netns\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.290286 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.289165 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7bw7\" (UniqueName: \"kubernetes.io/projected/84caccde-ac51-463e-ba82-ccc6e54ee9dc-kube-api-access-t7bw7\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.290286 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.289189 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-run-systemd\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.290286 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.289214 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-var-lib-openvswitch\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.291048 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.289238 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-run-ovn\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.291048 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.289262 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-log-socket\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.291048 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.289501 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/460bd20d-6a98-47e3-9a2a-a1438b7cc63c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hsxn8\" (UID: \"460bd20d-6a98-47e3-9a2a-a1438b7cc63c\") " pod="openshift-multus/multus-additional-cni-plugins-hsxn8" May 21 14:54:35.291048 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.289538 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a47bc04-1f5f-4dc4-824a-5fa35b392b73-metrics-certs\") pod \"network-metrics-daemon-qtgkj\" (UID: \"4a47bc04-1f5f-4dc4-824a-5fa35b392b73\") " pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:54:35.291048 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.289570 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-hostroot\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.291048 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.289591 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/460bd20d-6a98-47e3-9a2a-a1438b7cc63c-cni-binary-copy\") pod \"multus-additional-cni-plugins-hsxn8\" (UID: \"460bd20d-6a98-47e3-9a2a-a1438b7cc63c\") " pod="openshift-multus/multus-additional-cni-plugins-hsxn8" May 21 14:54:35.291048 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.289597 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-host-cni-bin\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.291048 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.289624 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/04d69156-db3f-4353-ada5-f84ea0fadc0c-ovnkube-config\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.291048 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:35.289631 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:54:35.291048 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.289644 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-hostroot\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.291048 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.289653 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/460bd20d-6a98-47e3-9a2a-a1438b7cc63c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hsxn8\" (UID: \"460bd20d-6a98-47e3-9a2a-a1438b7cc63c\") " pod="openshift-multus/multus-additional-cni-plugins-hsxn8" May 21 14:54:35.291048 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.289678 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-host-var-lib-cni-bin\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.291048 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.289727 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-host-var-lib-cni-bin\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.291048 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:35.289725 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a47bc04-1f5f-4dc4-824a-5fa35b392b73-metrics-certs podName:4a47bc04-1f5f-4dc4-824a-5fa35b392b73 nodeName:}" failed. No retries permitted until 2026-05-21 14:54:35.789690137 +0000 UTC m=+3.085566049 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a47bc04-1f5f-4dc4-824a-5fa35b392b73-metrics-certs") pod "network-metrics-daemon-qtgkj" (UID: "4a47bc04-1f5f-4dc4-824a-5fa35b392b73") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:54:35.291048 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.289790 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4a5605b1-be58-4e18-85a7-35718abc3e2f-multus-daemon-config\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.291048 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.289823 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-etc-kubernetes\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.291048 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.289850 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-cnibin\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.291743 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.289874 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6293d82-33a8-4156-998f-c0ed8232df8c-host\") pod \"node-ca-w4lgs\" (UID: \"a6293d82-33a8-4156-998f-c0ed8232df8c\") " pod="openshift-image-registry/node-ca-w4lgs" May 21 14:54:35.291743 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.289899 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-host-run-multus-certs\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.291743 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.289928 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-var-lib-kubelet\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.291743 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.289956 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-host-run-ovn-kubernetes\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.291743 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.290004 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxh7v\" (UniqueName: \"kubernetes.io/projected/04d69156-db3f-4353-ada5-f84ea0fadc0c-kube-api-access-mxh7v\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.291743 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.290035 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-multus-cni-dir\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.291743 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.290080 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-etc-modprobe-d\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.291743 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.290105 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-host\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.291743 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.290117 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/460bd20d-6a98-47e3-9a2a-a1438b7cc63c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hsxn8\" (UID: \"460bd20d-6a98-47e3-9a2a-a1438b7cc63c\") " pod="openshift-multus/multus-additional-cni-plugins-hsxn8" May 21 14:54:35.291743 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.290128 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-host-cni-netd\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.291743 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.290153 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/04d69156-db3f-4353-ada5-f84ea0fadc0c-env-overrides\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.291743 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.290172 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-etc-kubernetes\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.291743 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.290198 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/819725de-9223-4f73-a7c2-f5abe8d0a725-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hch2b\" (UID: \"819725de-9223-4f73-a7c2-f5abe8d0a725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hch2b" May 21 14:54:35.291743 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.290222 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-cnibin\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.291743 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.290263 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6293d82-33a8-4156-998f-c0ed8232df8c-host\") pod \"node-ca-w4lgs\" (UID: \"a6293d82-33a8-4156-998f-c0ed8232df8c\") " pod="openshift-image-registry/node-ca-w4lgs" May 21 14:54:35.291743 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.290296 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-multus-cni-dir\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.291743 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.290302 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4a5605b1-be58-4e18-85a7-35718abc3e2f-host-run-multus-certs\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.292418 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.290224 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln6c6\" (UniqueName: \"kubernetes.io/projected/893775ba-09a6-4fd3-912b-23ffa1f601b6-kube-api-access-ln6c6\") pod \"iptables-alerter-9qd82\" (UID: \"893775ba-09a6-4fd3-912b-23ffa1f601b6\") " pod="openshift-network-operator/iptables-alerter-9qd82" May 21 14:54:35.292418 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.290367 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4a5605b1-be58-4e18-85a7-35718abc3e2f-multus-daemon-config\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.292418 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.292191 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bd5269e8-4aa4-489a-a650-e45b4f8a99d7-agent-certs\") pod \"konnectivity-agent-v85zc\" (UID: \"bd5269e8-4aa4-489a-a650-e45b4f8a99d7\") " pod="kube-system/konnectivity-agent-v85zc" May 21 14:54:35.294991 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:35.294956 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:54:35.295512 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:35.295010 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:54:35.295512 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:35.295027 2557 projected.go:194] Error preparing data for projected volume kube-api-access-z64gd for pod openshift-network-diagnostics/network-check-target-gdtjn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:54:35.295512 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:35.295095 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3b95b77-0eda-4a70-8a69-8eac95eefb8e-kube-api-access-z64gd podName:b3b95b77-0eda-4a70-8a69-8eac95eefb8e nodeName:}" failed. No retries permitted until 2026-05-21 14:54:35.795076246 +0000 UTC m=+3.090952129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-z64gd" (UniqueName: "kubernetes.io/projected/b3b95b77-0eda-4a70-8a69-8eac95eefb8e-kube-api-access-z64gd") pod "network-check-target-gdtjn" (UID: "b3b95b77-0eda-4a70-8a69-8eac95eefb8e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:54:35.297862 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.297801 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b257c\" (UniqueName: \"kubernetes.io/projected/460bd20d-6a98-47e3-9a2a-a1438b7cc63c-kube-api-access-b257c\") pod \"multus-additional-cni-plugins-hsxn8\" (UID: \"460bd20d-6a98-47e3-9a2a-a1438b7cc63c\") " pod="openshift-multus/multus-additional-cni-plugins-hsxn8" May 21 14:54:35.298204 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.298185 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m66x\" (UniqueName: \"kubernetes.io/projected/4a5605b1-be58-4e18-85a7-35718abc3e2f-kube-api-access-2m66x\") pod \"multus-nbh7v\" (UID: \"4a5605b1-be58-4e18-85a7-35718abc3e2f\") " pod="openshift-multus/multus-nbh7v" May 21 14:54:35.298292 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.298224 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njs8j\" (UniqueName: \"kubernetes.io/projected/a6293d82-33a8-4156-998f-c0ed8232df8c-kube-api-access-njs8j\") pod \"node-ca-w4lgs\" (UID: \"a6293d82-33a8-4156-998f-c0ed8232df8c\") " pod="openshift-image-registry/node-ca-w4lgs" May 21 14:54:35.298292 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.298233 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg9mt\" (UniqueName: \"kubernetes.io/projected/575ad37b-aef2-41aa-8c72-53f7a515aa96-kube-api-access-cg9mt\") pod \"node-resolver-5tqsh\" (UID: \"575ad37b-aef2-41aa-8c72-53f7a515aa96\") " pod="openshift-dns/node-resolver-5tqsh" May 21 14:54:35.298377 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.298277 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw5sd\" (UniqueName: \"kubernetes.io/projected/4a47bc04-1f5f-4dc4-824a-5fa35b392b73-kube-api-access-tw5sd\") pod \"network-metrics-daemon-qtgkj\" (UID: \"4a47bc04-1f5f-4dc4-824a-5fa35b392b73\") " pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:54:35.390631 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.390590 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-etc-modprobe-d\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.390815 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.390646 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-host\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.390815 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.390672 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-host-cni-netd\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.390815 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.390696 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/04d69156-db3f-4353-ada5-f84ea0fadc0c-env-overrides\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.390815 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.390720 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/819725de-9223-4f73-a7c2-f5abe8d0a725-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hch2b\" (UID: \"819725de-9223-4f73-a7c2-f5abe8d0a725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hch2b" May 21 14:54:35.390815 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.390743 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ln6c6\" (UniqueName: \"kubernetes.io/projected/893775ba-09a6-4fd3-912b-23ffa1f601b6-kube-api-access-ln6c6\") pod \"iptables-alerter-9qd82\" (UID: \"893775ba-09a6-4fd3-912b-23ffa1f601b6\") " pod="openshift-network-operator/iptables-alerter-9qd82" May 21 14:54:35.390815 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.390767 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-host-kubelet\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.390815 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.390791 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-host-slash\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.390815 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.390817 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-run-openvswitch\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.391214 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.390856 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-etc-systemd\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.391214 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.390891 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-sys\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.391214 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.390915 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-systemd-units\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.391214 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.390938 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-etc-sysctl-d\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.391214 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.390960 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/819725de-9223-4f73-a7c2-f5abe8d0a725-etc-selinux\") pod \"aws-ebs-csi-driver-node-hch2b\" (UID: \"819725de-9223-4f73-a7c2-f5abe8d0a725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hch2b" May 21 14:54:35.391214 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.390763 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-etc-modprobe-d\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.391214 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391038 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-host\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.391214 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391064 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-sys\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.391214 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391072 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-host-cni-netd\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.391214 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391047 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/819725de-9223-4f73-a7c2-f5abe8d0a725-etc-selinux\") pod \"aws-ebs-csi-driver-node-hch2b\" (UID: \"819725de-9223-4f73-a7c2-f5abe8d0a725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hch2b" May 21 14:54:35.391214 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391110 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-host-kubelet\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.391214 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391116 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hjrk7\" (UniqueName: \"kubernetes.io/projected/819725de-9223-4f73-a7c2-f5abe8d0a725-kube-api-access-hjrk7\") pod \"aws-ebs-csi-driver-node-hch2b\" (UID: \"819725de-9223-4f73-a7c2-f5abe8d0a725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hch2b" May 21 14:54:35.391214 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391142 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/819725de-9223-4f73-a7c2-f5abe8d0a725-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hch2b\" (UID: \"819725de-9223-4f73-a7c2-f5abe8d0a725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hch2b" May 21 14:54:35.391214 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391145 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-etc-sysctl-conf\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.391214 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391178 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-lib-modules\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.391214 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391194 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84caccde-ac51-463e-ba82-ccc6e54ee9dc-tmp\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.391214 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391210 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-node-log\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.391956 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391225 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/819725de-9223-4f73-a7c2-f5abe8d0a725-sys-fs\") pod \"aws-ebs-csi-driver-node-hch2b\" (UID: \"819725de-9223-4f73-a7c2-f5abe8d0a725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hch2b" May 21 14:54:35.391956 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391278 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-etc-sysconfig\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.391956 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391275 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-etc-sysctl-conf\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.391956 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391293 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-run\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.391956 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391293 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-systemd-units\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.391956 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391310 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/893775ba-09a6-4fd3-912b-23ffa1f601b6-host-slash\") pod \"iptables-alerter-9qd82\" (UID: \"893775ba-09a6-4fd3-912b-23ffa1f601b6\") " pod="openshift-network-operator/iptables-alerter-9qd82" May 21 14:54:35.391956 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391325 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-host-slash\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.391956 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391335 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-host-run-netns\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.391956 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391361 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-host-run-netns\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.391956 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391377 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/84caccde-ac51-463e-ba82-ccc6e54ee9dc-etc-tuned\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.391956 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391388 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-etc-sysctl-d\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.391956 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391433 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-etc-sysconfig\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.391956 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391448 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-lib-modules\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.391956 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391477 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-etc-systemd\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.391956 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391288 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/04d69156-db3f-4353-ada5-f84ea0fadc0c-env-overrides\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.391956 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391498 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-run-openvswitch\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.391956 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391513 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/893775ba-09a6-4fd3-912b-23ffa1f601b6-host-slash\") pod \"iptables-alerter-9qd82\" (UID: \"893775ba-09a6-4fd3-912b-23ffa1f601b6\") " pod="openshift-network-operator/iptables-alerter-9qd82" May 21 14:54:35.391956 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391522 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-node-log\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.392798 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391485 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-run\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.392798 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391558 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/819725de-9223-4f73-a7c2-f5abe8d0a725-sys-fs\") pod \"aws-ebs-csi-driver-node-hch2b\" (UID: \"819725de-9223-4f73-a7c2-f5abe8d0a725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hch2b" May 21 14:54:35.392798 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391632 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/893775ba-09a6-4fd3-912b-23ffa1f601b6-iptables-alerter-script\") pod \"iptables-alerter-9qd82\" (UID: \"893775ba-09a6-4fd3-912b-23ffa1f601b6\") " pod="openshift-network-operator/iptables-alerter-9qd82" May 21 14:54:35.392798 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391666 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-etc-openvswitch\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.392798 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391693 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.392798 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391721 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/819725de-9223-4f73-a7c2-f5abe8d0a725-registration-dir\") pod \"aws-ebs-csi-driver-node-hch2b\" (UID: \"819725de-9223-4f73-a7c2-f5abe8d0a725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hch2b" May 21 14:54:35.392798 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391753 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-etc-kubernetes\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.392798 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391779 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/04d69156-db3f-4353-ada5-f84ea0fadc0c-ovn-node-metrics-cert\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.392798 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391802 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/819725de-9223-4f73-a7c2-f5abe8d0a725-socket-dir\") pod \"aws-ebs-csi-driver-node-hch2b\" (UID: \"819725de-9223-4f73-a7c2-f5abe8d0a725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hch2b" May 21 14:54:35.392798 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391813 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.392798 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391829 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/04d69156-db3f-4353-ada5-f84ea0fadc0c-ovnkube-script-lib\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.392798 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391857 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/819725de-9223-4f73-a7c2-f5abe8d0a725-device-dir\") pod \"aws-ebs-csi-driver-node-hch2b\" (UID: \"819725de-9223-4f73-a7c2-f5abe8d0a725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hch2b" May 21 14:54:35.392798 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391863 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-etc-openvswitch\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.392798 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391883 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7bw7\" (UniqueName: \"kubernetes.io/projected/84caccde-ac51-463e-ba82-ccc6e54ee9dc-kube-api-access-t7bw7\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.392798 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391907 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-run-systemd\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.392798 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391931 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-var-lib-openvswitch\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.392798 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391956 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-run-ovn\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.393637 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.391997 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-log-socket\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.393637 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.392035 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-host-cni-bin\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.393637 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.392059 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/04d69156-db3f-4353-ada5-f84ea0fadc0c-ovnkube-config\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.393637 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.392093 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-var-lib-kubelet\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.393637 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.392123 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-host-run-ovn-kubernetes\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.393637 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.392147 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mxh7v\" (UniqueName: \"kubernetes.io/projected/04d69156-db3f-4353-ada5-f84ea0fadc0c-kube-api-access-mxh7v\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.393637 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.392178 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-log-socket\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.393637 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.392178 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-var-lib-openvswitch\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.393637 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.392194 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/893775ba-09a6-4fd3-912b-23ffa1f601b6-iptables-alerter-script\") pod \"iptables-alerter-9qd82\" (UID: \"893775ba-09a6-4fd3-912b-23ffa1f601b6\") " pod="openshift-network-operator/iptables-alerter-9qd82" May 21 14:54:35.393637 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.392211 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-host-cni-bin\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.393637 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.392259 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-var-lib-kubelet\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.393637 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.392274 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-host-run-ovn-kubernetes\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.393637 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.392320 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84caccde-ac51-463e-ba82-ccc6e54ee9dc-etc-kubernetes\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.393637 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.392363 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/819725de-9223-4f73-a7c2-f5abe8d0a725-registration-dir\") pod \"aws-ebs-csi-driver-node-hch2b\" (UID: \"819725de-9223-4f73-a7c2-f5abe8d0a725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hch2b" May 21 14:54:35.393637 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.392370 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/819725de-9223-4f73-a7c2-f5abe8d0a725-socket-dir\") pod \"aws-ebs-csi-driver-node-hch2b\" (UID: \"819725de-9223-4f73-a7c2-f5abe8d0a725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hch2b" May 21 14:54:35.393637 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.392448 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/819725de-9223-4f73-a7c2-f5abe8d0a725-device-dir\") pod \"aws-ebs-csi-driver-node-hch2b\" (UID: \"819725de-9223-4f73-a7c2-f5abe8d0a725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hch2b" May 21 14:54:35.393637 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.392498 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-run-systemd\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.394414 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.392534 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/04d69156-db3f-4353-ada5-f84ea0fadc0c-run-ovn\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.394414 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.392867 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/04d69156-db3f-4353-ada5-f84ea0fadc0c-ovnkube-script-lib\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.394414 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.393250 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/04d69156-db3f-4353-ada5-f84ea0fadc0c-ovnkube-config\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.394414 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.394008 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84caccde-ac51-463e-ba82-ccc6e54ee9dc-tmp\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.394414 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.394062 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/84caccde-ac51-463e-ba82-ccc6e54ee9dc-etc-tuned\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.394414 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.394371 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/04d69156-db3f-4353-ada5-f84ea0fadc0c-ovn-node-metrics-cert\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.400679 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.400598 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7bw7\" (UniqueName: \"kubernetes.io/projected/84caccde-ac51-463e-ba82-ccc6e54ee9dc-kube-api-access-t7bw7\") pod \"tuned-9tsp2\" (UID: \"84caccde-ac51-463e-ba82-ccc6e54ee9dc\") " pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.400907 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.400882 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln6c6\" (UniqueName: \"kubernetes.io/projected/893775ba-09a6-4fd3-912b-23ffa1f601b6-kube-api-access-ln6c6\") pod \"iptables-alerter-9qd82\" (UID: \"893775ba-09a6-4fd3-912b-23ffa1f601b6\") " pod="openshift-network-operator/iptables-alerter-9qd82" May 21 14:54:35.401123 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.401103 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxh7v\" (UniqueName: \"kubernetes.io/projected/04d69156-db3f-4353-ada5-f84ea0fadc0c-kube-api-access-mxh7v\") pod \"ovnkube-node-2qjxf\" (UID: \"04d69156-db3f-4353-ada5-f84ea0fadc0c\") " pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.401303 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.401281 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjrk7\" (UniqueName: \"kubernetes.io/projected/819725de-9223-4f73-a7c2-f5abe8d0a725-kube-api-access-hjrk7\") pod \"aws-ebs-csi-driver-node-hch2b\" (UID: \"819725de-9223-4f73-a7c2-f5abe8d0a725\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hch2b" May 21 14:54:35.481038 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.480998 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5tqsh" May 21 14:54:35.489705 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.489677 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hsxn8" May 21 14:54:35.497482 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.497453 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nbh7v" May 21 14:54:35.503098 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.503070 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v85zc" May 21 14:54:35.508722 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.508700 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w4lgs" May 21 14:54:35.515377 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.515352 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" May 21 14:54:35.522992 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.522960 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9qd82" May 21 14:54:35.530687 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.530655 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:35.536331 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.536310 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hch2b" May 21 14:54:35.794534 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.794452 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a47bc04-1f5f-4dc4-824a-5fa35b392b73-metrics-certs\") pod \"network-metrics-daemon-qtgkj\" (UID: \"4a47bc04-1f5f-4dc4-824a-5fa35b392b73\") " pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:54:35.794704 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:35.794590 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:54:35.794704 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:35.794680 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a47bc04-1f5f-4dc4-824a-5fa35b392b73-metrics-certs podName:4a47bc04-1f5f-4dc4-824a-5fa35b392b73 nodeName:}" failed. No retries permitted until 2026-05-21 14:54:36.794659039 +0000 UTC m=+4.090534921 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a47bc04-1f5f-4dc4-824a-5fa35b392b73-metrics-certs") pod "network-metrics-daemon-qtgkj" (UID: "4a47bc04-1f5f-4dc4-824a-5fa35b392b73") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:54:35.894856 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:35.894829 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z64gd\" (UniqueName: \"kubernetes.io/projected/b3b95b77-0eda-4a70-8a69-8eac95eefb8e-kube-api-access-z64gd\") pod \"network-check-target-gdtjn\" (UID: \"b3b95b77-0eda-4a70-8a69-8eac95eefb8e\") " pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:54:35.894962 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:35.894871 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6293d82_33a8_4156_998f_c0ed8232df8c.slice/crio-0318c92d831dfc9f3c3c14892425385ebb31aa2fde6b5b3815279555ddb668f5 WatchSource:0}: Error finding container 0318c92d831dfc9f3c3c14892425385ebb31aa2fde6b5b3815279555ddb668f5: Status 404 returned error can't find the container with id 0318c92d831dfc9f3c3c14892425385ebb31aa2fde6b5b3815279555ddb668f5 May 21 14:54:35.895043 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:35.894992 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:54:35.895043 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:35.895011 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:54:35.895043 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:35.895024 2557 projected.go:194] Error preparing data for projected volume kube-api-access-z64gd for pod openshift-network-diagnostics/network-check-target-gdtjn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:54:35.895212 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:35.895085 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3b95b77-0eda-4a70-8a69-8eac95eefb8e-kube-api-access-z64gd podName:b3b95b77-0eda-4a70-8a69-8eac95eefb8e nodeName:}" failed. No retries permitted until 2026-05-21 14:54:36.895064893 +0000 UTC m=+4.190940781 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-z64gd" (UniqueName: "kubernetes.io/projected/b3b95b77-0eda-4a70-8a69-8eac95eefb8e-kube-api-access-z64gd") pod "network-check-target-gdtjn" (UID: "b3b95b77-0eda-4a70-8a69-8eac95eefb8e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:54:35.896293 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:35.896233 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a5605b1_be58_4e18_85a7_35718abc3e2f.slice/crio-8c9082c4d170a00a8115bac70760be7c259f72b93a113bbe85645183bedae4a6 WatchSource:0}: Error finding container 8c9082c4d170a00a8115bac70760be7c259f72b93a113bbe85645183bedae4a6: Status 404 returned error can't find the container with id 8c9082c4d170a00a8115bac70760be7c259f72b93a113bbe85645183bedae4a6 May 21 14:54:35.899539 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:35.899450 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod460bd20d_6a98_47e3_9a2a_a1438b7cc63c.slice/crio-9531dd153f559f6e9f281b4b1e12181bca53360eee2803ceb4430dc99541db02 WatchSource:0}: Error finding container 9531dd153f559f6e9f281b4b1e12181bca53360eee2803ceb4430dc99541db02: Status 404 returned error can't find the container with id 9531dd153f559f6e9f281b4b1e12181bca53360eee2803ceb4430dc99541db02 May 21 14:54:35.900426 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:35.900391 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84caccde_ac51_463e_ba82_ccc6e54ee9dc.slice/crio-cea63be206436e7966785dbd69994a54ffb8b844a56d80f2b7959559aac82fab WatchSource:0}: Error finding container cea63be206436e7966785dbd69994a54ffb8b844a56d80f2b7959559aac82fab: Status 404 returned error can't find the container with id cea63be206436e7966785dbd69994a54ffb8b844a56d80f2b7959559aac82fab May 21 14:54:35.901219 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:35.901176 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04d69156_db3f_4353_ada5_f84ea0fadc0c.slice/crio-34f0cba1fabecac81014907f339beeeae9ab7deaa676cb55e421ce847160fc33 WatchSource:0}: Error finding container 34f0cba1fabecac81014907f339beeeae9ab7deaa676cb55e421ce847160fc33: Status 404 returned error can't find the container with id 34f0cba1fabecac81014907f339beeeae9ab7deaa676cb55e421ce847160fc33 May 21 14:54:35.902079 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:35.901919 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod575ad37b_aef2_41aa_8c72_53f7a515aa96.slice/crio-a261b49951a5b3af8b23c5786d43c57c595bd9f55a923b3f8af1521155a3f906 WatchSource:0}: Error finding container a261b49951a5b3af8b23c5786d43c57c595bd9f55a923b3f8af1521155a3f906: Status 404 returned error can't find the container with id a261b49951a5b3af8b23c5786d43c57c595bd9f55a923b3f8af1521155a3f906 May 21 14:54:35.903919 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:35.903819 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod893775ba_09a6_4fd3_912b_23ffa1f601b6.slice/crio-81ff764d36c65c2883fd82dbb717b83a2079be59b5022d5095dc3493d83c91e1 WatchSource:0}: Error finding container 81ff764d36c65c2883fd82dbb717b83a2079be59b5022d5095dc3493d83c91e1: Status 404 returned error can't find the container with id 81ff764d36c65c2883fd82dbb717b83a2079be59b5022d5095dc3493d83c91e1 May 21 14:54:35.905183 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:35.905093 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod819725de_9223_4f73_a7c2_f5abe8d0a725.slice/crio-9bb3c00d5bec99fd781f71f6ca89a75eb9fe205797ef658e6e23dde56b5e4c1c WatchSource:0}: Error finding container 9bb3c00d5bec99fd781f71f6ca89a75eb9fe205797ef658e6e23dde56b5e4c1c: Status 404 returned error can't find the container with id 9bb3c00d5bec99fd781f71f6ca89a75eb9fe205797ef658e6e23dde56b5e4c1c May 21 14:54:35.906774 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:54:35.906638 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd5269e8_4aa4_489a_a650_e45b4f8a99d7.slice/crio-c5ce8a40644a9f237615960a2ffee092506c9dc1990541ad5bfd62209bd31781 WatchSource:0}: Error finding container c5ce8a40644a9f237615960a2ffee092506c9dc1990541ad5bfd62209bd31781: Status 404 returned error can't find the container with id c5ce8a40644a9f237615960a2ffee092506c9dc1990541ad5bfd62209bd31781 May 21 14:54:36.242368 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:36.242288 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 14:49:34 +0000 UTC" deadline="2027-12-13 00:29:49.35716074 +0000 UTC" May 21 14:54:36.242368 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:36.242335 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13689h35m13.114830036s" May 21 14:54:36.313109 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:36.312408 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-49.ec2.internal" event={"ID":"424ec5f97454f8128494aaae5c30ac05","Type":"ContainerStarted","Data":"a7a4adab5146a2cc576700b3d054e72f62edff7be4dff66293204d5678081409"} May 21 14:54:36.316025 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:36.315360 2557 generic.go:358] "Generic (PLEG): container finished" podID="c5aee6b7c8b52c009d017aa2d3454cd4" containerID="83b9e2b8d2c81cf25c91982a40b2cd2b39a166be4c3fc0d803b7348f89c03b35" exitCode=0 May 21 14:54:36.316025 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:36.315433 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-49.ec2.internal" event={"ID":"c5aee6b7c8b52c009d017aa2d3454cd4","Type":"ContainerDied","Data":"83b9e2b8d2c81cf25c91982a40b2cd2b39a166be4c3fc0d803b7348f89c03b35"} May 21 14:54:36.320176 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:36.320110 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9qd82" event={"ID":"893775ba-09a6-4fd3-912b-23ffa1f601b6","Type":"ContainerStarted","Data":"81ff764d36c65c2883fd82dbb717b83a2079be59b5022d5095dc3493d83c91e1"} May 21 14:54:36.322548 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:36.322487 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hsxn8" event={"ID":"460bd20d-6a98-47e3-9a2a-a1438b7cc63c","Type":"ContainerStarted","Data":"9531dd153f559f6e9f281b4b1e12181bca53360eee2803ceb4430dc99541db02"} May 21 14:54:36.326449 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:36.326393 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nbh7v" event={"ID":"4a5605b1-be58-4e18-85a7-35718abc3e2f","Type":"ContainerStarted","Data":"8c9082c4d170a00a8115bac70760be7c259f72b93a113bbe85645183bedae4a6"} May 21 14:54:36.330577 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:36.330510 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v85zc" event={"ID":"bd5269e8-4aa4-489a-a650-e45b4f8a99d7","Type":"ContainerStarted","Data":"c5ce8a40644a9f237615960a2ffee092506c9dc1990541ad5bfd62209bd31781"} May 21 14:54:36.331972 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:36.331937 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hch2b" event={"ID":"819725de-9223-4f73-a7c2-f5abe8d0a725","Type":"ContainerStarted","Data":"9bb3c00d5bec99fd781f71f6ca89a75eb9fe205797ef658e6e23dde56b5e4c1c"} May 21 14:54:36.334331 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:36.334297 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5tqsh" event={"ID":"575ad37b-aef2-41aa-8c72-53f7a515aa96","Type":"ContainerStarted","Data":"a261b49951a5b3af8b23c5786d43c57c595bd9f55a923b3f8af1521155a3f906"} May 21 14:54:36.337060 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:36.337033 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" event={"ID":"04d69156-db3f-4353-ada5-f84ea0fadc0c","Type":"ContainerStarted","Data":"34f0cba1fabecac81014907f339beeeae9ab7deaa676cb55e421ce847160fc33"} May 21 14:54:36.339464 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:36.339439 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" event={"ID":"84caccde-ac51-463e-ba82-ccc6e54ee9dc","Type":"ContainerStarted","Data":"cea63be206436e7966785dbd69994a54ffb8b844a56d80f2b7959559aac82fab"} May 21 14:54:36.346330 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:36.346297 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w4lgs" event={"ID":"a6293d82-33a8-4156-998f-c0ed8232df8c","Type":"ContainerStarted","Data":"0318c92d831dfc9f3c3c14892425385ebb31aa2fde6b5b3815279555ddb668f5"} May 21 14:54:36.346748 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:36.346698 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-49.ec2.internal" podStartSLOduration=2.346683447 podStartE2EDuration="2.346683447s" podCreationTimestamp="2026-05-21 14:54:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:54:36.330248534 +0000 UTC m=+3.626124437" watchObservedRunningTime="2026-05-21 14:54:36.346683447 +0000 UTC m=+3.642559351" May 21 14:54:36.804436 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:36.804320 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a47bc04-1f5f-4dc4-824a-5fa35b392b73-metrics-certs\") pod \"network-metrics-daemon-qtgkj\" (UID: \"4a47bc04-1f5f-4dc4-824a-5fa35b392b73\") " pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:54:36.804616 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:36.804520 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:54:36.804616 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:36.804586 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a47bc04-1f5f-4dc4-824a-5fa35b392b73-metrics-certs podName:4a47bc04-1f5f-4dc4-824a-5fa35b392b73 nodeName:}" failed. No retries permitted until 2026-05-21 14:54:38.804564142 +0000 UTC m=+6.100440027 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a47bc04-1f5f-4dc4-824a-5fa35b392b73-metrics-certs") pod "network-metrics-daemon-qtgkj" (UID: "4a47bc04-1f5f-4dc4-824a-5fa35b392b73") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:54:36.906930 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:36.906885 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z64gd\" (UniqueName: \"kubernetes.io/projected/b3b95b77-0eda-4a70-8a69-8eac95eefb8e-kube-api-access-z64gd\") pod \"network-check-target-gdtjn\" (UID: \"b3b95b77-0eda-4a70-8a69-8eac95eefb8e\") " pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:54:36.907127 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:36.907108 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:54:36.907185 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:36.907136 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:54:36.907185 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:36.907151 2557 projected.go:194] Error preparing data for projected volume kube-api-access-z64gd for pod openshift-network-diagnostics/network-check-target-gdtjn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:54:36.907301 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:36.907212 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3b95b77-0eda-4a70-8a69-8eac95eefb8e-kube-api-access-z64gd podName:b3b95b77-0eda-4a70-8a69-8eac95eefb8e nodeName:}" failed. No retries permitted until 2026-05-21 14:54:38.907192755 +0000 UTC m=+6.203068642 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-z64gd" (UniqueName: "kubernetes.io/projected/b3b95b77-0eda-4a70-8a69-8eac95eefb8e-kube-api-access-z64gd") pod "network-check-target-gdtjn" (UID: "b3b95b77-0eda-4a70-8a69-8eac95eefb8e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:54:37.305953 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:37.305187 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:54:37.305953 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:37.305332 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtgkj" podUID="4a47bc04-1f5f-4dc4-824a-5fa35b392b73" May 21 14:54:37.305953 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:37.305744 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:54:37.305953 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:37.305851 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdtjn" podUID="b3b95b77-0eda-4a70-8a69-8eac95eefb8e" May 21 14:54:37.362651 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:37.362615 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-49.ec2.internal" event={"ID":"c5aee6b7c8b52c009d017aa2d3454cd4","Type":"ContainerStarted","Data":"bd641f9c7dc616cae63731797fa391595f866063339349cb327d44cfdadd0c9f"} May 21 14:54:38.826210 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:38.826135 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a47bc04-1f5f-4dc4-824a-5fa35b392b73-metrics-certs\") pod \"network-metrics-daemon-qtgkj\" (UID: \"4a47bc04-1f5f-4dc4-824a-5fa35b392b73\") " pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:54:38.826678 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:38.826292 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:54:38.826678 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:38.826355 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a47bc04-1f5f-4dc4-824a-5fa35b392b73-metrics-certs podName:4a47bc04-1f5f-4dc4-824a-5fa35b392b73 nodeName:}" failed. No retries permitted until 2026-05-21 14:54:42.826337407 +0000 UTC m=+10.122213301 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a47bc04-1f5f-4dc4-824a-5fa35b392b73-metrics-certs") pod "network-metrics-daemon-qtgkj" (UID: "4a47bc04-1f5f-4dc4-824a-5fa35b392b73") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:54:38.927305 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:38.927260 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z64gd\" (UniqueName: \"kubernetes.io/projected/b3b95b77-0eda-4a70-8a69-8eac95eefb8e-kube-api-access-z64gd\") pod \"network-check-target-gdtjn\" (UID: \"b3b95b77-0eda-4a70-8a69-8eac95eefb8e\") " pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:54:38.927534 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:38.927460 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:54:38.927534 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:38.927482 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:54:38.927534 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:38.927495 2557 projected.go:194] Error preparing data for projected volume kube-api-access-z64gd for pod openshift-network-diagnostics/network-check-target-gdtjn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:54:38.927688 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:38.927558 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3b95b77-0eda-4a70-8a69-8eac95eefb8e-kube-api-access-z64gd podName:b3b95b77-0eda-4a70-8a69-8eac95eefb8e nodeName:}" failed. No retries permitted until 2026-05-21 14:54:42.92754095 +0000 UTC m=+10.223416846 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-z64gd" (UniqueName: "kubernetes.io/projected/b3b95b77-0eda-4a70-8a69-8eac95eefb8e-kube-api-access-z64gd") pod "network-check-target-gdtjn" (UID: "b3b95b77-0eda-4a70-8a69-8eac95eefb8e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:54:39.303005 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:39.302909 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:54:39.303173 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:39.303061 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtgkj" podUID="4a47bc04-1f5f-4dc4-824a-5fa35b392b73" May 21 14:54:39.303538 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:39.303521 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:54:39.303633 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:39.303613 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdtjn" podUID="b3b95b77-0eda-4a70-8a69-8eac95eefb8e" May 21 14:54:41.302376 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:41.302345 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:54:41.302810 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:41.302383 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:54:41.302810 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:41.302489 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtgkj" podUID="4a47bc04-1f5f-4dc4-824a-5fa35b392b73" May 21 14:54:41.302929 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:41.302893 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdtjn" podUID="b3b95b77-0eda-4a70-8a69-8eac95eefb8e" May 21 14:54:42.860699 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:42.860112 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a47bc04-1f5f-4dc4-824a-5fa35b392b73-metrics-certs\") pod \"network-metrics-daemon-qtgkj\" (UID: \"4a47bc04-1f5f-4dc4-824a-5fa35b392b73\") " pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:54:42.860699 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:42.860292 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:54:42.860699 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:42.860365 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a47bc04-1f5f-4dc4-824a-5fa35b392b73-metrics-certs podName:4a47bc04-1f5f-4dc4-824a-5fa35b392b73 nodeName:}" failed. No retries permitted until 2026-05-21 14:54:50.860343903 +0000 UTC m=+18.156219794 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a47bc04-1f5f-4dc4-824a-5fa35b392b73-metrics-certs") pod "network-metrics-daemon-qtgkj" (UID: "4a47bc04-1f5f-4dc4-824a-5fa35b392b73") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:54:42.961365 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:42.961321 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z64gd\" (UniqueName: \"kubernetes.io/projected/b3b95b77-0eda-4a70-8a69-8eac95eefb8e-kube-api-access-z64gd\") pod \"network-check-target-gdtjn\" (UID: \"b3b95b77-0eda-4a70-8a69-8eac95eefb8e\") " pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:54:42.961561 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:42.961532 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:54:42.961561 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:42.961554 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:54:42.961670 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:42.961567 2557 projected.go:194] Error preparing data for projected volume kube-api-access-z64gd for pod openshift-network-diagnostics/network-check-target-gdtjn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:54:42.961670 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:42.961636 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3b95b77-0eda-4a70-8a69-8eac95eefb8e-kube-api-access-z64gd podName:b3b95b77-0eda-4a70-8a69-8eac95eefb8e nodeName:}" failed. No retries permitted until 2026-05-21 14:54:50.96161522 +0000 UTC m=+18.257491102 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-z64gd" (UniqueName: "kubernetes.io/projected/b3b95b77-0eda-4a70-8a69-8eac95eefb8e-kube-api-access-z64gd") pod "network-check-target-gdtjn" (UID: "b3b95b77-0eda-4a70-8a69-8eac95eefb8e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:54:43.302314 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:43.302226 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:54:43.302477 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:43.302402 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtgkj" podUID="4a47bc04-1f5f-4dc4-824a-5fa35b392b73" May 21 14:54:43.304124 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:43.303925 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:54:43.304124 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:43.304067 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdtjn" podUID="b3b95b77-0eda-4a70-8a69-8eac95eefb8e" May 21 14:54:45.302815 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:45.302779 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:54:45.303291 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:45.302785 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:54:45.303291 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:45.302953 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdtjn" podUID="b3b95b77-0eda-4a70-8a69-8eac95eefb8e" May 21 14:54:45.303291 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:45.303112 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtgkj" podUID="4a47bc04-1f5f-4dc4-824a-5fa35b392b73" May 21 14:54:47.302164 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:47.302076 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:54:47.302164 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:47.302112 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:54:47.302691 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:47.302229 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtgkj" podUID="4a47bc04-1f5f-4dc4-824a-5fa35b392b73" May 21 14:54:47.302691 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:47.302343 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdtjn" podUID="b3b95b77-0eda-4a70-8a69-8eac95eefb8e" May 21 14:54:49.302510 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:49.302473 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:54:49.302992 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:49.302528 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:54:49.302992 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:49.302615 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdtjn" podUID="b3b95b77-0eda-4a70-8a69-8eac95eefb8e" May 21 14:54:49.302992 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:49.302756 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtgkj" podUID="4a47bc04-1f5f-4dc4-824a-5fa35b392b73" May 21 14:54:50.915555 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:50.915518 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a47bc04-1f5f-4dc4-824a-5fa35b392b73-metrics-certs\") pod \"network-metrics-daemon-qtgkj\" (UID: \"4a47bc04-1f5f-4dc4-824a-5fa35b392b73\") " pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:54:50.916005 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:50.915696 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:54:50.916005 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:50.915765 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a47bc04-1f5f-4dc4-824a-5fa35b392b73-metrics-certs podName:4a47bc04-1f5f-4dc4-824a-5fa35b392b73 nodeName:}" failed. No retries permitted until 2026-05-21 14:55:06.915748939 +0000 UTC m=+34.211624818 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a47bc04-1f5f-4dc4-824a-5fa35b392b73-metrics-certs") pod "network-metrics-daemon-qtgkj" (UID: "4a47bc04-1f5f-4dc4-824a-5fa35b392b73") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:54:51.016489 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:51.016445 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z64gd\" (UniqueName: \"kubernetes.io/projected/b3b95b77-0eda-4a70-8a69-8eac95eefb8e-kube-api-access-z64gd\") pod \"network-check-target-gdtjn\" (UID: \"b3b95b77-0eda-4a70-8a69-8eac95eefb8e\") " pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:54:51.016666 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:51.016615 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:54:51.016666 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:51.016643 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:54:51.016666 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:51.016657 2557 projected.go:194] Error preparing data for projected volume kube-api-access-z64gd for pod openshift-network-diagnostics/network-check-target-gdtjn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:54:51.016803 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:51.016736 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3b95b77-0eda-4a70-8a69-8eac95eefb8e-kube-api-access-z64gd podName:b3b95b77-0eda-4a70-8a69-8eac95eefb8e nodeName:}" failed. No retries permitted until 2026-05-21 14:55:07.016703571 +0000 UTC m=+34.312579467 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-z64gd" (UniqueName: "kubernetes.io/projected/b3b95b77-0eda-4a70-8a69-8eac95eefb8e-kube-api-access-z64gd") pod "network-check-target-gdtjn" (UID: "b3b95b77-0eda-4a70-8a69-8eac95eefb8e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:54:51.302871 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:51.302781 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:54:51.303056 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:51.302780 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:54:51.303056 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:51.302950 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdtjn" podUID="b3b95b77-0eda-4a70-8a69-8eac95eefb8e" May 21 14:54:51.303056 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:51.303012 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtgkj" podUID="4a47bc04-1f5f-4dc4-824a-5fa35b392b73" May 21 14:54:53.303892 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:53.303854 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:54:53.304264 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:53.303904 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:54:53.304264 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:53.304047 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdtjn" podUID="b3b95b77-0eda-4a70-8a69-8eac95eefb8e" May 21 14:54:53.304264 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:53.304032 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtgkj" podUID="4a47bc04-1f5f-4dc4-824a-5fa35b392b73" May 21 14:54:54.401614 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:54.401183 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v85zc" event={"ID":"bd5269e8-4aa4-489a-a650-e45b4f8a99d7","Type":"ContainerStarted","Data":"50064fb2e29bb2b6c14ef91eb38f7540bc1cc6309c8d8d0f83f5c103899c40ba"} May 21 14:54:54.402791 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:54.402759 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hch2b" event={"ID":"819725de-9223-4f73-a7c2-f5abe8d0a725","Type":"ContainerStarted","Data":"05ed4c050367a2088f2dd29b23f0ec49fa449dff2543d81edafe188e0a6d0437"} May 21 14:54:54.404254 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:54.404222 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5tqsh" event={"ID":"575ad37b-aef2-41aa-8c72-53f7a515aa96","Type":"ContainerStarted","Data":"c26530db1bea9fa24072e252268e7b4d887d6227c61a8fd9d40e0ca07050ee97"} May 21 14:54:54.407286 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:54.407252 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" event={"ID":"04d69156-db3f-4353-ada5-f84ea0fadc0c","Type":"ContainerStarted","Data":"a186be21f0d34db508ae27b1f1c1731a2be73f96064484dcd3f9543bbaff1e2e"} May 21 14:54:54.407286 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:54.407287 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" event={"ID":"04d69156-db3f-4353-ada5-f84ea0fadc0c","Type":"ContainerStarted","Data":"c2741b3afd9913753e17efff3363a288cbf7aaaeb647322ef7fe2de89d66e823"} May 21 14:54:54.407451 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:54.407299 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" event={"ID":"04d69156-db3f-4353-ada5-f84ea0fadc0c","Type":"ContainerStarted","Data":"2ad5163acf43543cd4d2c1a8b8c9bf9aaf54f8503e27ca340ba5bf2324355a58"} May 21 14:54:54.407451 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:54.407307 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" event={"ID":"04d69156-db3f-4353-ada5-f84ea0fadc0c","Type":"ContainerStarted","Data":"b01d2fdc0380c204f11ceceeb367fa8165cb2b45a711aee3a084f8c5e791c1a7"} May 21 14:54:54.407451 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:54.407322 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" event={"ID":"04d69156-db3f-4353-ada5-f84ea0fadc0c","Type":"ContainerStarted","Data":"c818115fc333900f7e39768764fb1f87f21e27acc15cd2bc69c0946de30db868"} May 21 14:54:54.407451 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:54.407334 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" event={"ID":"04d69156-db3f-4353-ada5-f84ea0fadc0c","Type":"ContainerStarted","Data":"05b50fb4d63cfc0c261a2dbd3fe5fef439c3c2aa28a46a573dd4bb44d586cd91"} May 21 14:54:54.408678 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:54.408652 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" event={"ID":"84caccde-ac51-463e-ba82-ccc6e54ee9dc","Type":"ContainerStarted","Data":"f8e943dc26785280475a8137526d091b58e0e9c38f8638134c995a56dffcaba9"} May 21 14:54:54.410124 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:54.410103 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w4lgs" event={"ID":"a6293d82-33a8-4156-998f-c0ed8232df8c","Type":"ContainerStarted","Data":"b6e1ea2eabceb8349a5756e9a92ad7d95217abc76fb16ed8e0cfac7244ca41d4"} May 21 14:54:54.411685 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:54.411659 2557 generic.go:358] "Generic (PLEG): container finished" podID="460bd20d-6a98-47e3-9a2a-a1438b7cc63c" containerID="10a33848f632ff9846591ed3d61a370d55e0225e2edb23638bdbf704293aebb8" exitCode=0 May 21 14:54:54.411775 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:54.411737 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hsxn8" event={"ID":"460bd20d-6a98-47e3-9a2a-a1438b7cc63c","Type":"ContainerDied","Data":"10a33848f632ff9846591ed3d61a370d55e0225e2edb23638bdbf704293aebb8"} May 21 14:54:54.413125 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:54.413085 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nbh7v" event={"ID":"4a5605b1-be58-4e18-85a7-35718abc3e2f","Type":"ContainerStarted","Data":"f9d48987f8a689fb2176c6712ec30a0e37d0194acb84dc159d9ffa2ee5234758"} May 21 14:54:54.417482 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:54.417445 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-49.ec2.internal" podStartSLOduration=20.417435307 podStartE2EDuration="20.417435307s" podCreationTimestamp="2026-05-21 14:54:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:54:37.38421531 +0000 UTC m=+4.680091213" watchObservedRunningTime="2026-05-21 14:54:54.417435307 +0000 UTC m=+21.713311208" May 21 14:54:54.436558 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:54.436502 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-v85zc" podStartSLOduration=3.823797929 podStartE2EDuration="21.436480569s" podCreationTimestamp="2026-05-21 14:54:33 +0000 UTC" firstStartedPulling="2026-05-21 14:54:35.908411181 +0000 UTC m=+3.204287065" lastFinishedPulling="2026-05-21 14:54:53.521093811 +0000 UTC m=+20.816969705" observedRunningTime="2026-05-21 14:54:54.417393257 +0000 UTC m=+21.713269158" watchObservedRunningTime="2026-05-21 14:54:54.436480569 +0000 UTC m=+21.732356461" May 21 14:54:54.437049 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:54.437019 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9tsp2" podStartSLOduration=3.793818992 podStartE2EDuration="21.437009815s" podCreationTimestamp="2026-05-21 14:54:33 +0000 UTC" firstStartedPulling="2026-05-21 14:54:35.902245232 +0000 UTC m=+3.198121123" lastFinishedPulling="2026-05-21 14:54:53.545436054 +0000 UTC m=+20.841311946" observedRunningTime="2026-05-21 14:54:54.436601075 +0000 UTC m=+21.732476979" watchObservedRunningTime="2026-05-21 14:54:54.437009815 +0000 UTC m=+21.732885716" May 21 14:54:54.482889 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:54.482843 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-5tqsh" podStartSLOduration=3.843487977 podStartE2EDuration="21.482826745s" podCreationTimestamp="2026-05-21 14:54:33 +0000 UTC" firstStartedPulling="2026-05-21 14:54:35.904762268 +0000 UTC m=+3.200638149" lastFinishedPulling="2026-05-21 14:54:53.544101024 +0000 UTC m=+20.839976917" observedRunningTime="2026-05-21 14:54:54.455138907 +0000 UTC m=+21.751014807" watchObservedRunningTime="2026-05-21 14:54:54.482826745 +0000 UTC m=+21.778702643" May 21 14:54:54.504108 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:54.504056 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-nbh7v" podStartSLOduration=3.843155359 podStartE2EDuration="21.504041897s" podCreationTimestamp="2026-05-21 14:54:33 +0000 UTC" firstStartedPulling="2026-05-21 14:54:35.898308082 +0000 UTC m=+3.194183966" lastFinishedPulling="2026-05-21 14:54:53.559194608 +0000 UTC m=+20.855070504" observedRunningTime="2026-05-21 14:54:54.503634138 +0000 UTC m=+21.799510038" watchObservedRunningTime="2026-05-21 14:54:54.504041897 +0000 UTC m=+21.799917798" May 21 14:54:54.521796 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:54.521708 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-w4lgs" podStartSLOduration=11.645651061 podStartE2EDuration="21.521690516s" podCreationTimestamp="2026-05-21 14:54:33 +0000 UTC" firstStartedPulling="2026-05-21 14:54:35.897710773 +0000 UTC m=+3.193586655" lastFinishedPulling="2026-05-21 14:54:45.773750214 +0000 UTC m=+13.069626110" observedRunningTime="2026-05-21 14:54:54.521470257 +0000 UTC m=+21.817346171" watchObservedRunningTime="2026-05-21 14:54:54.521690516 +0000 UTC m=+21.817566419" May 21 14:54:54.626753 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:54.626541 2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 21 14:54:55.244987 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:55.244851 2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T14:54:54.626747633Z","UUID":"f5bfa2f6-bdf9-4854-bf01-60988561f25a","Handler":null,"Name":"","Endpoint":""} May 21 14:54:55.248450 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:55.248408 2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 21 14:54:55.248623 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:55.248523 2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 21 14:54:55.301804 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:55.301762 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:54:55.302007 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:55.301921 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtgkj" podUID="4a47bc04-1f5f-4dc4-824a-5fa35b392b73" May 21 14:54:55.302289 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:55.302144 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:54:55.302289 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:55.302252 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdtjn" podUID="b3b95b77-0eda-4a70-8a69-8eac95eefb8e" May 21 14:54:55.417156 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:55.417066 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hch2b" event={"ID":"819725de-9223-4f73-a7c2-f5abe8d0a725","Type":"ContainerStarted","Data":"c36553e67b5558dd3035cd269655bcdf29d1d7cfdb0fb11de4194a44f5e7f496"} May 21 14:54:55.418643 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:55.418605 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9qd82" event={"ID":"893775ba-09a6-4fd3-912b-23ffa1f601b6","Type":"ContainerStarted","Data":"256cfa4b3a6b23649eed7ebbed862ff90316e1faa45bfb105e7bd53c9f251268"} May 21 14:54:55.435106 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:55.435054 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9qd82" podStartSLOduration=4.797231415 podStartE2EDuration="22.435040824s" podCreationTimestamp="2026-05-21 14:54:33 +0000 UTC" firstStartedPulling="2026-05-21 14:54:35.905769709 +0000 UTC m=+3.201645590" lastFinishedPulling="2026-05-21 14:54:53.543579106 +0000 UTC m=+20.839454999" observedRunningTime="2026-05-21 14:54:55.434998167 +0000 UTC m=+22.730874065" watchObservedRunningTime="2026-05-21 14:54:55.435040824 +0000 UTC m=+22.730916725" May 21 14:54:56.423453 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:56.423358 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" event={"ID":"04d69156-db3f-4353-ada5-f84ea0fadc0c","Type":"ContainerStarted","Data":"355f328d6d71f853fb03a35ddf19ce01b2d413d0f997dbc8f33a5cdb95a71b84"} May 21 14:54:56.425070 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:56.425043 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hch2b" event={"ID":"819725de-9223-4f73-a7c2-f5abe8d0a725","Type":"ContainerStarted","Data":"84e38843d9e9ad3a9c6da0729c3c77b601baa50c715fc9fe7540f3f77f49897e"} May 21 14:54:57.302399 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:57.302345 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:54:57.302399 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:57.302383 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:54:57.302663 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:57.302523 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtgkj" podUID="4a47bc04-1f5f-4dc4-824a-5fa35b392b73" May 21 14:54:57.302663 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:57.302635 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdtjn" podUID="b3b95b77-0eda-4a70-8a69-8eac95eefb8e" May 21 14:54:58.089451 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:58.089416 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-v85zc" May 21 14:54:58.090395 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:58.090372 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-v85zc" May 21 14:54:58.106634 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:58.106578 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hch2b" podStartSLOduration=5.421661417 podStartE2EDuration="25.106563224s" podCreationTimestamp="2026-05-21 14:54:33 +0000 UTC" firstStartedPulling="2026-05-21 14:54:35.907193103 +0000 UTC m=+3.203068997" lastFinishedPulling="2026-05-21 14:54:55.592094914 +0000 UTC m=+22.887970804" observedRunningTime="2026-05-21 14:54:56.443633304 +0000 UTC m=+23.739509203" watchObservedRunningTime="2026-05-21 14:54:58.106563224 +0000 UTC m=+25.402439124" May 21 14:54:58.428927 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:58.428845 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-v85zc" May 21 14:54:58.429387 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:58.429364 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-v85zc" May 21 14:54:59.302841 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:59.302509 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:54:59.302841 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:59.302509 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:54:59.303319 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:59.302869 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdtjn" podUID="b3b95b77-0eda-4a70-8a69-8eac95eefb8e" May 21 14:54:59.303319 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:54:59.302908 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtgkj" podUID="4a47bc04-1f5f-4dc4-824a-5fa35b392b73" May 21 14:54:59.433338 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:59.433308 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" event={"ID":"04d69156-db3f-4353-ada5-f84ea0fadc0c","Type":"ContainerStarted","Data":"00019a5c40bb5d240b03b36b7c2646acbee2d0df5be648c8a1bc48705d412799"} May 21 14:54:59.433583 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:59.433558 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:59.433695 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:59.433593 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:59.449954 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:59.449931 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:54:59.462186 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:54:59.462140 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" podStartSLOduration=8.776823662 podStartE2EDuration="26.462124314s" podCreationTimestamp="2026-05-21 14:54:33 +0000 UTC" firstStartedPulling="2026-05-21 14:54:35.903268239 +0000 UTC m=+3.199144130" lastFinishedPulling="2026-05-21 14:54:53.5885689 +0000 UTC m=+20.884444782" observedRunningTime="2026-05-21 14:54:59.461741078 +0000 UTC m=+26.757616998" watchObservedRunningTime="2026-05-21 14:54:59.462124314 +0000 UTC m=+26.758000214" May 21 14:55:00.436320 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:00.436285 2557 generic.go:358] "Generic (PLEG): container finished" podID="460bd20d-6a98-47e3-9a2a-a1438b7cc63c" containerID="3e5b1b470bd31c072b504e3cf26017294f5081e6bae288fb62a944df6edc8aec" exitCode=0 May 21 14:55:00.436847 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:00.436369 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hsxn8" event={"ID":"460bd20d-6a98-47e3-9a2a-a1438b7cc63c","Type":"ContainerDied","Data":"3e5b1b470bd31c072b504e3cf26017294f5081e6bae288fb62a944df6edc8aec"} May 21 14:55:00.437521 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:00.437103 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:55:00.452778 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:00.452750 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:55:01.302600 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:01.302355 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:55:01.302737 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:01.302703 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdtjn" podUID="b3b95b77-0eda-4a70-8a69-8eac95eefb8e" May 21 14:55:01.302737 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:01.302420 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:55:01.302900 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:01.302817 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtgkj" podUID="4a47bc04-1f5f-4dc4-824a-5fa35b392b73" May 21 14:55:01.310516 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:01.310486 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qtgkj"] May 21 14:55:01.323996 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:01.323958 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gdtjn"] May 21 14:55:01.440489 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:01.440455 2557 generic.go:358] "Generic (PLEG): container finished" podID="460bd20d-6a98-47e3-9a2a-a1438b7cc63c" containerID="0d0d9e8a46ae35a66742e7d09707d94376f68ce03cbb8fe6a1c157e19c52f161" exitCode=0 May 21 14:55:01.440963 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:01.440500 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hsxn8" event={"ID":"460bd20d-6a98-47e3-9a2a-a1438b7cc63c","Type":"ContainerDied","Data":"0d0d9e8a46ae35a66742e7d09707d94376f68ce03cbb8fe6a1c157e19c52f161"} May 21 14:55:01.440963 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:01.440553 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:55:01.440963 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:01.440641 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdtjn" podUID="b3b95b77-0eda-4a70-8a69-8eac95eefb8e" May 21 14:55:01.440963 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:01.440729 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:55:01.440963 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:01.440842 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtgkj" podUID="4a47bc04-1f5f-4dc4-824a-5fa35b392b73" May 21 14:55:03.303298 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:03.303257 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:55:03.304010 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:03.303364 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdtjn" podUID="b3b95b77-0eda-4a70-8a69-8eac95eefb8e" May 21 14:55:03.304010 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:03.303413 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:55:03.304010 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:03.303509 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtgkj" podUID="4a47bc04-1f5f-4dc4-824a-5fa35b392b73" May 21 14:55:03.447256 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:03.447226 2557 generic.go:358] "Generic (PLEG): container finished" podID="460bd20d-6a98-47e3-9a2a-a1438b7cc63c" containerID="b513e19161b5bcb73e7a30a850cc5460975d57773d2b5b96779e27b03b9af4b1" exitCode=0 May 21 14:55:03.447403 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:03.447267 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hsxn8" event={"ID":"460bd20d-6a98-47e3-9a2a-a1438b7cc63c","Type":"ContainerDied","Data":"b513e19161b5bcb73e7a30a850cc5460975d57773d2b5b96779e27b03b9af4b1"} May 21 14:55:05.302195 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:05.302160 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:55:05.302736 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:05.302160 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:55:05.302736 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:05.302320 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qtgkj" podUID="4a47bc04-1f5f-4dc4-824a-5fa35b392b73" May 21 14:55:05.302736 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:05.302366 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdtjn" podUID="b3b95b77-0eda-4a70-8a69-8eac95eefb8e" May 21 14:55:06.515158 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.515130 2557 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-137-49.ec2.internal" event="NodeReady" May 21 14:55:06.515543 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.515256 2557 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 21 14:55:06.564245 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.564202 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-57vtw"] May 21 14:55:06.583631 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.583599 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tpsq5"] May 21 14:55:06.583817 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.583762 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-57vtw" May 21 14:55:06.586287 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.586116 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 21 14:55:06.586287 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.586136 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jrvl8\"" May 21 14:55:06.586287 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.586205 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 21 14:55:06.605043 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.605007 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-57vtw"] May 21 14:55:06.605043 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.605037 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tpsq5"] May 21 14:55:06.605263 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.605157 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tpsq5" May 21 14:55:06.607957 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.607765 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 21 14:55:06.607957 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.607831 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 21 14:55:06.607957 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.607840 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 21 14:55:06.607957 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.607840 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-j2cxw\"" May 21 14:55:06.735285 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.735253 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c45651aa-fdb1-463b-a7cd-e3894c939874-tmp-dir\") pod \"dns-default-57vtw\" (UID: \"c45651aa-fdb1-463b-a7cd-e3894c939874\") " pod="openshift-dns/dns-default-57vtw" May 21 14:55:06.735476 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.735318 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf248aa5-1086-4c30-919a-df06b4850374-cert\") pod \"ingress-canary-tpsq5\" (UID: \"cf248aa5-1086-4c30-919a-df06b4850374\") " pod="openshift-ingress-canary/ingress-canary-tpsq5" May 21 14:55:06.735476 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.735381 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c45651aa-fdb1-463b-a7cd-e3894c939874-metrics-tls\") pod \"dns-default-57vtw\" (UID: \"c45651aa-fdb1-463b-a7cd-e3894c939874\") " pod="openshift-dns/dns-default-57vtw" May 21 14:55:06.735476 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.735411 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpsjg\" (UniqueName: \"kubernetes.io/projected/cf248aa5-1086-4c30-919a-df06b4850374-kube-api-access-gpsjg\") pod \"ingress-canary-tpsq5\" (UID: \"cf248aa5-1086-4c30-919a-df06b4850374\") " pod="openshift-ingress-canary/ingress-canary-tpsq5" May 21 14:55:06.735602 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.735482 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dv2w\" (UniqueName: \"kubernetes.io/projected/c45651aa-fdb1-463b-a7cd-e3894c939874-kube-api-access-8dv2w\") pod \"dns-default-57vtw\" (UID: \"c45651aa-fdb1-463b-a7cd-e3894c939874\") " pod="openshift-dns/dns-default-57vtw" May 21 14:55:06.735602 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.735548 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c45651aa-fdb1-463b-a7cd-e3894c939874-config-volume\") pod \"dns-default-57vtw\" (UID: \"c45651aa-fdb1-463b-a7cd-e3894c939874\") " pod="openshift-dns/dns-default-57vtw" May 21 14:55:06.836437 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.836355 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf248aa5-1086-4c30-919a-df06b4850374-cert\") pod \"ingress-canary-tpsq5\" (UID: \"cf248aa5-1086-4c30-919a-df06b4850374\") " pod="openshift-ingress-canary/ingress-canary-tpsq5" May 21 14:55:06.836437 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.836410 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c45651aa-fdb1-463b-a7cd-e3894c939874-metrics-tls\") pod \"dns-default-57vtw\" (UID: \"c45651aa-fdb1-463b-a7cd-e3894c939874\") " pod="openshift-dns/dns-default-57vtw" May 21 14:55:06.836437 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.836434 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gpsjg\" (UniqueName: \"kubernetes.io/projected/cf248aa5-1086-4c30-919a-df06b4850374-kube-api-access-gpsjg\") pod \"ingress-canary-tpsq5\" (UID: \"cf248aa5-1086-4c30-919a-df06b4850374\") " pod="openshift-ingress-canary/ingress-canary-tpsq5" May 21 14:55:06.836719 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.836451 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8dv2w\" (UniqueName: \"kubernetes.io/projected/c45651aa-fdb1-463b-a7cd-e3894c939874-kube-api-access-8dv2w\") pod \"dns-default-57vtw\" (UID: \"c45651aa-fdb1-463b-a7cd-e3894c939874\") " pod="openshift-dns/dns-default-57vtw" May 21 14:55:06.836719 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.836478 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c45651aa-fdb1-463b-a7cd-e3894c939874-config-volume\") pod \"dns-default-57vtw\" (UID: \"c45651aa-fdb1-463b-a7cd-e3894c939874\") " pod="openshift-dns/dns-default-57vtw" May 21 14:55:06.836719 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:06.836504 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:55:06.836719 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.836530 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c45651aa-fdb1-463b-a7cd-e3894c939874-tmp-dir\") pod \"dns-default-57vtw\" (UID: \"c45651aa-fdb1-463b-a7cd-e3894c939874\") " pod="openshift-dns/dns-default-57vtw" May 21 14:55:06.836719 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:06.836578 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf248aa5-1086-4c30-919a-df06b4850374-cert podName:cf248aa5-1086-4c30-919a-df06b4850374 nodeName:}" failed. No retries permitted until 2026-05-21 14:55:07.336557221 +0000 UTC m=+34.632433124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cf248aa5-1086-4c30-919a-df06b4850374-cert") pod "ingress-canary-tpsq5" (UID: "cf248aa5-1086-4c30-919a-df06b4850374") : secret "canary-serving-cert" not found May 21 14:55:06.836719 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:06.836577 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:55:06.836719 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:06.836615 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c45651aa-fdb1-463b-a7cd-e3894c939874-metrics-tls podName:c45651aa-fdb1-463b-a7cd-e3894c939874 nodeName:}" failed. No retries permitted until 2026-05-21 14:55:07.336606627 +0000 UTC m=+34.632482512 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c45651aa-fdb1-463b-a7cd-e3894c939874-metrics-tls") pod "dns-default-57vtw" (UID: "c45651aa-fdb1-463b-a7cd-e3894c939874") : secret "dns-default-metrics-tls" not found May 21 14:55:06.837096 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.836878 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c45651aa-fdb1-463b-a7cd-e3894c939874-tmp-dir\") pod \"dns-default-57vtw\" (UID: \"c45651aa-fdb1-463b-a7cd-e3894c939874\") " pod="openshift-dns/dns-default-57vtw" May 21 14:55:06.837243 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.837222 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c45651aa-fdb1-463b-a7cd-e3894c939874-config-volume\") pod \"dns-default-57vtw\" (UID: \"c45651aa-fdb1-463b-a7cd-e3894c939874\") " pod="openshift-dns/dns-default-57vtw" May 21 14:55:06.851897 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.851753 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpsjg\" (UniqueName: \"kubernetes.io/projected/cf248aa5-1086-4c30-919a-df06b4850374-kube-api-access-gpsjg\") pod \"ingress-canary-tpsq5\" (UID: \"cf248aa5-1086-4c30-919a-df06b4850374\") " pod="openshift-ingress-canary/ingress-canary-tpsq5" May 21 14:55:06.853514 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.853491 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dv2w\" (UniqueName: \"kubernetes.io/projected/c45651aa-fdb1-463b-a7cd-e3894c939874-kube-api-access-8dv2w\") pod \"dns-default-57vtw\" (UID: \"c45651aa-fdb1-463b-a7cd-e3894c939874\") " pod="openshift-dns/dns-default-57vtw" May 21 14:55:06.936904 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:06.936865 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a47bc04-1f5f-4dc4-824a-5fa35b392b73-metrics-certs\") pod \"network-metrics-daemon-qtgkj\" (UID: \"4a47bc04-1f5f-4dc4-824a-5fa35b392b73\") " pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:55:06.937123 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:06.937038 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:55:06.937123 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:06.937121 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a47bc04-1f5f-4dc4-824a-5fa35b392b73-metrics-certs podName:4a47bc04-1f5f-4dc4-824a-5fa35b392b73 nodeName:}" failed. No retries permitted until 2026-05-21 14:55:38.937099026 +0000 UTC m=+66.232974908 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a47bc04-1f5f-4dc4-824a-5fa35b392b73-metrics-certs") pod "network-metrics-daemon-qtgkj" (UID: "4a47bc04-1f5f-4dc4-824a-5fa35b392b73") : object "openshift-multus"/"metrics-daemon-secret" not registered May 21 14:55:07.037514 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:07.037476 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z64gd\" (UniqueName: \"kubernetes.io/projected/b3b95b77-0eda-4a70-8a69-8eac95eefb8e-kube-api-access-z64gd\") pod \"network-check-target-gdtjn\" (UID: \"b3b95b77-0eda-4a70-8a69-8eac95eefb8e\") " pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:55:07.037694 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:07.037655 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 21 14:55:07.037694 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:07.037680 2557 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 21 14:55:07.037694 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:07.037693 2557 projected.go:194] Error preparing data for projected volume kube-api-access-z64gd for pod openshift-network-diagnostics/network-check-target-gdtjn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:55:07.037836 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:07.037771 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b3b95b77-0eda-4a70-8a69-8eac95eefb8e-kube-api-access-z64gd podName:b3b95b77-0eda-4a70-8a69-8eac95eefb8e nodeName:}" failed. No retries permitted until 2026-05-21 14:55:39.037749552 +0000 UTC m=+66.333625433 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-z64gd" (UniqueName: "kubernetes.io/projected/b3b95b77-0eda-4a70-8a69-8eac95eefb8e-kube-api-access-z64gd") pod "network-check-target-gdtjn" (UID: "b3b95b77-0eda-4a70-8a69-8eac95eefb8e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 21 14:55:07.301725 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:07.301687 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:55:07.301928 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:07.301716 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:55:07.304636 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:07.304612 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 14:55:07.305686 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:07.305652 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zxl42\"" May 21 14:55:07.305830 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:07.305729 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 14:55:07.305830 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:07.305729 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 14:55:07.305830 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:07.305785 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lrll9\"" May 21 14:55:07.340176 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:07.340125 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf248aa5-1086-4c30-919a-df06b4850374-cert\") pod \"ingress-canary-tpsq5\" (UID: \"cf248aa5-1086-4c30-919a-df06b4850374\") " pod="openshift-ingress-canary/ingress-canary-tpsq5" May 21 14:55:07.340176 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:07.340183 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c45651aa-fdb1-463b-a7cd-e3894c939874-metrics-tls\") pod \"dns-default-57vtw\" (UID: \"c45651aa-fdb1-463b-a7cd-e3894c939874\") " pod="openshift-dns/dns-default-57vtw" May 21 14:55:07.340418 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:07.340305 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:55:07.340418 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:07.340389 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf248aa5-1086-4c30-919a-df06b4850374-cert podName:cf248aa5-1086-4c30-919a-df06b4850374 nodeName:}" failed. No retries permitted until 2026-05-21 14:55:08.340372156 +0000 UTC m=+35.636248034 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cf248aa5-1086-4c30-919a-df06b4850374-cert") pod "ingress-canary-tpsq5" (UID: "cf248aa5-1086-4c30-919a-df06b4850374") : secret "canary-serving-cert" not found May 21 14:55:07.340418 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:07.340308 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:55:07.340605 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:07.340446 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c45651aa-fdb1-463b-a7cd-e3894c939874-metrics-tls podName:c45651aa-fdb1-463b-a7cd-e3894c939874 nodeName:}" failed. No retries permitted until 2026-05-21 14:55:08.340430505 +0000 UTC m=+35.636306395 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c45651aa-fdb1-463b-a7cd-e3894c939874-metrics-tls") pod "dns-default-57vtw" (UID: "c45651aa-fdb1-463b-a7cd-e3894c939874") : secret "dns-default-metrics-tls" not found May 21 14:55:08.348202 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:08.348156 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c45651aa-fdb1-463b-a7cd-e3894c939874-metrics-tls\") pod \"dns-default-57vtw\" (UID: \"c45651aa-fdb1-463b-a7cd-e3894c939874\") " pod="openshift-dns/dns-default-57vtw" May 21 14:55:08.348667 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:08.348293 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf248aa5-1086-4c30-919a-df06b4850374-cert\") pod \"ingress-canary-tpsq5\" (UID: \"cf248aa5-1086-4c30-919a-df06b4850374\") " pod="openshift-ingress-canary/ingress-canary-tpsq5" May 21 14:55:08.348667 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:08.348314 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:55:08.348667 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:08.348373 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:55:08.348667 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:08.348387 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c45651aa-fdb1-463b-a7cd-e3894c939874-metrics-tls podName:c45651aa-fdb1-463b-a7cd-e3894c939874 nodeName:}" failed. No retries permitted until 2026-05-21 14:55:10.348366149 +0000 UTC m=+37.644242038 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c45651aa-fdb1-463b-a7cd-e3894c939874-metrics-tls") pod "dns-default-57vtw" (UID: "c45651aa-fdb1-463b-a7cd-e3894c939874") : secret "dns-default-metrics-tls" not found May 21 14:55:08.348667 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:08.348405 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf248aa5-1086-4c30-919a-df06b4850374-cert podName:cf248aa5-1086-4c30-919a-df06b4850374 nodeName:}" failed. No retries permitted until 2026-05-21 14:55:10.348394644 +0000 UTC m=+37.644270522 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cf248aa5-1086-4c30-919a-df06b4850374-cert") pod "ingress-canary-tpsq5" (UID: "cf248aa5-1086-4c30-919a-df06b4850374") : secret "canary-serving-cert" not found May 21 14:55:10.362900 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:10.362859 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf248aa5-1086-4c30-919a-df06b4850374-cert\") pod \"ingress-canary-tpsq5\" (UID: \"cf248aa5-1086-4c30-919a-df06b4850374\") " pod="openshift-ingress-canary/ingress-canary-tpsq5" May 21 14:55:10.363358 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:10.362926 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c45651aa-fdb1-463b-a7cd-e3894c939874-metrics-tls\") pod \"dns-default-57vtw\" (UID: \"c45651aa-fdb1-463b-a7cd-e3894c939874\") " pod="openshift-dns/dns-default-57vtw" May 21 14:55:10.363358 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:10.363056 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:55:10.363358 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:10.363071 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:55:10.363358 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:10.363136 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c45651aa-fdb1-463b-a7cd-e3894c939874-metrics-tls podName:c45651aa-fdb1-463b-a7cd-e3894c939874 nodeName:}" failed. No retries permitted until 2026-05-21 14:55:14.363119849 +0000 UTC m=+41.658995727 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c45651aa-fdb1-463b-a7cd-e3894c939874-metrics-tls") pod "dns-default-57vtw" (UID: "c45651aa-fdb1-463b-a7cd-e3894c939874") : secret "dns-default-metrics-tls" not found May 21 14:55:10.363358 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:10.363150 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf248aa5-1086-4c30-919a-df06b4850374-cert podName:cf248aa5-1086-4c30-919a-df06b4850374 nodeName:}" failed. No retries permitted until 2026-05-21 14:55:14.363143769 +0000 UTC m=+41.659019647 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cf248aa5-1086-4c30-919a-df06b4850374-cert") pod "ingress-canary-tpsq5" (UID: "cf248aa5-1086-4c30-919a-df06b4850374") : secret "canary-serving-cert" not found May 21 14:55:10.463585 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:10.463544 2557 generic.go:358] "Generic (PLEG): container finished" podID="460bd20d-6a98-47e3-9a2a-a1438b7cc63c" containerID="7f69e4ca0650a7f0f1842ace02beaa9b09735450fcbcde3b56589ff8cebd1d05" exitCode=0 May 21 14:55:10.463778 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:10.463600 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hsxn8" event={"ID":"460bd20d-6a98-47e3-9a2a-a1438b7cc63c","Type":"ContainerDied","Data":"7f69e4ca0650a7f0f1842ace02beaa9b09735450fcbcde3b56589ff8cebd1d05"} May 21 14:55:11.467880 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:11.467840 2557 generic.go:358] "Generic (PLEG): container finished" podID="460bd20d-6a98-47e3-9a2a-a1438b7cc63c" containerID="f33633f0fb7e1063a134b9466a010572e0790e8bf338f29f388916b6e1e9208a" exitCode=0 May 21 14:55:11.468286 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:11.467914 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hsxn8" event={"ID":"460bd20d-6a98-47e3-9a2a-a1438b7cc63c","Type":"ContainerDied","Data":"f33633f0fb7e1063a134b9466a010572e0790e8bf338f29f388916b6e1e9208a"} May 21 14:55:12.472825 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:12.472782 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hsxn8" event={"ID":"460bd20d-6a98-47e3-9a2a-a1438b7cc63c","Type":"ContainerStarted","Data":"064b7d62f355c936be300ee9edeb96be0e96620a80afc25e3d8071bdbc2a0819"} May 21 14:55:12.526928 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:12.526875 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hsxn8" podStartSLOduration=6.042615491 podStartE2EDuration="39.526860071s" podCreationTimestamp="2026-05-21 14:54:33 +0000 UTC" firstStartedPulling="2026-05-21 14:54:35.901037845 +0000 UTC m=+3.196913731" lastFinishedPulling="2026-05-21 14:55:09.385282433 +0000 UTC m=+36.681158311" observedRunningTime="2026-05-21 14:55:12.526494967 +0000 UTC m=+39.822370867" watchObservedRunningTime="2026-05-21 14:55:12.526860071 +0000 UTC m=+39.822736022" May 21 14:55:14.391040 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:14.390971 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf248aa5-1086-4c30-919a-df06b4850374-cert\") pod \"ingress-canary-tpsq5\" (UID: \"cf248aa5-1086-4c30-919a-df06b4850374\") " pod="openshift-ingress-canary/ingress-canary-tpsq5" May 21 14:55:14.391040 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:14.391046 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c45651aa-fdb1-463b-a7cd-e3894c939874-metrics-tls\") pod \"dns-default-57vtw\" (UID: \"c45651aa-fdb1-463b-a7cd-e3894c939874\") " pod="openshift-dns/dns-default-57vtw" May 21 14:55:14.391583 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:14.391123 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:55:14.391583 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:14.391180 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:55:14.391583 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:14.391192 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf248aa5-1086-4c30-919a-df06b4850374-cert podName:cf248aa5-1086-4c30-919a-df06b4850374 nodeName:}" failed. No retries permitted until 2026-05-21 14:55:22.391176026 +0000 UTC m=+49.687051905 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cf248aa5-1086-4c30-919a-df06b4850374-cert") pod "ingress-canary-tpsq5" (UID: "cf248aa5-1086-4c30-919a-df06b4850374") : secret "canary-serving-cert" not found May 21 14:55:14.391583 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:14.391232 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c45651aa-fdb1-463b-a7cd-e3894c939874-metrics-tls podName:c45651aa-fdb1-463b-a7cd-e3894c939874 nodeName:}" failed. No retries permitted until 2026-05-21 14:55:22.391217979 +0000 UTC m=+49.687093858 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c45651aa-fdb1-463b-a7cd-e3894c939874-metrics-tls") pod "dns-default-57vtw" (UID: "c45651aa-fdb1-463b-a7cd-e3894c939874") : secret "dns-default-metrics-tls" not found May 21 14:55:22.449036 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:22.448963 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf248aa5-1086-4c30-919a-df06b4850374-cert\") pod \"ingress-canary-tpsq5\" (UID: \"cf248aa5-1086-4c30-919a-df06b4850374\") " pod="openshift-ingress-canary/ingress-canary-tpsq5" May 21 14:55:22.449036 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:22.449046 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c45651aa-fdb1-463b-a7cd-e3894c939874-metrics-tls\") pod \"dns-default-57vtw\" (UID: \"c45651aa-fdb1-463b-a7cd-e3894c939874\") " pod="openshift-dns/dns-default-57vtw" May 21 14:55:22.449492 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:22.449118 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:55:22.449492 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:22.449174 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:55:22.449492 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:22.449190 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf248aa5-1086-4c30-919a-df06b4850374-cert podName:cf248aa5-1086-4c30-919a-df06b4850374 nodeName:}" failed. No retries permitted until 2026-05-21 14:55:38.449173834 +0000 UTC m=+65.745049713 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cf248aa5-1086-4c30-919a-df06b4850374-cert") pod "ingress-canary-tpsq5" (UID: "cf248aa5-1086-4c30-919a-df06b4850374") : secret "canary-serving-cert" not found May 21 14:55:22.449492 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:22.449225 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c45651aa-fdb1-463b-a7cd-e3894c939874-metrics-tls podName:c45651aa-fdb1-463b-a7cd-e3894c939874 nodeName:}" failed. No retries permitted until 2026-05-21 14:55:38.449211436 +0000 UTC m=+65.745087321 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c45651aa-fdb1-463b-a7cd-e3894c939874-metrics-tls") pod "dns-default-57vtw" (UID: "c45651aa-fdb1-463b-a7cd-e3894c939874") : secret "dns-default-metrics-tls" not found May 21 14:55:32.458245 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:32.458214 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2qjxf" May 21 14:55:38.467073 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:38.467036 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf248aa5-1086-4c30-919a-df06b4850374-cert\") pod \"ingress-canary-tpsq5\" (UID: \"cf248aa5-1086-4c30-919a-df06b4850374\") " pod="openshift-ingress-canary/ingress-canary-tpsq5" May 21 14:55:38.467073 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:38.467080 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c45651aa-fdb1-463b-a7cd-e3894c939874-metrics-tls\") pod \"dns-default-57vtw\" (UID: \"c45651aa-fdb1-463b-a7cd-e3894c939874\") " pod="openshift-dns/dns-default-57vtw" May 21 14:55:38.467512 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:38.467175 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:55:38.467512 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:38.467253 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf248aa5-1086-4c30-919a-df06b4850374-cert podName:cf248aa5-1086-4c30-919a-df06b4850374 nodeName:}" failed. No retries permitted until 2026-05-21 14:56:10.467236515 +0000 UTC m=+97.763112399 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cf248aa5-1086-4c30-919a-df06b4850374-cert") pod "ingress-canary-tpsq5" (UID: "cf248aa5-1086-4c30-919a-df06b4850374") : secret "canary-serving-cert" not found May 21 14:55:38.467512 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:38.467181 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:55:38.467512 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:38.467334 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c45651aa-fdb1-463b-a7cd-e3894c939874-metrics-tls podName:c45651aa-fdb1-463b-a7cd-e3894c939874 nodeName:}" failed. No retries permitted until 2026-05-21 14:56:10.467319741 +0000 UTC m=+97.763195623 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c45651aa-fdb1-463b-a7cd-e3894c939874-metrics-tls") pod "dns-default-57vtw" (UID: "c45651aa-fdb1-463b-a7cd-e3894c939874") : secret "dns-default-metrics-tls" not found May 21 14:55:38.969735 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:38.969706 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a47bc04-1f5f-4dc4-824a-5fa35b392b73-metrics-certs\") pod \"network-metrics-daemon-qtgkj\" (UID: \"4a47bc04-1f5f-4dc4-824a-5fa35b392b73\") " pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:55:38.972351 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:38.972326 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 21 14:55:38.980679 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:38.980659 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 21 14:55:38.980791 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:55:38.980737 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a47bc04-1f5f-4dc4-824a-5fa35b392b73-metrics-certs podName:4a47bc04-1f5f-4dc4-824a-5fa35b392b73 nodeName:}" failed. No retries permitted until 2026-05-21 14:56:42.980718726 +0000 UTC m=+130.276594609 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4a47bc04-1f5f-4dc4-824a-5fa35b392b73-metrics-certs") pod "network-metrics-daemon-qtgkj" (UID: "4a47bc04-1f5f-4dc4-824a-5fa35b392b73") : secret "metrics-daemon-secret" not found May 21 14:55:39.070406 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:39.070348 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z64gd\" (UniqueName: \"kubernetes.io/projected/b3b95b77-0eda-4a70-8a69-8eac95eefb8e-kube-api-access-z64gd\") pod \"network-check-target-gdtjn\" (UID: \"b3b95b77-0eda-4a70-8a69-8eac95eefb8e\") " pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:55:39.073079 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:39.073059 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 21 14:55:39.083543 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:39.083515 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 21 14:55:39.095066 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:39.095038 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z64gd\" (UniqueName: \"kubernetes.io/projected/b3b95b77-0eda-4a70-8a69-8eac95eefb8e-kube-api-access-z64gd\") pod \"network-check-target-gdtjn\" (UID: \"b3b95b77-0eda-4a70-8a69-8eac95eefb8e\") " pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:55:39.117184 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:39.117152 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lrll9\"" May 21 14:55:39.125457 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:39.125424 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:55:39.261143 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:39.261063 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gdtjn"] May 21 14:55:39.265605 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:55:39.265575 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3b95b77_0eda_4a70_8a69_8eac95eefb8e.slice/crio-1a7c9da8003e2ddea65be1bd7a666b12d351ce464e5add99004ec05e2fbb8969 WatchSource:0}: Error finding container 1a7c9da8003e2ddea65be1bd7a666b12d351ce464e5add99004ec05e2fbb8969: Status 404 returned error can't find the container with id 1a7c9da8003e2ddea65be1bd7a666b12d351ce464e5add99004ec05e2fbb8969 May 21 14:55:39.527108 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:39.527014 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gdtjn" event={"ID":"b3b95b77-0eda-4a70-8a69-8eac95eefb8e","Type":"ContainerStarted","Data":"1a7c9da8003e2ddea65be1bd7a666b12d351ce464e5add99004ec05e2fbb8969"} May 21 14:55:42.534323 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:42.534278 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gdtjn" event={"ID":"b3b95b77-0eda-4a70-8a69-8eac95eefb8e","Type":"ContainerStarted","Data":"254d67fb2eef1251a8e062865e5393ce58720791752b061c9a007bc262531862"} May 21 14:55:42.534782 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:42.534398 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:55:42.554148 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:55:42.554088 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gdtjn" podStartSLOduration=66.738494398 podStartE2EDuration="1m9.554068998s" podCreationTimestamp="2026-05-21 14:54:33 +0000 UTC" firstStartedPulling="2026-05-21 14:55:39.267476264 +0000 UTC m=+66.563352146" lastFinishedPulling="2026-05-21 14:55:42.083050863 +0000 UTC m=+69.378926746" observedRunningTime="2026-05-21 14:55:42.553899143 +0000 UTC m=+69.849775045" watchObservedRunningTime="2026-05-21 14:55:42.554068998 +0000 UTC m=+69.849944899" May 21 14:56:10.491633 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:10.491569 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf248aa5-1086-4c30-919a-df06b4850374-cert\") pod \"ingress-canary-tpsq5\" (UID: \"cf248aa5-1086-4c30-919a-df06b4850374\") " pod="openshift-ingress-canary/ingress-canary-tpsq5" May 21 14:56:10.491633 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:10.491632 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c45651aa-fdb1-463b-a7cd-e3894c939874-metrics-tls\") pod \"dns-default-57vtw\" (UID: \"c45651aa-fdb1-463b-a7cd-e3894c939874\") " pod="openshift-dns/dns-default-57vtw" May 21 14:56:10.492235 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:10.491691 2557 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 21 14:56:10.492235 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:10.491721 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 21 14:56:10.492235 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:10.491772 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf248aa5-1086-4c30-919a-df06b4850374-cert podName:cf248aa5-1086-4c30-919a-df06b4850374 nodeName:}" failed. No retries permitted until 2026-05-21 14:57:14.491755055 +0000 UTC m=+161.787630939 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cf248aa5-1086-4c30-919a-df06b4850374-cert") pod "ingress-canary-tpsq5" (UID: "cf248aa5-1086-4c30-919a-df06b4850374") : secret "canary-serving-cert" not found May 21 14:56:10.492235 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:10.491788 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c45651aa-fdb1-463b-a7cd-e3894c939874-metrics-tls podName:c45651aa-fdb1-463b-a7cd-e3894c939874 nodeName:}" failed. No retries permitted until 2026-05-21 14:57:14.491779904 +0000 UTC m=+161.787655783 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c45651aa-fdb1-463b-a7cd-e3894c939874-metrics-tls") pod "dns-default-57vtw" (UID: "c45651aa-fdb1-463b-a7cd-e3894c939874") : secret "dns-default-metrics-tls" not found May 21 14:56:13.470027 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.469989 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-lm77b"] May 21 14:56:13.471957 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.471933 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lm77b" May 21 14:56:13.475797 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.475776 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 21 14:56:13.477034 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.476839 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 21 14:56:13.477034 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.476868 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zbtzl\"" May 21 14:56:13.477034 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.476891 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 21 14:56:13.477034 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.476956 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 21 14:56:13.481121 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.481099 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-lm77b"] May 21 14:56:13.512395 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.512354 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/abea9f6a-e038-4f3e-acba-28ffcd808874-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-lm77b\" (UID: \"abea9f6a-e038-4f3e-acba-28ffcd808874\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lm77b" May 21 14:56:13.512395 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.512399 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hjx7\" (UniqueName: \"kubernetes.io/projected/abea9f6a-e038-4f3e-acba-28ffcd808874-kube-api-access-4hjx7\") pod \"cluster-monitoring-operator-6c75959455-lm77b\" (UID: \"abea9f6a-e038-4f3e-acba-28ffcd808874\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lm77b" May 21 14:56:13.512618 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.512494 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/abea9f6a-e038-4f3e-acba-28ffcd808874-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lm77b\" (UID: \"abea9f6a-e038-4f3e-acba-28ffcd808874\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lm77b" May 21 14:56:13.538276 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.538246 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gdtjn" May 21 14:56:13.588775 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.586006 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6b98c464fb-pxm7b"] May 21 14:56:13.589349 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.589323 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:13.591994 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.591956 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 21 14:56:13.592205 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.592005 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 21 14:56:13.592205 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.592049 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 21 14:56:13.592205 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.592011 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-fw697\"" May 21 14:56:13.592205 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.592050 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 21 14:56:13.592205 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.592005 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 21 14:56:13.592205 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.592054 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 21 14:56:13.598285 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.598263 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b98c464fb-pxm7b"] May 21 14:56:13.612952 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.612917 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/abea9f6a-e038-4f3e-acba-28ffcd808874-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-lm77b\" (UID: \"abea9f6a-e038-4f3e-acba-28ffcd808874\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lm77b" May 21 14:56:13.613138 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.612966 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4hjx7\" (UniqueName: \"kubernetes.io/projected/abea9f6a-e038-4f3e-acba-28ffcd808874-kube-api-access-4hjx7\") pod \"cluster-monitoring-operator-6c75959455-lm77b\" (UID: \"abea9f6a-e038-4f3e-acba-28ffcd808874\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lm77b" May 21 14:56:13.613138 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.613102 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/abea9f6a-e038-4f3e-acba-28ffcd808874-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lm77b\" (UID: \"abea9f6a-e038-4f3e-acba-28ffcd808874\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lm77b" May 21 14:56:13.613255 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:13.613206 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 14:56:13.613310 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:13.613282 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abea9f6a-e038-4f3e-acba-28ffcd808874-cluster-monitoring-operator-tls podName:abea9f6a-e038-4f3e-acba-28ffcd808874 nodeName:}" failed. No retries permitted until 2026-05-21 14:56:14.113261321 +0000 UTC m=+101.409137253 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/abea9f6a-e038-4f3e-acba-28ffcd808874-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-lm77b" (UID: "abea9f6a-e038-4f3e-acba-28ffcd808874") : secret "cluster-monitoring-operator-tls" not found May 21 14:56:13.613709 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.613684 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/abea9f6a-e038-4f3e-acba-28ffcd808874-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-lm77b\" (UID: \"abea9f6a-e038-4f3e-acba-28ffcd808874\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lm77b" May 21 14:56:13.621803 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.621764 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hjx7\" (UniqueName: \"kubernetes.io/projected/abea9f6a-e038-4f3e-acba-28ffcd808874-kube-api-access-4hjx7\") pod \"cluster-monitoring-operator-6c75959455-lm77b\" (UID: \"abea9f6a-e038-4f3e-acba-28ffcd808874\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lm77b" May 21 14:56:13.714002 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.713939 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-stats-auth\") pod \"router-default-6b98c464fb-pxm7b\" (UID: \"ba458fb2-e7b0-4b6b-9127-e936f8f26f96\") " pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:13.714170 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.714007 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkqsl\" (UniqueName: \"kubernetes.io/projected/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-kube-api-access-fkqsl\") pod \"router-default-6b98c464fb-pxm7b\" (UID: \"ba458fb2-e7b0-4b6b-9127-e936f8f26f96\") " pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:13.714170 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.714050 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-metrics-certs\") pod \"router-default-6b98c464fb-pxm7b\" (UID: \"ba458fb2-e7b0-4b6b-9127-e936f8f26f96\") " pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:13.714170 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.714069 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-service-ca-bundle\") pod \"router-default-6b98c464fb-pxm7b\" (UID: \"ba458fb2-e7b0-4b6b-9127-e936f8f26f96\") " pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:13.714170 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.714120 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-default-certificate\") pod \"router-default-6b98c464fb-pxm7b\" (UID: \"ba458fb2-e7b0-4b6b-9127-e936f8f26f96\") " pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:13.814447 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.814373 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-stats-auth\") pod \"router-default-6b98c464fb-pxm7b\" (UID: \"ba458fb2-e7b0-4b6b-9127-e936f8f26f96\") " pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:13.814447 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.814415 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fkqsl\" (UniqueName: \"kubernetes.io/projected/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-kube-api-access-fkqsl\") pod \"router-default-6b98c464fb-pxm7b\" (UID: \"ba458fb2-e7b0-4b6b-9127-e936f8f26f96\") " pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:13.814575 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.814555 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-metrics-certs\") pod \"router-default-6b98c464fb-pxm7b\" (UID: \"ba458fb2-e7b0-4b6b-9127-e936f8f26f96\") " pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:13.814613 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.814594 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-service-ca-bundle\") pod \"router-default-6b98c464fb-pxm7b\" (UID: \"ba458fb2-e7b0-4b6b-9127-e936f8f26f96\") " pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:13.814650 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.814636 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-default-certificate\") pod \"router-default-6b98c464fb-pxm7b\" (UID: \"ba458fb2-e7b0-4b6b-9127-e936f8f26f96\") " pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:13.814700 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:13.814682 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 14:56:13.814763 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:13.814744 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-service-ca-bundle podName:ba458fb2-e7b0-4b6b-9127-e936f8f26f96 nodeName:}" failed. No retries permitted until 2026-05-21 14:56:14.314727681 +0000 UTC m=+101.610603576 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-service-ca-bundle") pod "router-default-6b98c464fb-pxm7b" (UID: "ba458fb2-e7b0-4b6b-9127-e936f8f26f96") : configmap references non-existent config key: service-ca.crt May 21 14:56:13.814828 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:13.814773 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-metrics-certs podName:ba458fb2-e7b0-4b6b-9127-e936f8f26f96 nodeName:}" failed. No retries permitted until 2026-05-21 14:56:14.314765061 +0000 UTC m=+101.610640941 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-metrics-certs") pod "router-default-6b98c464fb-pxm7b" (UID: "ba458fb2-e7b0-4b6b-9127-e936f8f26f96") : secret "router-metrics-certs-default" not found May 21 14:56:13.816858 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.816825 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-stats-auth\") pod \"router-default-6b98c464fb-pxm7b\" (UID: \"ba458fb2-e7b0-4b6b-9127-e936f8f26f96\") " pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:13.817033 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.817018 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-default-certificate\") pod \"router-default-6b98c464fb-pxm7b\" (UID: \"ba458fb2-e7b0-4b6b-9127-e936f8f26f96\") " pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:13.822920 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:13.822896 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkqsl\" (UniqueName: \"kubernetes.io/projected/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-kube-api-access-fkqsl\") pod \"router-default-6b98c464fb-pxm7b\" (UID: \"ba458fb2-e7b0-4b6b-9127-e936f8f26f96\") " pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:14.117754 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:14.117655 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/abea9f6a-e038-4f3e-acba-28ffcd808874-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lm77b\" (UID: \"abea9f6a-e038-4f3e-acba-28ffcd808874\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lm77b" May 21 14:56:14.117950 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:14.117820 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 14:56:14.117950 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:14.117892 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abea9f6a-e038-4f3e-acba-28ffcd808874-cluster-monitoring-operator-tls podName:abea9f6a-e038-4f3e-acba-28ffcd808874 nodeName:}" failed. No retries permitted until 2026-05-21 14:56:15.117876434 +0000 UTC m=+102.413752313 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/abea9f6a-e038-4f3e-acba-28ffcd808874-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-lm77b" (UID: "abea9f6a-e038-4f3e-acba-28ffcd808874") : secret "cluster-monitoring-operator-tls" not found May 21 14:56:14.319265 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:14.319217 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-metrics-certs\") pod \"router-default-6b98c464fb-pxm7b\" (UID: \"ba458fb2-e7b0-4b6b-9127-e936f8f26f96\") " pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:14.319265 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:14.319269 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-service-ca-bundle\") pod \"router-default-6b98c464fb-pxm7b\" (UID: \"ba458fb2-e7b0-4b6b-9127-e936f8f26f96\") " pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:14.319443 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:14.319362 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 14:56:14.319443 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:14.319391 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-service-ca-bundle podName:ba458fb2-e7b0-4b6b-9127-e936f8f26f96 nodeName:}" failed. No retries permitted until 2026-05-21 14:56:15.319376935 +0000 UTC m=+102.615252813 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-service-ca-bundle") pod "router-default-6b98c464fb-pxm7b" (UID: "ba458fb2-e7b0-4b6b-9127-e936f8f26f96") : configmap references non-existent config key: service-ca.crt May 21 14:56:14.319443 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:14.319420 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-metrics-certs podName:ba458fb2-e7b0-4b6b-9127-e936f8f26f96 nodeName:}" failed. No retries permitted until 2026-05-21 14:56:15.319405844 +0000 UTC m=+102.615281727 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-metrics-certs") pod "router-default-6b98c464fb-pxm7b" (UID: "ba458fb2-e7b0-4b6b-9127-e936f8f26f96") : secret "router-metrics-certs-default" not found May 21 14:56:15.124124 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:15.124078 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/abea9f6a-e038-4f3e-acba-28ffcd808874-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lm77b\" (UID: \"abea9f6a-e038-4f3e-acba-28ffcd808874\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lm77b" May 21 14:56:15.124500 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:15.124236 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 14:56:15.124500 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:15.124310 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abea9f6a-e038-4f3e-acba-28ffcd808874-cluster-monitoring-operator-tls podName:abea9f6a-e038-4f3e-acba-28ffcd808874 nodeName:}" failed. No retries permitted until 2026-05-21 14:56:17.124291025 +0000 UTC m=+104.420166905 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/abea9f6a-e038-4f3e-acba-28ffcd808874-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-lm77b" (UID: "abea9f6a-e038-4f3e-acba-28ffcd808874") : secret "cluster-monitoring-operator-tls" not found May 21 14:56:15.325914 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:15.325874 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-metrics-certs\") pod \"router-default-6b98c464fb-pxm7b\" (UID: \"ba458fb2-e7b0-4b6b-9127-e936f8f26f96\") " pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:15.325914 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:15.325917 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-service-ca-bundle\") pod \"router-default-6b98c464fb-pxm7b\" (UID: \"ba458fb2-e7b0-4b6b-9127-e936f8f26f96\") " pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:15.326131 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:15.326040 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-service-ca-bundle podName:ba458fb2-e7b0-4b6b-9127-e936f8f26f96 nodeName:}" failed. No retries permitted until 2026-05-21 14:56:17.32602545 +0000 UTC m=+104.621901330 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-service-ca-bundle") pod "router-default-6b98c464fb-pxm7b" (UID: "ba458fb2-e7b0-4b6b-9127-e936f8f26f96") : configmap references non-existent config key: service-ca.crt May 21 14:56:15.326131 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:15.326038 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 14:56:15.326131 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:15.326067 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-metrics-certs podName:ba458fb2-e7b0-4b6b-9127-e936f8f26f96 nodeName:}" failed. No retries permitted until 2026-05-21 14:56:17.326061158 +0000 UTC m=+104.621937037 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-metrics-certs") pod "router-default-6b98c464fb-pxm7b" (UID: "ba458fb2-e7b0-4b6b-9127-e936f8f26f96") : secret "router-metrics-certs-default" not found May 21 14:56:15.443261 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:15.443232 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-x6m8s"] May 21 14:56:15.475526 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:15.475488 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-x6m8s"] May 21 14:56:15.475692 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:15.475610 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-x6m8s" May 21 14:56:15.479390 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:15.479363 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 21 14:56:15.479560 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:15.479406 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 21 14:56:15.479560 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:15.479475 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-nqn8r\"" May 21 14:56:15.527373 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:15.527337 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nh42\" (UniqueName: \"kubernetes.io/projected/7540dbe5-45d7-4c07-888b-14d5a25a5d23-kube-api-access-5nh42\") pod \"volume-data-source-validator-5cf8c89d64-x6m8s\" (UID: \"7540dbe5-45d7-4c07-888b-14d5a25a5d23\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-x6m8s" May 21 14:56:15.628523 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:15.628476 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5nh42\" (UniqueName: \"kubernetes.io/projected/7540dbe5-45d7-4c07-888b-14d5a25a5d23-kube-api-access-5nh42\") pod \"volume-data-source-validator-5cf8c89d64-x6m8s\" (UID: \"7540dbe5-45d7-4c07-888b-14d5a25a5d23\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-x6m8s" May 21 14:56:15.643439 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:15.643411 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nh42\" (UniqueName: \"kubernetes.io/projected/7540dbe5-45d7-4c07-888b-14d5a25a5d23-kube-api-access-5nh42\") pod \"volume-data-source-validator-5cf8c89d64-x6m8s\" (UID: \"7540dbe5-45d7-4c07-888b-14d5a25a5d23\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-x6m8s" May 21 14:56:15.783959 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:15.783870 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-x6m8s" May 21 14:56:15.931765 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:15.931729 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-x6m8s"] May 21 14:56:15.935779 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:56:15.935749 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7540dbe5_45d7_4c07_888b_14d5a25a5d23.slice/crio-d5fd6108caeaa4ee7a2524406e498a5056a3aa9c67bbba6a9475c64ff64b1917 WatchSource:0}: Error finding container d5fd6108caeaa4ee7a2524406e498a5056a3aa9c67bbba6a9475c64ff64b1917: Status 404 returned error can't find the container with id d5fd6108caeaa4ee7a2524406e498a5056a3aa9c67bbba6a9475c64ff64b1917 May 21 14:56:16.456660 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:16.456627 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-qfg49"] May 21 14:56:16.459217 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:16.459201 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-qfg49" May 21 14:56:16.463711 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:16.463684 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 21 14:56:16.463711 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:16.463708 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 21 14:56:16.463901 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:16.463835 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 21 14:56:16.465288 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:16.465264 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 21 14:56:16.465412 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:16.465266 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-qw5pd\"" May 21 14:56:16.471538 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:16.470193 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-qfg49"] May 21 14:56:16.471538 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:16.470328 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 21 14:56:16.538631 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:16.538589 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1ee545c-62b8-4223-8c79-c00a1a036620-trusted-ca\") pod \"console-operator-76dff48d59-qfg49\" (UID: \"c1ee545c-62b8-4223-8c79-c00a1a036620\") " pod="openshift-console-operator/console-operator-76dff48d59-qfg49" May 21 14:56:16.538829 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:16.538655 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c1ee545c-62b8-4223-8c79-c00a1a036620-serving-cert\") pod \"console-operator-76dff48d59-qfg49\" (UID: \"c1ee545c-62b8-4223-8c79-c00a1a036620\") " pod="openshift-console-operator/console-operator-76dff48d59-qfg49" May 21 14:56:16.538829 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:16.538782 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c1ee545c-62b8-4223-8c79-c00a1a036620-config\") pod \"console-operator-76dff48d59-qfg49\" (UID: \"c1ee545c-62b8-4223-8c79-c00a1a036620\") " pod="openshift-console-operator/console-operator-76dff48d59-qfg49" May 21 14:56:16.538941 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:16.538860 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bplm\" (UniqueName: \"kubernetes.io/projected/c1ee545c-62b8-4223-8c79-c00a1a036620-kube-api-access-2bplm\") pod \"console-operator-76dff48d59-qfg49\" (UID: \"c1ee545c-62b8-4223-8c79-c00a1a036620\") " pod="openshift-console-operator/console-operator-76dff48d59-qfg49" May 21 14:56:16.596570 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:16.596527 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-x6m8s" event={"ID":"7540dbe5-45d7-4c07-888b-14d5a25a5d23","Type":"ContainerStarted","Data":"d5fd6108caeaa4ee7a2524406e498a5056a3aa9c67bbba6a9475c64ff64b1917"} May 21 14:56:16.639693 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:16.639654 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c1ee545c-62b8-4223-8c79-c00a1a036620-serving-cert\") pod \"console-operator-76dff48d59-qfg49\" (UID: \"c1ee545c-62b8-4223-8c79-c00a1a036620\") " pod="openshift-console-operator/console-operator-76dff48d59-qfg49" May 21 14:56:16.639892 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:16.639712 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c1ee545c-62b8-4223-8c79-c00a1a036620-config\") pod \"console-operator-76dff48d59-qfg49\" (UID: \"c1ee545c-62b8-4223-8c79-c00a1a036620\") " pod="openshift-console-operator/console-operator-76dff48d59-qfg49" May 21 14:56:16.639892 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:16.639740 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2bplm\" (UniqueName: \"kubernetes.io/projected/c1ee545c-62b8-4223-8c79-c00a1a036620-kube-api-access-2bplm\") pod \"console-operator-76dff48d59-qfg49\" (UID: \"c1ee545c-62b8-4223-8c79-c00a1a036620\") " pod="openshift-console-operator/console-operator-76dff48d59-qfg49" May 21 14:56:16.640020 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:16.639965 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1ee545c-62b8-4223-8c79-c00a1a036620-trusted-ca\") pod \"console-operator-76dff48d59-qfg49\" (UID: \"c1ee545c-62b8-4223-8c79-c00a1a036620\") " pod="openshift-console-operator/console-operator-76dff48d59-qfg49" May 21 14:56:16.640478 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:16.640455 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c1ee545c-62b8-4223-8c79-c00a1a036620-config\") pod \"console-operator-76dff48d59-qfg49\" (UID: \"c1ee545c-62b8-4223-8c79-c00a1a036620\") " pod="openshift-console-operator/console-operator-76dff48d59-qfg49" May 21 14:56:16.640730 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:16.640710 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1ee545c-62b8-4223-8c79-c00a1a036620-trusted-ca\") pod \"console-operator-76dff48d59-qfg49\" (UID: \"c1ee545c-62b8-4223-8c79-c00a1a036620\") " pod="openshift-console-operator/console-operator-76dff48d59-qfg49" May 21 14:56:16.642175 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:16.642154 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c1ee545c-62b8-4223-8c79-c00a1a036620-serving-cert\") pod \"console-operator-76dff48d59-qfg49\" (UID: \"c1ee545c-62b8-4223-8c79-c00a1a036620\") " pod="openshift-console-operator/console-operator-76dff48d59-qfg49" May 21 14:56:16.648715 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:16.648692 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bplm\" (UniqueName: \"kubernetes.io/projected/c1ee545c-62b8-4223-8c79-c00a1a036620-kube-api-access-2bplm\") pod \"console-operator-76dff48d59-qfg49\" (UID: \"c1ee545c-62b8-4223-8c79-c00a1a036620\") " pod="openshift-console-operator/console-operator-76dff48d59-qfg49" May 21 14:56:16.769152 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:16.769055 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-qfg49" May 21 14:56:16.911741 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:16.911707 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-qfg49"] May 21 14:56:16.914808 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:56:16.914773 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1ee545c_62b8_4223_8c79_c00a1a036620.slice/crio-6b34685c2c9168873f747b72e30a4a692b5229ac88548068f860e1990218c270 WatchSource:0}: Error finding container 6b34685c2c9168873f747b72e30a4a692b5229ac88548068f860e1990218c270: Status 404 returned error can't find the container with id 6b34685c2c9168873f747b72e30a4a692b5229ac88548068f860e1990218c270 May 21 14:56:17.144324 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:17.144226 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/abea9f6a-e038-4f3e-acba-28ffcd808874-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lm77b\" (UID: \"abea9f6a-e038-4f3e-acba-28ffcd808874\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lm77b" May 21 14:56:17.144501 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:17.144392 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 14:56:17.144501 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:17.144482 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abea9f6a-e038-4f3e-acba-28ffcd808874-cluster-monitoring-operator-tls podName:abea9f6a-e038-4f3e-acba-28ffcd808874 nodeName:}" failed. No retries permitted until 2026-05-21 14:56:21.144461197 +0000 UTC m=+108.440337075 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/abea9f6a-e038-4f3e-acba-28ffcd808874-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-lm77b" (UID: "abea9f6a-e038-4f3e-acba-28ffcd808874") : secret "cluster-monitoring-operator-tls" not found May 21 14:56:17.346670 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:17.346631 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-metrics-certs\") pod \"router-default-6b98c464fb-pxm7b\" (UID: \"ba458fb2-e7b0-4b6b-9127-e936f8f26f96\") " pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:17.346841 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:17.346699 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-service-ca-bundle\") pod \"router-default-6b98c464fb-pxm7b\" (UID: \"ba458fb2-e7b0-4b6b-9127-e936f8f26f96\") " pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:17.346841 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:17.346777 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 14:56:17.346910 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:17.346844 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-metrics-certs podName:ba458fb2-e7b0-4b6b-9127-e936f8f26f96 nodeName:}" failed. No retries permitted until 2026-05-21 14:56:21.346829115 +0000 UTC m=+108.642704995 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-metrics-certs") pod "router-default-6b98c464fb-pxm7b" (UID: "ba458fb2-e7b0-4b6b-9127-e936f8f26f96") : secret "router-metrics-certs-default" not found May 21 14:56:17.346910 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:17.346858 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-service-ca-bundle podName:ba458fb2-e7b0-4b6b-9127-e936f8f26f96 nodeName:}" failed. No retries permitted until 2026-05-21 14:56:21.346851661 +0000 UTC m=+108.642727541 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-service-ca-bundle") pod "router-default-6b98c464fb-pxm7b" (UID: "ba458fb2-e7b0-4b6b-9127-e936f8f26f96") : configmap references non-existent config key: service-ca.crt May 21 14:56:17.599867 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:17.599829 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-x6m8s" event={"ID":"7540dbe5-45d7-4c07-888b-14d5a25a5d23","Type":"ContainerStarted","Data":"b4dbfcdc1a8fc2a59432776cf9f859767618180f369d6906ee37c519fb92ca9b"} May 21 14:56:17.600872 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:17.600850 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-qfg49" event={"ID":"c1ee545c-62b8-4223-8c79-c00a1a036620","Type":"ContainerStarted","Data":"6b34685c2c9168873f747b72e30a4a692b5229ac88548068f860e1990218c270"} May 21 14:56:17.615033 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:17.614965 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-x6m8s" podStartSLOduration=1.300586987 podStartE2EDuration="2.614952643s" podCreationTimestamp="2026-05-21 14:56:15 +0000 UTC" firstStartedPulling="2026-05-21 14:56:15.937721486 +0000 UTC m=+103.233597369" lastFinishedPulling="2026-05-21 14:56:17.252087146 +0000 UTC m=+104.547963025" observedRunningTime="2026-05-21 14:56:17.614623359 +0000 UTC m=+104.910499273" watchObservedRunningTime="2026-05-21 14:56:17.614952643 +0000 UTC m=+104.910828544" May 21 14:56:19.457431 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:19.457404 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5tqsh_575ad37b-aef2-41aa-8c72-53f7a515aa96/dns-node-resolver/0.log" May 21 14:56:19.605849 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:19.605822 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qfg49_c1ee545c-62b8-4223-8c79-c00a1a036620/console-operator/0.log" May 21 14:56:19.606008 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:19.605862 2557 generic.go:358] "Generic (PLEG): container finished" podID="c1ee545c-62b8-4223-8c79-c00a1a036620" containerID="ee01c60e8a9586cbe047be63d1567860c811210b42243aa756595c9aa7fc5bf1" exitCode=255 May 21 14:56:19.606008 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:19.605896 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-qfg49" event={"ID":"c1ee545c-62b8-4223-8c79-c00a1a036620","Type":"ContainerDied","Data":"ee01c60e8a9586cbe047be63d1567860c811210b42243aa756595c9aa7fc5bf1"} May 21 14:56:19.606178 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:19.606164 2557 scope.go:117] "RemoveContainer" containerID="ee01c60e8a9586cbe047be63d1567860c811210b42243aa756595c9aa7fc5bf1" May 21 14:56:20.461724 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:20.461698 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w4lgs_a6293d82-33a8-4156-998f-c0ed8232df8c/node-ca/0.log" May 21 14:56:20.609357 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:20.609332 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qfg49_c1ee545c-62b8-4223-8c79-c00a1a036620/console-operator/1.log" May 21 14:56:20.609714 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:20.609698 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qfg49_c1ee545c-62b8-4223-8c79-c00a1a036620/console-operator/0.log" May 21 14:56:20.609765 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:20.609734 2557 generic.go:358] "Generic (PLEG): container finished" podID="c1ee545c-62b8-4223-8c79-c00a1a036620" containerID="5cd0606a002f5fb43298c539aa9494936d499363e364271f7b8d91dfeaa2b93b" exitCode=255 May 21 14:56:20.609818 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:20.609804 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-qfg49" event={"ID":"c1ee545c-62b8-4223-8c79-c00a1a036620","Type":"ContainerDied","Data":"5cd0606a002f5fb43298c539aa9494936d499363e364271f7b8d91dfeaa2b93b"} May 21 14:56:20.609858 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:20.609837 2557 scope.go:117] "RemoveContainer" containerID="ee01c60e8a9586cbe047be63d1567860c811210b42243aa756595c9aa7fc5bf1" May 21 14:56:20.610507 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:20.610483 2557 scope.go:117] "RemoveContainer" containerID="5cd0606a002f5fb43298c539aa9494936d499363e364271f7b8d91dfeaa2b93b" May 21 14:56:20.610850 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:20.610828 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-qfg49_openshift-console-operator(c1ee545c-62b8-4223-8c79-c00a1a036620)\"" pod="openshift-console-operator/console-operator-76dff48d59-qfg49" podUID="c1ee545c-62b8-4223-8c79-c00a1a036620" May 21 14:56:21.178935 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:21.178880 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/abea9f6a-e038-4f3e-acba-28ffcd808874-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lm77b\" (UID: \"abea9f6a-e038-4f3e-acba-28ffcd808874\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lm77b" May 21 14:56:21.179156 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:21.179048 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 14:56:21.179156 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:21.179119 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abea9f6a-e038-4f3e-acba-28ffcd808874-cluster-monitoring-operator-tls podName:abea9f6a-e038-4f3e-acba-28ffcd808874 nodeName:}" failed. No retries permitted until 2026-05-21 14:56:29.179102028 +0000 UTC m=+116.474977906 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/abea9f6a-e038-4f3e-acba-28ffcd808874-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-lm77b" (UID: "abea9f6a-e038-4f3e-acba-28ffcd808874") : secret "cluster-monitoring-operator-tls" not found May 21 14:56:21.381504 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:21.381459 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-metrics-certs\") pod \"router-default-6b98c464fb-pxm7b\" (UID: \"ba458fb2-e7b0-4b6b-9127-e936f8f26f96\") " pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:21.381711 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:21.381526 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-service-ca-bundle\") pod \"router-default-6b98c464fb-pxm7b\" (UID: \"ba458fb2-e7b0-4b6b-9127-e936f8f26f96\") " pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:21.381711 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:21.381603 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 14:56:21.381711 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:21.381683 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-metrics-certs podName:ba458fb2-e7b0-4b6b-9127-e936f8f26f96 nodeName:}" failed. No retries permitted until 2026-05-21 14:56:29.381661849 +0000 UTC m=+116.677537730 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-metrics-certs") pod "router-default-6b98c464fb-pxm7b" (UID: "ba458fb2-e7b0-4b6b-9127-e936f8f26f96") : secret "router-metrics-certs-default" not found May 21 14:56:21.381889 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:21.381745 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-service-ca-bundle podName:ba458fb2-e7b0-4b6b-9127-e936f8f26f96 nodeName:}" failed. No retries permitted until 2026-05-21 14:56:29.381723148 +0000 UTC m=+116.677599041 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-service-ca-bundle") pod "router-default-6b98c464fb-pxm7b" (UID: "ba458fb2-e7b0-4b6b-9127-e936f8f26f96") : configmap references non-existent config key: service-ca.crt May 21 14:56:21.613343 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:21.613309 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qfg49_c1ee545c-62b8-4223-8c79-c00a1a036620/console-operator/1.log" May 21 14:56:21.613696 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:21.613686 2557 scope.go:117] "RemoveContainer" containerID="5cd0606a002f5fb43298c539aa9494936d499363e364271f7b8d91dfeaa2b93b" May 21 14:56:21.613879 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:21.613860 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-qfg49_openshift-console-operator(c1ee545c-62b8-4223-8c79-c00a1a036620)\"" pod="openshift-console-operator/console-operator-76dff48d59-qfg49" podUID="c1ee545c-62b8-4223-8c79-c00a1a036620" May 21 14:56:26.769567 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:26.769529 2557 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-qfg49" May 21 14:56:26.769567 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:26.769575 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-qfg49" May 21 14:56:26.770027 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:26.769932 2557 scope.go:117] "RemoveContainer" containerID="5cd0606a002f5fb43298c539aa9494936d499363e364271f7b8d91dfeaa2b93b" May 21 14:56:26.770125 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:26.770107 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-qfg49_openshift-console-operator(c1ee545c-62b8-4223-8c79-c00a1a036620)\"" pod="openshift-console-operator/console-operator-76dff48d59-qfg49" podUID="c1ee545c-62b8-4223-8c79-c00a1a036620" May 21 14:56:29.249036 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:29.248955 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/abea9f6a-e038-4f3e-acba-28ffcd808874-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lm77b\" (UID: \"abea9f6a-e038-4f3e-acba-28ffcd808874\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lm77b" May 21 14:56:29.249438 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:29.249112 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 21 14:56:29.249438 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:29.249183 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abea9f6a-e038-4f3e-acba-28ffcd808874-cluster-monitoring-operator-tls podName:abea9f6a-e038-4f3e-acba-28ffcd808874 nodeName:}" failed. No retries permitted until 2026-05-21 14:56:45.249167673 +0000 UTC m=+132.545043552 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/abea9f6a-e038-4f3e-acba-28ffcd808874-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-lm77b" (UID: "abea9f6a-e038-4f3e-acba-28ffcd808874") : secret "cluster-monitoring-operator-tls" not found May 21 14:56:29.450126 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:29.450093 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-metrics-certs\") pod \"router-default-6b98c464fb-pxm7b\" (UID: \"ba458fb2-e7b0-4b6b-9127-e936f8f26f96\") " pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:29.450307 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:29.450140 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-service-ca-bundle\") pod \"router-default-6b98c464fb-pxm7b\" (UID: \"ba458fb2-e7b0-4b6b-9127-e936f8f26f96\") " pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:29.450307 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:29.450228 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 21 14:56:29.450307 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:29.450300 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-metrics-certs podName:ba458fb2-e7b0-4b6b-9127-e936f8f26f96 nodeName:}" failed. No retries permitted until 2026-05-21 14:56:45.450285192 +0000 UTC m=+132.746161071 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-metrics-certs") pod "router-default-6b98c464fb-pxm7b" (UID: "ba458fb2-e7b0-4b6b-9127-e936f8f26f96") : secret "router-metrics-certs-default" not found May 21 14:56:29.450426 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:29.450314 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-service-ca-bundle podName:ba458fb2-e7b0-4b6b-9127-e936f8f26f96 nodeName:}" failed. No retries permitted until 2026-05-21 14:56:45.450308466 +0000 UTC m=+132.746184345 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-service-ca-bundle") pod "router-default-6b98c464fb-pxm7b" (UID: "ba458fb2-e7b0-4b6b-9127-e936f8f26f96") : configmap references non-existent config key: service-ca.crt May 21 14:56:40.302574 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:40.302536 2557 scope.go:117] "RemoveContainer" containerID="5cd0606a002f5fb43298c539aa9494936d499363e364271f7b8d91dfeaa2b93b" May 21 14:56:40.650307 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:40.650227 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qfg49_c1ee545c-62b8-4223-8c79-c00a1a036620/console-operator/2.log" May 21 14:56:40.650641 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:40.650622 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qfg49_c1ee545c-62b8-4223-8c79-c00a1a036620/console-operator/1.log" May 21 14:56:40.650738 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:40.650663 2557 generic.go:358] "Generic (PLEG): container finished" podID="c1ee545c-62b8-4223-8c79-c00a1a036620" containerID="39e6ecc5678b7e84240b87e384b94fd6e263183fe060d35a09f3b97b70aeeedd" exitCode=255 May 21 14:56:40.650794 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:40.650731 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-qfg49" event={"ID":"c1ee545c-62b8-4223-8c79-c00a1a036620","Type":"ContainerDied","Data":"39e6ecc5678b7e84240b87e384b94fd6e263183fe060d35a09f3b97b70aeeedd"} May 21 14:56:40.650794 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:40.650774 2557 scope.go:117] "RemoveContainer" containerID="5cd0606a002f5fb43298c539aa9494936d499363e364271f7b8d91dfeaa2b93b" May 21 14:56:40.651129 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:40.651108 2557 scope.go:117] "RemoveContainer" containerID="39e6ecc5678b7e84240b87e384b94fd6e263183fe060d35a09f3b97b70aeeedd" May 21 14:56:40.651337 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:40.651318 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-qfg49_openshift-console-operator(c1ee545c-62b8-4223-8c79-c00a1a036620)\"" pod="openshift-console-operator/console-operator-76dff48d59-qfg49" podUID="c1ee545c-62b8-4223-8c79-c00a1a036620" May 21 14:56:41.654072 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:41.654044 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qfg49_c1ee545c-62b8-4223-8c79-c00a1a036620/console-operator/2.log" May 21 14:56:43.053900 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:43.053862 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a47bc04-1f5f-4dc4-824a-5fa35b392b73-metrics-certs\") pod \"network-metrics-daemon-qtgkj\" (UID: \"4a47bc04-1f5f-4dc4-824a-5fa35b392b73\") " pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:56:43.056192 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:43.056156 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4a47bc04-1f5f-4dc4-824a-5fa35b392b73-metrics-certs\") pod \"network-metrics-daemon-qtgkj\" (UID: \"4a47bc04-1f5f-4dc4-824a-5fa35b392b73\") " pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:56:43.322515 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:43.322432 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zxl42\"" May 21 14:56:43.330790 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:43.330765 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qtgkj" May 21 14:56:43.461146 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:43.461105 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qtgkj"] May 21 14:56:43.463835 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:56:43.463797 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a47bc04_1f5f_4dc4_824a_5fa35b392b73.slice/crio-4e91608985f487c1ef65cd79504e70d9bf7fadd4c4ec2347b26df15d90987bdd WatchSource:0}: Error finding container 4e91608985f487c1ef65cd79504e70d9bf7fadd4c4ec2347b26df15d90987bdd: Status 404 returned error can't find the container with id 4e91608985f487c1ef65cd79504e70d9bf7fadd4c4ec2347b26df15d90987bdd May 21 14:56:43.658959 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:43.658870 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qtgkj" event={"ID":"4a47bc04-1f5f-4dc4-824a-5fa35b392b73","Type":"ContainerStarted","Data":"4e91608985f487c1ef65cd79504e70d9bf7fadd4c4ec2347b26df15d90987bdd"} May 21 14:56:44.662303 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:44.662265 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qtgkj" event={"ID":"4a47bc04-1f5f-4dc4-824a-5fa35b392b73","Type":"ContainerStarted","Data":"b533f38f5568a411a35b72fc8cabc46e1f1f00f051158455c3b53f9d890de46d"} May 21 14:56:45.270410 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:45.270371 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/abea9f6a-e038-4f3e-acba-28ffcd808874-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lm77b\" (UID: \"abea9f6a-e038-4f3e-acba-28ffcd808874\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lm77b" May 21 14:56:45.272997 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:45.272948 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/abea9f6a-e038-4f3e-acba-28ffcd808874-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lm77b\" (UID: \"abea9f6a-e038-4f3e-acba-28ffcd808874\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lm77b" May 21 14:56:45.283231 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:45.283203 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zbtzl\"" May 21 14:56:45.291409 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:45.291386 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lm77b" May 21 14:56:45.418145 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:45.418112 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-lm77b"] May 21 14:56:45.421600 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:56:45.421084 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabea9f6a_e038_4f3e_acba_28ffcd808874.slice/crio-b857060f209b239fbb0636050bb829754224ec469fef84d831b8b456303e97e9 WatchSource:0}: Error finding container b857060f209b239fbb0636050bb829754224ec469fef84d831b8b456303e97e9: Status 404 returned error can't find the container with id b857060f209b239fbb0636050bb829754224ec469fef84d831b8b456303e97e9 May 21 14:56:45.471818 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:45.471768 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-metrics-certs\") pod \"router-default-6b98c464fb-pxm7b\" (UID: \"ba458fb2-e7b0-4b6b-9127-e936f8f26f96\") " pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:45.471818 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:45.471819 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-service-ca-bundle\") pod \"router-default-6b98c464fb-pxm7b\" (UID: \"ba458fb2-e7b0-4b6b-9127-e936f8f26f96\") " pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:45.472448 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:45.472422 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-service-ca-bundle\") pod \"router-default-6b98c464fb-pxm7b\" (UID: \"ba458fb2-e7b0-4b6b-9127-e936f8f26f96\") " pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:45.474164 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:45.474144 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba458fb2-e7b0-4b6b-9127-e936f8f26f96-metrics-certs\") pod \"router-default-6b98c464fb-pxm7b\" (UID: \"ba458fb2-e7b0-4b6b-9127-e936f8f26f96\") " pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:45.666242 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:45.666137 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qtgkj" event={"ID":"4a47bc04-1f5f-4dc4-824a-5fa35b392b73","Type":"ContainerStarted","Data":"1d9f3f473e6d6a44d5ae67f847c0827e824f333245327d8db5379ec19f1dac23"} May 21 14:56:45.667128 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:45.667106 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lm77b" event={"ID":"abea9f6a-e038-4f3e-acba-28ffcd808874","Type":"ContainerStarted","Data":"b857060f209b239fbb0636050bb829754224ec469fef84d831b8b456303e97e9"} May 21 14:56:45.681530 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:45.681465 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qtgkj" podStartSLOduration=131.631104857 podStartE2EDuration="2m12.681451989s" podCreationTimestamp="2026-05-21 14:54:33 +0000 UTC" firstStartedPulling="2026-05-21 14:56:43.465752861 +0000 UTC m=+130.761628756" lastFinishedPulling="2026-05-21 14:56:44.516100005 +0000 UTC m=+131.811975888" observedRunningTime="2026-05-21 14:56:45.680868215 +0000 UTC m=+132.976744115" watchObservedRunningTime="2026-05-21 14:56:45.681451989 +0000 UTC m=+132.977327902" May 21 14:56:45.700823 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:45.700797 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-fw697\"" May 21 14:56:45.708868 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:45.708846 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:45.834077 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:45.834032 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b98c464fb-pxm7b"] May 21 14:56:45.837859 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:56:45.837820 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba458fb2_e7b0_4b6b_9127_e936f8f26f96.slice/crio-a7aa9fccb0af0153de4b1af48f20335cee5bc009d8397af7f1d178dfb98cf69f WatchSource:0}: Error finding container a7aa9fccb0af0153de4b1af48f20335cee5bc009d8397af7f1d178dfb98cf69f: Status 404 returned error can't find the container with id a7aa9fccb0af0153de4b1af48f20335cee5bc009d8397af7f1d178dfb98cf69f May 21 14:56:46.670996 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:46.670946 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b98c464fb-pxm7b" event={"ID":"ba458fb2-e7b0-4b6b-9127-e936f8f26f96","Type":"ContainerStarted","Data":"72ede123761fcf3d79cad8817944e4ed75e32eabbe2c520ab523c77180ddd767"} May 21 14:56:46.671373 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:46.671008 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b98c464fb-pxm7b" event={"ID":"ba458fb2-e7b0-4b6b-9127-e936f8f26f96","Type":"ContainerStarted","Data":"a7aa9fccb0af0153de4b1af48f20335cee5bc009d8397af7f1d178dfb98cf69f"} May 21 14:56:46.692939 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:46.692888 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-6b98c464fb-pxm7b" podStartSLOduration=33.692870622 podStartE2EDuration="33.692870622s" podCreationTimestamp="2026-05-21 14:56:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 14:56:46.691638982 +0000 UTC m=+133.987515069" watchObservedRunningTime="2026-05-21 14:56:46.692870622 +0000 UTC m=+133.988746522" May 21 14:56:46.709786 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:46.709753 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:46.712774 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:46.712751 2557 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:46.769957 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:46.769918 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-qfg49" May 21 14:56:46.769957 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:46.769965 2557 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-qfg49" May 21 14:56:46.770344 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:46.770331 2557 scope.go:117] "RemoveContainer" containerID="39e6ecc5678b7e84240b87e384b94fd6e263183fe060d35a09f3b97b70aeeedd" May 21 14:56:46.770525 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:46.770509 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-qfg49_openshift-console-operator(c1ee545c-62b8-4223-8c79-c00a1a036620)\"" pod="openshift-console-operator/console-operator-76dff48d59-qfg49" podUID="c1ee545c-62b8-4223-8c79-c00a1a036620" May 21 14:56:47.675608 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:47.675484 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lm77b" event={"ID":"abea9f6a-e038-4f3e-acba-28ffcd808874","Type":"ContainerStarted","Data":"0af00882e185ec83a76bd99a4e2bc47dc5b48eb56d76227af37e3a82e767d51a"} May 21 14:56:47.676204 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:47.676175 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:47.677500 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:47.677469 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6b98c464fb-pxm7b" May 21 14:56:47.698907 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:47.698851 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lm77b" podStartSLOduration=32.876563655 podStartE2EDuration="34.698834504s" podCreationTimestamp="2026-05-21 14:56:13 +0000 UTC" firstStartedPulling="2026-05-21 14:56:45.422933127 +0000 UTC m=+132.718809008" lastFinishedPulling="2026-05-21 14:56:47.245203975 +0000 UTC m=+134.541079857" observedRunningTime="2026-05-21 14:56:47.697045403 +0000 UTC m=+134.992921305" watchObservedRunningTime="2026-05-21 14:56:47.698834504 +0000 UTC m=+134.994710405" May 21 14:56:51.087425 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.087388 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2xmdh"] May 21 14:56:51.090697 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.090671 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2xmdh" May 21 14:56:51.095930 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.095900 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 21 14:56:51.096084 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.095912 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 21 14:56:51.097274 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.097053 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 21 14:56:51.097274 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.097066 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w4hfq\"" May 21 14:56:51.097274 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.097238 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 21 14:56:51.108263 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.108226 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2xmdh"] May 21 14:56:51.113103 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.113079 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ceebc474-22a2-4fe2-8a53-05e42c8b77a5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2xmdh\" (UID: \"ceebc474-22a2-4fe2-8a53-05e42c8b77a5\") " pod="openshift-insights/insights-runtime-extractor-2xmdh" May 21 14:56:51.113237 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.113107 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ceebc474-22a2-4fe2-8a53-05e42c8b77a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2xmdh\" (UID: \"ceebc474-22a2-4fe2-8a53-05e42c8b77a5\") " pod="openshift-insights/insights-runtime-extractor-2xmdh" May 21 14:56:51.113237 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.113130 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ceebc474-22a2-4fe2-8a53-05e42c8b77a5-crio-socket\") pod \"insights-runtime-extractor-2xmdh\" (UID: \"ceebc474-22a2-4fe2-8a53-05e42c8b77a5\") " pod="openshift-insights/insights-runtime-extractor-2xmdh" May 21 14:56:51.113237 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.113208 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkcqb\" (UniqueName: \"kubernetes.io/projected/ceebc474-22a2-4fe2-8a53-05e42c8b77a5-kube-api-access-vkcqb\") pod \"insights-runtime-extractor-2xmdh\" (UID: \"ceebc474-22a2-4fe2-8a53-05e42c8b77a5\") " pod="openshift-insights/insights-runtime-extractor-2xmdh" May 21 14:56:51.113359 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.113241 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ceebc474-22a2-4fe2-8a53-05e42c8b77a5-data-volume\") pod \"insights-runtime-extractor-2xmdh\" (UID: \"ceebc474-22a2-4fe2-8a53-05e42c8b77a5\") " pod="openshift-insights/insights-runtime-extractor-2xmdh" May 21 14:56:51.187788 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.187747 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-drv2v"] May 21 14:56:51.190570 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.190554 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-drv2v" May 21 14:56:51.193282 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.193252 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-bd4kc\"" May 21 14:56:51.193424 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.193334 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" May 21 14:56:51.199966 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.199943 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-drv2v"] May 21 14:56:51.214052 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.214026 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vkcqb\" (UniqueName: \"kubernetes.io/projected/ceebc474-22a2-4fe2-8a53-05e42c8b77a5-kube-api-access-vkcqb\") pod \"insights-runtime-extractor-2xmdh\" (UID: \"ceebc474-22a2-4fe2-8a53-05e42c8b77a5\") " pod="openshift-insights/insights-runtime-extractor-2xmdh" May 21 14:56:51.214210 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.214074 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ceebc474-22a2-4fe2-8a53-05e42c8b77a5-data-volume\") pod \"insights-runtime-extractor-2xmdh\" (UID: \"ceebc474-22a2-4fe2-8a53-05e42c8b77a5\") " pod="openshift-insights/insights-runtime-extractor-2xmdh" May 21 14:56:51.214210 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.214114 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a9963900-501f-402a-af30-87253063a7ea-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-drv2v\" (UID: \"a9963900-501f-402a-af30-87253063a7ea\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-drv2v" May 21 14:56:51.214210 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.214183 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ceebc474-22a2-4fe2-8a53-05e42c8b77a5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2xmdh\" (UID: \"ceebc474-22a2-4fe2-8a53-05e42c8b77a5\") " pod="openshift-insights/insights-runtime-extractor-2xmdh" May 21 14:56:51.214210 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.214206 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ceebc474-22a2-4fe2-8a53-05e42c8b77a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2xmdh\" (UID: \"ceebc474-22a2-4fe2-8a53-05e42c8b77a5\") " pod="openshift-insights/insights-runtime-extractor-2xmdh" May 21 14:56:51.214407 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.214234 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ceebc474-22a2-4fe2-8a53-05e42c8b77a5-crio-socket\") pod \"insights-runtime-extractor-2xmdh\" (UID: \"ceebc474-22a2-4fe2-8a53-05e42c8b77a5\") " pod="openshift-insights/insights-runtime-extractor-2xmdh" May 21 14:56:51.214407 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.214309 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ceebc474-22a2-4fe2-8a53-05e42c8b77a5-crio-socket\") pod \"insights-runtime-extractor-2xmdh\" (UID: \"ceebc474-22a2-4fe2-8a53-05e42c8b77a5\") " pod="openshift-insights/insights-runtime-extractor-2xmdh" May 21 14:56:51.214501 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.214435 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ceebc474-22a2-4fe2-8a53-05e42c8b77a5-data-volume\") pod \"insights-runtime-extractor-2xmdh\" (UID: \"ceebc474-22a2-4fe2-8a53-05e42c8b77a5\") " pod="openshift-insights/insights-runtime-extractor-2xmdh" May 21 14:56:51.214968 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.214890 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ceebc474-22a2-4fe2-8a53-05e42c8b77a5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2xmdh\" (UID: \"ceebc474-22a2-4fe2-8a53-05e42c8b77a5\") " pod="openshift-insights/insights-runtime-extractor-2xmdh" May 21 14:56:51.216724 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.216700 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ceebc474-22a2-4fe2-8a53-05e42c8b77a5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2xmdh\" (UID: \"ceebc474-22a2-4fe2-8a53-05e42c8b77a5\") " pod="openshift-insights/insights-runtime-extractor-2xmdh" May 21 14:56:51.233217 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.233183 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkcqb\" (UniqueName: \"kubernetes.io/projected/ceebc474-22a2-4fe2-8a53-05e42c8b77a5-kube-api-access-vkcqb\") pod \"insights-runtime-extractor-2xmdh\" (UID: \"ceebc474-22a2-4fe2-8a53-05e42c8b77a5\") " pod="openshift-insights/insights-runtime-extractor-2xmdh" May 21 14:56:51.314635 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.314548 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a9963900-501f-402a-af30-87253063a7ea-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-drv2v\" (UID: \"a9963900-501f-402a-af30-87253063a7ea\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-drv2v" May 21 14:56:51.317069 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.317042 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a9963900-501f-402a-af30-87253063a7ea-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-drv2v\" (UID: \"a9963900-501f-402a-af30-87253063a7ea\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-drv2v" May 21 14:56:51.400155 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.400117 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2xmdh" May 21 14:56:51.499553 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.499520 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-drv2v" May 21 14:56:51.527857 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.527819 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2xmdh"] May 21 14:56:51.530864 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:56:51.530836 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceebc474_22a2_4fe2_8a53_05e42c8b77a5.slice/crio-1ce4bfd8df4f50901ed2b53c8cd46d999e7476a8763c86210571a738ad37f421 WatchSource:0}: Error finding container 1ce4bfd8df4f50901ed2b53c8cd46d999e7476a8763c86210571a738ad37f421: Status 404 returned error can't find the container with id 1ce4bfd8df4f50901ed2b53c8cd46d999e7476a8763c86210571a738ad37f421 May 21 14:56:51.635757 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.635725 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-drv2v"] May 21 14:56:51.638632 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:56:51.638583 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9963900_501f_402a_af30_87253063a7ea.slice/crio-1c0d1b9f764b2dbb250805447c603e86490408412c19a04fd107a92dd9e73564 WatchSource:0}: Error finding container 1c0d1b9f764b2dbb250805447c603e86490408412c19a04fd107a92dd9e73564: Status 404 returned error can't find the container with id 1c0d1b9f764b2dbb250805447c603e86490408412c19a04fd107a92dd9e73564 May 21 14:56:51.690884 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.690844 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-drv2v" event={"ID":"a9963900-501f-402a-af30-87253063a7ea","Type":"ContainerStarted","Data":"1c0d1b9f764b2dbb250805447c603e86490408412c19a04fd107a92dd9e73564"} May 21 14:56:51.692038 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.692017 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2xmdh" event={"ID":"ceebc474-22a2-4fe2-8a53-05e42c8b77a5","Type":"ContainerStarted","Data":"d8f7c9c47719a7170ffbd0e7f0f2493cbea4439962a74fe5c3b1d0182205d3fa"} May 21 14:56:51.692160 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:51.692042 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2xmdh" event={"ID":"ceebc474-22a2-4fe2-8a53-05e42c8b77a5","Type":"ContainerStarted","Data":"1ce4bfd8df4f50901ed2b53c8cd46d999e7476a8763c86210571a738ad37f421"} May 21 14:56:52.697951 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:52.697902 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2xmdh" event={"ID":"ceebc474-22a2-4fe2-8a53-05e42c8b77a5","Type":"ContainerStarted","Data":"d5e0f5f042b99707343066b496f6f9230bddbfccb0b8bda0fef8c316a0463db3"} May 21 14:56:53.701771 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:53.701732 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-drv2v" event={"ID":"a9963900-501f-402a-af30-87253063a7ea","Type":"ContainerStarted","Data":"90cfbeab9b4d8903b94212fa8db36a2b5e44c3e47e786b070d0e10b712302513"} May 21 14:56:53.702260 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:53.701906 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-drv2v" May 21 14:56:53.703677 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:53.703654 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2xmdh" event={"ID":"ceebc474-22a2-4fe2-8a53-05e42c8b77a5","Type":"ContainerStarted","Data":"4ca5119bfac6ab36ed950555b0858ba23eafeafddcb809a56b610e36663ae730"} May 21 14:56:53.706941 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:53.706919 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-drv2v" May 21 14:56:53.718174 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:53.718112 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-drv2v" podStartSLOduration=1.325386184 podStartE2EDuration="2.718084023s" podCreationTimestamp="2026-05-21 14:56:51 +0000 UTC" firstStartedPulling="2026-05-21 14:56:51.642499861 +0000 UTC m=+138.938375742" lastFinishedPulling="2026-05-21 14:56:53.0351977 +0000 UTC m=+140.331073581" observedRunningTime="2026-05-21 14:56:53.717879995 +0000 UTC m=+141.013755896" watchObservedRunningTime="2026-05-21 14:56:53.718084023 +0000 UTC m=+141.013959924" May 21 14:56:53.734327 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:53.734267 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2xmdh" podStartSLOduration=0.706503984 podStartE2EDuration="2.734253142s" podCreationTimestamp="2026-05-21 14:56:51 +0000 UTC" firstStartedPulling="2026-05-21 14:56:51.59878779 +0000 UTC m=+138.894663669" lastFinishedPulling="2026-05-21 14:56:53.626536945 +0000 UTC m=+140.922412827" observedRunningTime="2026-05-21 14:56:53.734002323 +0000 UTC m=+141.029878225" watchObservedRunningTime="2026-05-21 14:56:53.734253142 +0000 UTC m=+141.030129044" May 21 14:56:54.799631 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:54.799592 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-74df5"] May 21 14:56:54.802733 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:54.802713 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-74df5" May 21 14:56:54.806428 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:54.806409 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" May 21 14:56:54.806428 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:54.806419 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-bgzxr\"" May 21 14:56:54.806653 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:54.806411 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" May 21 14:56:54.806653 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:54.806509 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 21 14:56:54.815498 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:54.815468 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-74df5"] May 21 14:56:54.836435 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:54.836400 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5949dbe3-9662-4c63-99aa-4a4935f0d84f-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-74df5\" (UID: \"5949dbe3-9662-4c63-99aa-4a4935f0d84f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-74df5" May 21 14:56:54.836589 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:54.836465 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5949dbe3-9662-4c63-99aa-4a4935f0d84f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-74df5\" (UID: \"5949dbe3-9662-4c63-99aa-4a4935f0d84f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-74df5" May 21 14:56:54.836589 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:54.836494 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9g82\" (UniqueName: \"kubernetes.io/projected/5949dbe3-9662-4c63-99aa-4a4935f0d84f-kube-api-access-f9g82\") pod \"prometheus-operator-7779bbdd78-74df5\" (UID: \"5949dbe3-9662-4c63-99aa-4a4935f0d84f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-74df5" May 21 14:56:54.836589 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:54.836537 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5949dbe3-9662-4c63-99aa-4a4935f0d84f-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-74df5\" (UID: \"5949dbe3-9662-4c63-99aa-4a4935f0d84f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-74df5" May 21 14:56:54.937654 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:54.937618 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f9g82\" (UniqueName: \"kubernetes.io/projected/5949dbe3-9662-4c63-99aa-4a4935f0d84f-kube-api-access-f9g82\") pod \"prometheus-operator-7779bbdd78-74df5\" (UID: \"5949dbe3-9662-4c63-99aa-4a4935f0d84f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-74df5" May 21 14:56:54.937834 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:54.937665 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5949dbe3-9662-4c63-99aa-4a4935f0d84f-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-74df5\" (UID: \"5949dbe3-9662-4c63-99aa-4a4935f0d84f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-74df5" May 21 14:56:54.937879 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:54.937850 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5949dbe3-9662-4c63-99aa-4a4935f0d84f-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-74df5\" (UID: \"5949dbe3-9662-4c63-99aa-4a4935f0d84f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-74df5" May 21 14:56:54.937965 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:54.937949 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5949dbe3-9662-4c63-99aa-4a4935f0d84f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-74df5\" (UID: \"5949dbe3-9662-4c63-99aa-4a4935f0d84f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-74df5" May 21 14:56:54.938474 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:54.938443 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5949dbe3-9662-4c63-99aa-4a4935f0d84f-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-74df5\" (UID: \"5949dbe3-9662-4c63-99aa-4a4935f0d84f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-74df5" May 21 14:56:54.940249 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:54.940225 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5949dbe3-9662-4c63-99aa-4a4935f0d84f-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-74df5\" (UID: \"5949dbe3-9662-4c63-99aa-4a4935f0d84f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-74df5" May 21 14:56:54.940474 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:54.940443 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5949dbe3-9662-4c63-99aa-4a4935f0d84f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-74df5\" (UID: \"5949dbe3-9662-4c63-99aa-4a4935f0d84f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-74df5" May 21 14:56:54.947073 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:54.947045 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9g82\" (UniqueName: \"kubernetes.io/projected/5949dbe3-9662-4c63-99aa-4a4935f0d84f-kube-api-access-f9g82\") pod \"prometheus-operator-7779bbdd78-74df5\" (UID: \"5949dbe3-9662-4c63-99aa-4a4935f0d84f\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-74df5" May 21 14:56:55.111425 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:55.111323 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-74df5" May 21 14:56:55.253118 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:55.253081 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-74df5"] May 21 14:56:55.256291 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:56:55.256262 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5949dbe3_9662_4c63_99aa_4a4935f0d84f.slice/crio-78e9d2f17686910a47aa814625a77be1e796e86a1bb0055380d6fe290afdf272 WatchSource:0}: Error finding container 78e9d2f17686910a47aa814625a77be1e796e86a1bb0055380d6fe290afdf272: Status 404 returned error can't find the container with id 78e9d2f17686910a47aa814625a77be1e796e86a1bb0055380d6fe290afdf272 May 21 14:56:55.709961 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:55.709917 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-74df5" event={"ID":"5949dbe3-9662-4c63-99aa-4a4935f0d84f","Type":"ContainerStarted","Data":"78e9d2f17686910a47aa814625a77be1e796e86a1bb0055380d6fe290afdf272"} May 21 14:56:56.713704 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:56.713666 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-74df5" event={"ID":"5949dbe3-9662-4c63-99aa-4a4935f0d84f","Type":"ContainerStarted","Data":"5dea759af34be959aaf477ac5680907841b1f245038e4e49e142b05d57f51507"} May 21 14:56:56.713704 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:56.713708 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-74df5" event={"ID":"5949dbe3-9662-4c63-99aa-4a4935f0d84f","Type":"ContainerStarted","Data":"29a89caf88d4b84d29c8bbdf59a4b4db1e52892f44d194c0c85ddd29dcdeabb7"} May 21 14:56:56.731994 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:56.731923 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-74df5" podStartSLOduration=1.444034507 podStartE2EDuration="2.731908457s" podCreationTimestamp="2026-05-21 14:56:54 +0000 UTC" firstStartedPulling="2026-05-21 14:56:55.258169392 +0000 UTC m=+142.554045271" lastFinishedPulling="2026-05-21 14:56:56.546043325 +0000 UTC m=+143.841919221" observedRunningTime="2026-05-21 14:56:56.730227843 +0000 UTC m=+144.026103744" watchObservedRunningTime="2026-05-21 14:56:56.731908457 +0000 UTC m=+144.027784359" May 21 14:56:58.157833 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.157798 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-xdrg8"] May 21 14:56:58.161417 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.161392 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xdrg8" May 21 14:56:58.165000 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.164953 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 21 14:56:58.165200 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.164973 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 21 14:56:58.165320 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.165201 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9xmnp"] May 21 14:56:58.165320 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.165021 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 21 14:56:58.165416 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.165042 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-mbzbq\"" May 21 14:56:58.168382 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.168330 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9xmnp" May 21 14:56:58.170823 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.170803 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 21 14:56:58.170940 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.170812 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2chdt\"" May 21 14:56:58.170940 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.170909 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 21 14:56:58.171081 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.171021 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 21 14:56:58.174882 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.174858 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-xdrg8"] May 21 14:56:58.263204 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.263173 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28bc8\" (UniqueName: \"kubernetes.io/projected/8b61588a-a197-40da-a81f-35bd70515b6f-kube-api-access-28bc8\") pod \"kube-state-metrics-54fd6bc5c4-xdrg8\" (UID: \"8b61588a-a197-40da-a81f-35bd70515b6f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xdrg8" May 21 14:56:58.263383 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.263208 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f4aea9bc-fe76-4096-b336-75fd2f2c891a-root\") pod \"node-exporter-9xmnp\" (UID: \"f4aea9bc-fe76-4096-b336-75fd2f2c891a\") " pod="openshift-monitoring/node-exporter-9xmnp" May 21 14:56:58.263383 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.263251 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b61588a-a197-40da-a81f-35bd70515b6f-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-xdrg8\" (UID: \"8b61588a-a197-40da-a81f-35bd70515b6f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xdrg8" May 21 14:56:58.263383 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.263355 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8b61588a-a197-40da-a81f-35bd70515b6f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-xdrg8\" (UID: \"8b61588a-a197-40da-a81f-35bd70515b6f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xdrg8" May 21 14:56:58.263505 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.263383 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j47v\" (UniqueName: \"kubernetes.io/projected/f4aea9bc-fe76-4096-b336-75fd2f2c891a-kube-api-access-5j47v\") pod \"node-exporter-9xmnp\" (UID: \"f4aea9bc-fe76-4096-b336-75fd2f2c891a\") " pod="openshift-monitoring/node-exporter-9xmnp" May 21 14:56:58.263505 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.263407 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f4aea9bc-fe76-4096-b336-75fd2f2c891a-node-exporter-wtmp\") pod \"node-exporter-9xmnp\" (UID: \"f4aea9bc-fe76-4096-b336-75fd2f2c891a\") " pod="openshift-monitoring/node-exporter-9xmnp" May 21 14:56:58.263505 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.263451 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f4aea9bc-fe76-4096-b336-75fd2f2c891a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9xmnp\" (UID: \"f4aea9bc-fe76-4096-b336-75fd2f2c891a\") " pod="openshift-monitoring/node-exporter-9xmnp" May 21 14:56:58.263505 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.263474 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8b61588a-a197-40da-a81f-35bd70515b6f-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-xdrg8\" (UID: \"8b61588a-a197-40da-a81f-35bd70515b6f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xdrg8" May 21 14:56:58.263505 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.263494 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f4aea9bc-fe76-4096-b336-75fd2f2c891a-node-exporter-tls\") pod \"node-exporter-9xmnp\" (UID: \"f4aea9bc-fe76-4096-b336-75fd2f2c891a\") " pod="openshift-monitoring/node-exporter-9xmnp" May 21 14:56:58.263671 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.263510 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f4aea9bc-fe76-4096-b336-75fd2f2c891a-node-exporter-accelerators-collector-config\") pod \"node-exporter-9xmnp\" (UID: \"f4aea9bc-fe76-4096-b336-75fd2f2c891a\") " pod="openshift-monitoring/node-exporter-9xmnp" May 21 14:56:58.263671 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.263570 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4aea9bc-fe76-4096-b336-75fd2f2c891a-sys\") pod \"node-exporter-9xmnp\" (UID: \"f4aea9bc-fe76-4096-b336-75fd2f2c891a\") " pod="openshift-monitoring/node-exporter-9xmnp" May 21 14:56:58.263671 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.263605 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b61588a-a197-40da-a81f-35bd70515b6f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-xdrg8\" (UID: \"8b61588a-a197-40da-a81f-35bd70515b6f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xdrg8" May 21 14:56:58.263671 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.263628 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b61588a-a197-40da-a81f-35bd70515b6f-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-xdrg8\" (UID: \"8b61588a-a197-40da-a81f-35bd70515b6f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xdrg8" May 21 14:56:58.263671 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.263647 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f4aea9bc-fe76-4096-b336-75fd2f2c891a-node-exporter-textfile\") pod \"node-exporter-9xmnp\" (UID: \"f4aea9bc-fe76-4096-b336-75fd2f2c891a\") " pod="openshift-monitoring/node-exporter-9xmnp" May 21 14:56:58.263671 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.263663 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4aea9bc-fe76-4096-b336-75fd2f2c891a-metrics-client-ca\") pod \"node-exporter-9xmnp\" (UID: \"f4aea9bc-fe76-4096-b336-75fd2f2c891a\") " pod="openshift-monitoring/node-exporter-9xmnp" May 21 14:56:58.302374 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.302344 2557 scope.go:117] "RemoveContainer" containerID="39e6ecc5678b7e84240b87e384b94fd6e263183fe060d35a09f3b97b70aeeedd" May 21 14:56:58.302538 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:58.302520 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-qfg49_openshift-console-operator(c1ee545c-62b8-4223-8c79-c00a1a036620)\"" pod="openshift-console-operator/console-operator-76dff48d59-qfg49" podUID="c1ee545c-62b8-4223-8c79-c00a1a036620" May 21 14:56:58.364115 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.364077 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4aea9bc-fe76-4096-b336-75fd2f2c891a-sys\") pod \"node-exporter-9xmnp\" (UID: \"f4aea9bc-fe76-4096-b336-75fd2f2c891a\") " pod="openshift-monitoring/node-exporter-9xmnp" May 21 14:56:58.364300 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.364157 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b61588a-a197-40da-a81f-35bd70515b6f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-xdrg8\" (UID: \"8b61588a-a197-40da-a81f-35bd70515b6f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xdrg8" May 21 14:56:58.364300 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.364188 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b61588a-a197-40da-a81f-35bd70515b6f-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-xdrg8\" (UID: \"8b61588a-a197-40da-a81f-35bd70515b6f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xdrg8" May 21 14:56:58.364300 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.364196 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4aea9bc-fe76-4096-b336-75fd2f2c891a-sys\") pod \"node-exporter-9xmnp\" (UID: \"f4aea9bc-fe76-4096-b336-75fd2f2c891a\") " pod="openshift-monitoring/node-exporter-9xmnp" May 21 14:56:58.364300 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.364206 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f4aea9bc-fe76-4096-b336-75fd2f2c891a-node-exporter-textfile\") pod \"node-exporter-9xmnp\" (UID: \"f4aea9bc-fe76-4096-b336-75fd2f2c891a\") " pod="openshift-monitoring/node-exporter-9xmnp" May 21 14:56:58.364300 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.364253 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4aea9bc-fe76-4096-b336-75fd2f2c891a-metrics-client-ca\") pod \"node-exporter-9xmnp\" (UID: \"f4aea9bc-fe76-4096-b336-75fd2f2c891a\") " pod="openshift-monitoring/node-exporter-9xmnp" May 21 14:56:58.364565 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.364327 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-28bc8\" (UniqueName: \"kubernetes.io/projected/8b61588a-a197-40da-a81f-35bd70515b6f-kube-api-access-28bc8\") pod \"kube-state-metrics-54fd6bc5c4-xdrg8\" (UID: \"8b61588a-a197-40da-a81f-35bd70515b6f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xdrg8" May 21 14:56:58.364565 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.364383 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f4aea9bc-fe76-4096-b336-75fd2f2c891a-root\") pod \"node-exporter-9xmnp\" (UID: \"f4aea9bc-fe76-4096-b336-75fd2f2c891a\") " pod="openshift-monitoring/node-exporter-9xmnp" May 21 14:56:58.364565 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.364420 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b61588a-a197-40da-a81f-35bd70515b6f-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-xdrg8\" (UID: \"8b61588a-a197-40da-a81f-35bd70515b6f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xdrg8" May 21 14:56:58.364565 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.364488 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8b61588a-a197-40da-a81f-35bd70515b6f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-xdrg8\" (UID: \"8b61588a-a197-40da-a81f-35bd70515b6f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xdrg8" May 21 14:56:58.364565 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.364530 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5j47v\" (UniqueName: \"kubernetes.io/projected/f4aea9bc-fe76-4096-b336-75fd2f2c891a-kube-api-access-5j47v\") pod \"node-exporter-9xmnp\" (UID: \"f4aea9bc-fe76-4096-b336-75fd2f2c891a\") " pod="openshift-monitoring/node-exporter-9xmnp" May 21 14:56:58.364565 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.364544 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f4aea9bc-fe76-4096-b336-75fd2f2c891a-node-exporter-textfile\") pod \"node-exporter-9xmnp\" (UID: \"f4aea9bc-fe76-4096-b336-75fd2f2c891a\") " pod="openshift-monitoring/node-exporter-9xmnp" May 21 14:56:58.364565 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.364560 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f4aea9bc-fe76-4096-b336-75fd2f2c891a-node-exporter-wtmp\") pod \"node-exporter-9xmnp\" (UID: \"f4aea9bc-fe76-4096-b336-75fd2f2c891a\") " pod="openshift-monitoring/node-exporter-9xmnp" May 21 14:56:58.364891 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.364590 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f4aea9bc-fe76-4096-b336-75fd2f2c891a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9xmnp\" (UID: \"f4aea9bc-fe76-4096-b336-75fd2f2c891a\") " pod="openshift-monitoring/node-exporter-9xmnp" May 21 14:56:58.364891 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.364619 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8b61588a-a197-40da-a81f-35bd70515b6f-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-xdrg8\" (UID: \"8b61588a-a197-40da-a81f-35bd70515b6f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xdrg8" May 21 14:56:58.364891 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.364634 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f4aea9bc-fe76-4096-b336-75fd2f2c891a-root\") pod \"node-exporter-9xmnp\" (UID: \"f4aea9bc-fe76-4096-b336-75fd2f2c891a\") " pod="openshift-monitoring/node-exporter-9xmnp" May 21 14:56:58.364891 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.364647 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f4aea9bc-fe76-4096-b336-75fd2f2c891a-node-exporter-tls\") pod \"node-exporter-9xmnp\" (UID: \"f4aea9bc-fe76-4096-b336-75fd2f2c891a\") " pod="openshift-monitoring/node-exporter-9xmnp" May 21 14:56:58.364891 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.364689 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f4aea9bc-fe76-4096-b336-75fd2f2c891a-node-exporter-accelerators-collector-config\") pod \"node-exporter-9xmnp\" (UID: \"f4aea9bc-fe76-4096-b336-75fd2f2c891a\") " pod="openshift-monitoring/node-exporter-9xmnp" May 21 14:56:58.364891 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:58.364592 2557 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found May 21 14:56:58.364891 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.364817 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f4aea9bc-fe76-4096-b336-75fd2f2c891a-node-exporter-wtmp\") pod \"node-exporter-9xmnp\" (UID: \"f4aea9bc-fe76-4096-b336-75fd2f2c891a\") " pod="openshift-monitoring/node-exporter-9xmnp" May 21 14:56:58.364891 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.364827 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4aea9bc-fe76-4096-b336-75fd2f2c891a-metrics-client-ca\") pod \"node-exporter-9xmnp\" (UID: \"f4aea9bc-fe76-4096-b336-75fd2f2c891a\") " pod="openshift-monitoring/node-exporter-9xmnp" May 21 14:56:58.364891 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:56:58.364873 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b61588a-a197-40da-a81f-35bd70515b6f-kube-state-metrics-tls podName:8b61588a-a197-40da-a81f-35bd70515b6f nodeName:}" failed. No retries permitted until 2026-05-21 14:56:58.864853805 +0000 UTC m=+146.160729684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8b61588a-a197-40da-a81f-35bd70515b6f-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-xdrg8" (UID: "8b61588a-a197-40da-a81f-35bd70515b6f") : secret "kube-state-metrics-tls" not found May 21 14:56:58.365436 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.365193 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8b61588a-a197-40da-a81f-35bd70515b6f-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-xdrg8\" (UID: \"8b61588a-a197-40da-a81f-35bd70515b6f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xdrg8" May 21 14:56:58.365436 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.365226 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f4aea9bc-fe76-4096-b336-75fd2f2c891a-node-exporter-accelerators-collector-config\") pod \"node-exporter-9xmnp\" (UID: \"f4aea9bc-fe76-4096-b336-75fd2f2c891a\") " pod="openshift-monitoring/node-exporter-9xmnp" May 21 14:56:58.365547 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.365534 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b61588a-a197-40da-a81f-35bd70515b6f-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-xdrg8\" (UID: \"8b61588a-a197-40da-a81f-35bd70515b6f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xdrg8" May 21 14:56:58.365665 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.365637 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8b61588a-a197-40da-a81f-35bd70515b6f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-xdrg8\" (UID: \"8b61588a-a197-40da-a81f-35bd70515b6f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xdrg8" May 21 14:56:58.367041 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.367016 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b61588a-a197-40da-a81f-35bd70515b6f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-xdrg8\" (UID: \"8b61588a-a197-40da-a81f-35bd70515b6f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xdrg8" May 21 14:56:58.367150 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.367091 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f4aea9bc-fe76-4096-b336-75fd2f2c891a-node-exporter-tls\") pod \"node-exporter-9xmnp\" (UID: \"f4aea9bc-fe76-4096-b336-75fd2f2c891a\") " pod="openshift-monitoring/node-exporter-9xmnp" May 21 14:56:58.367370 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.367353 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f4aea9bc-fe76-4096-b336-75fd2f2c891a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9xmnp\" (UID: \"f4aea9bc-fe76-4096-b336-75fd2f2c891a\") " pod="openshift-monitoring/node-exporter-9xmnp" May 21 14:56:58.379110 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.379075 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j47v\" (UniqueName: \"kubernetes.io/projected/f4aea9bc-fe76-4096-b336-75fd2f2c891a-kube-api-access-5j47v\") pod \"node-exporter-9xmnp\" (UID: \"f4aea9bc-fe76-4096-b336-75fd2f2c891a\") " pod="openshift-monitoring/node-exporter-9xmnp" May 21 14:56:58.379640 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.379614 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28bc8\" (UniqueName: \"kubernetes.io/projected/8b61588a-a197-40da-a81f-35bd70515b6f-kube-api-access-28bc8\") pod \"kube-state-metrics-54fd6bc5c4-xdrg8\" (UID: \"8b61588a-a197-40da-a81f-35bd70515b6f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xdrg8" May 21 14:56:58.478228 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.478190 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9xmnp" May 21 14:56:58.486140 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:56:58.486100 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4aea9bc_fe76_4096_b336_75fd2f2c891a.slice/crio-c0921208f9b1ffac61241b6557b4f84f8c054f61d1ec8ddac3c73fff38f087f1 WatchSource:0}: Error finding container c0921208f9b1ffac61241b6557b4f84f8c054f61d1ec8ddac3c73fff38f087f1: Status 404 returned error can't find the container with id c0921208f9b1ffac61241b6557b4f84f8c054f61d1ec8ddac3c73fff38f087f1 May 21 14:56:58.719294 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.719259 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9xmnp" event={"ID":"f4aea9bc-fe76-4096-b336-75fd2f2c891a","Type":"ContainerStarted","Data":"c0921208f9b1ffac61241b6557b4f84f8c054f61d1ec8ddac3c73fff38f087f1"} May 21 14:56:58.868407 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.868317 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b61588a-a197-40da-a81f-35bd70515b6f-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-xdrg8\" (UID: \"8b61588a-a197-40da-a81f-35bd70515b6f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xdrg8" May 21 14:56:58.870833 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:58.870807 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b61588a-a197-40da-a81f-35bd70515b6f-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-xdrg8\" (UID: \"8b61588a-a197-40da-a81f-35bd70515b6f\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xdrg8" May 21 14:56:59.071780 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:59.071641 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xdrg8" May 21 14:56:59.235653 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:59.235392 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-xdrg8"] May 21 14:56:59.457800 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:56:59.457752 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b61588a_a197_40da_a81f_35bd70515b6f.slice/crio-623682f5e0886bf12cf125ada40b73d131aec1f90e500262c65183534a239204 WatchSource:0}: Error finding container 623682f5e0886bf12cf125ada40b73d131aec1f90e500262c65183534a239204: Status 404 returned error can't find the container with id 623682f5e0886bf12cf125ada40b73d131aec1f90e500262c65183534a239204 May 21 14:56:59.723468 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:59.723376 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xdrg8" event={"ID":"8b61588a-a197-40da-a81f-35bd70515b6f","Type":"ContainerStarted","Data":"623682f5e0886bf12cf125ada40b73d131aec1f90e500262c65183534a239204"} May 21 14:56:59.724899 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:59.724868 2557 generic.go:358] "Generic (PLEG): container finished" podID="f4aea9bc-fe76-4096-b336-75fd2f2c891a" containerID="e542a6862e396f576597a9bca53896c53c4489ddd97117a5836ee26dee858cbe" exitCode=0 May 21 14:56:59.725027 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:56:59.724930 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9xmnp" event={"ID":"f4aea9bc-fe76-4096-b336-75fd2f2c891a","Type":"ContainerDied","Data":"e542a6862e396f576597a9bca53896c53c4489ddd97117a5836ee26dee858cbe"} May 21 14:57:00.729996 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:00.729953 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9xmnp" event={"ID":"f4aea9bc-fe76-4096-b336-75fd2f2c891a","Type":"ContainerStarted","Data":"34b787d669972857a0534e77da926d07d02838152c86e0c668b22ef1e784c43e"} May 21 14:57:00.730367 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:00.730012 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9xmnp" event={"ID":"f4aea9bc-fe76-4096-b336-75fd2f2c891a","Type":"ContainerStarted","Data":"e9ab8fc2450a9668cf693008b5e4aceddbba1c07c9c1ca3025b0577efae8c655"} May 21 14:57:00.753651 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:00.753590 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9xmnp" podStartSLOduration=1.738630656 podStartE2EDuration="2.753571111s" podCreationTimestamp="2026-05-21 14:56:58 +0000 UTC" firstStartedPulling="2026-05-21 14:56:58.487908187 +0000 UTC m=+145.783784069" lastFinishedPulling="2026-05-21 14:56:59.502848644 +0000 UTC m=+146.798724524" observedRunningTime="2026-05-21 14:57:00.752643804 +0000 UTC m=+148.048519716" watchObservedRunningTime="2026-05-21 14:57:00.753571111 +0000 UTC m=+148.049447012" May 21 14:57:01.734241 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:01.734208 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xdrg8" event={"ID":"8b61588a-a197-40da-a81f-35bd70515b6f","Type":"ContainerStarted","Data":"c3abeb4ab900376787eb26d6b72f8808bfe4f89210425274aae6b4e5a426c01a"} May 21 14:57:01.734241 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:01.734245 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xdrg8" event={"ID":"8b61588a-a197-40da-a81f-35bd70515b6f","Type":"ContainerStarted","Data":"148eb14f45c8a3c725ac8ab9da0c1be68baf531952a5003ee95e7c4f67ed6c3d"} May 21 14:57:01.734682 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:01.734254 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xdrg8" event={"ID":"8b61588a-a197-40da-a81f-35bd70515b6f","Type":"ContainerStarted","Data":"cd282aa62325e04e9fd86edda10de258a548e3d3d8ee59f35f01c41df872648d"} May 21 14:57:01.755420 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:01.755365 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-xdrg8" podStartSLOduration=2.5270119920000003 podStartE2EDuration="3.75535089s" podCreationTimestamp="2026-05-21 14:56:58 +0000 UTC" firstStartedPulling="2026-05-21 14:56:59.459784292 +0000 UTC m=+146.755660173" lastFinishedPulling="2026-05-21 14:57:00.68812319 +0000 UTC m=+147.983999071" observedRunningTime="2026-05-21 14:57:01.753872879 +0000 UTC m=+149.049748779" watchObservedRunningTime="2026-05-21 14:57:01.75535089 +0000 UTC m=+149.051226792" May 21 14:57:03.363318 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.363272 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-fb6ff45b6-t98dz"] May 21 14:57:03.366736 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.366711 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" May 21 14:57:03.369289 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.369260 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-wx6gj\"" May 21 14:57:03.369447 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.369324 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" May 21 14:57:03.369525 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.369501 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" May 21 14:57:03.369633 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.369611 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" May 21 14:57:03.369827 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.369668 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" May 21 14:57:03.369904 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.369862 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" May 21 14:57:03.374694 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.374669 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" May 21 14:57:03.378413 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.378386 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-fb6ff45b6-t98dz"] May 21 14:57:03.407340 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.407295 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70aad2f1-209d-4ef9-b696-663fcb5bbcfb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fb6ff45b6-t98dz\" (UID: \"70aad2f1-209d-4ef9-b696-663fcb5bbcfb\") " pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" May 21 14:57:03.407340 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.407341 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h72vc\" (UniqueName: \"kubernetes.io/projected/70aad2f1-209d-4ef9-b696-663fcb5bbcfb-kube-api-access-h72vc\") pod \"telemeter-client-fb6ff45b6-t98dz\" (UID: \"70aad2f1-209d-4ef9-b696-663fcb5bbcfb\") " pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" May 21 14:57:03.407556 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.407382 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70aad2f1-209d-4ef9-b696-663fcb5bbcfb-serving-certs-ca-bundle\") pod \"telemeter-client-fb6ff45b6-t98dz\" (UID: \"70aad2f1-209d-4ef9-b696-663fcb5bbcfb\") " pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" May 21 14:57:03.407556 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.407407 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/70aad2f1-209d-4ef9-b696-663fcb5bbcfb-telemeter-client-tls\") pod \"telemeter-client-fb6ff45b6-t98dz\" (UID: \"70aad2f1-209d-4ef9-b696-663fcb5bbcfb\") " pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" May 21 14:57:03.407556 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.407423 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70aad2f1-209d-4ef9-b696-663fcb5bbcfb-metrics-client-ca\") pod \"telemeter-client-fb6ff45b6-t98dz\" (UID: \"70aad2f1-209d-4ef9-b696-663fcb5bbcfb\") " pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" May 21 14:57:03.407556 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.407474 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/70aad2f1-209d-4ef9-b696-663fcb5bbcfb-federate-client-tls\") pod \"telemeter-client-fb6ff45b6-t98dz\" (UID: \"70aad2f1-209d-4ef9-b696-663fcb5bbcfb\") " pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" May 21 14:57:03.407556 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.407529 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70aad2f1-209d-4ef9-b696-663fcb5bbcfb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fb6ff45b6-t98dz\" (UID: \"70aad2f1-209d-4ef9-b696-663fcb5bbcfb\") " pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" May 21 14:57:03.407556 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.407556 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/70aad2f1-209d-4ef9-b696-663fcb5bbcfb-secret-telemeter-client\") pod \"telemeter-client-fb6ff45b6-t98dz\" (UID: \"70aad2f1-209d-4ef9-b696-663fcb5bbcfb\") " pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" May 21 14:57:03.507946 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.507911 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70aad2f1-209d-4ef9-b696-663fcb5bbcfb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fb6ff45b6-t98dz\" (UID: \"70aad2f1-209d-4ef9-b696-663fcb5bbcfb\") " pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" May 21 14:57:03.508123 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.507959 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/70aad2f1-209d-4ef9-b696-663fcb5bbcfb-secret-telemeter-client\") pod \"telemeter-client-fb6ff45b6-t98dz\" (UID: \"70aad2f1-209d-4ef9-b696-663fcb5bbcfb\") " pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" May 21 14:57:03.508123 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.508049 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70aad2f1-209d-4ef9-b696-663fcb5bbcfb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fb6ff45b6-t98dz\" (UID: \"70aad2f1-209d-4ef9-b696-663fcb5bbcfb\") " pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" May 21 14:57:03.508123 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.508083 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h72vc\" (UniqueName: \"kubernetes.io/projected/70aad2f1-209d-4ef9-b696-663fcb5bbcfb-kube-api-access-h72vc\") pod \"telemeter-client-fb6ff45b6-t98dz\" (UID: \"70aad2f1-209d-4ef9-b696-663fcb5bbcfb\") " pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" May 21 14:57:03.508258 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.508151 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70aad2f1-209d-4ef9-b696-663fcb5bbcfb-serving-certs-ca-bundle\") pod \"telemeter-client-fb6ff45b6-t98dz\" (UID: \"70aad2f1-209d-4ef9-b696-663fcb5bbcfb\") " pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" May 21 14:57:03.508439 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.508421 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/70aad2f1-209d-4ef9-b696-663fcb5bbcfb-telemeter-client-tls\") pod \"telemeter-client-fb6ff45b6-t98dz\" (UID: \"70aad2f1-209d-4ef9-b696-663fcb5bbcfb\") " pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" May 21 14:57:03.508626 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.508544 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70aad2f1-209d-4ef9-b696-663fcb5bbcfb-metrics-client-ca\") pod \"telemeter-client-fb6ff45b6-t98dz\" (UID: \"70aad2f1-209d-4ef9-b696-663fcb5bbcfb\") " pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" May 21 14:57:03.508626 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.508586 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/70aad2f1-209d-4ef9-b696-663fcb5bbcfb-federate-client-tls\") pod \"telemeter-client-fb6ff45b6-t98dz\" (UID: \"70aad2f1-209d-4ef9-b696-663fcb5bbcfb\") " pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" May 21 14:57:03.508903 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.508872 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70aad2f1-209d-4ef9-b696-663fcb5bbcfb-serving-certs-ca-bundle\") pod \"telemeter-client-fb6ff45b6-t98dz\" (UID: \"70aad2f1-209d-4ef9-b696-663fcb5bbcfb\") " pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" May 21 14:57:03.509166 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.509146 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70aad2f1-209d-4ef9-b696-663fcb5bbcfb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fb6ff45b6-t98dz\" (UID: \"70aad2f1-209d-4ef9-b696-663fcb5bbcfb\") " pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" May 21 14:57:03.509483 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.509462 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70aad2f1-209d-4ef9-b696-663fcb5bbcfb-metrics-client-ca\") pod \"telemeter-client-fb6ff45b6-t98dz\" (UID: \"70aad2f1-209d-4ef9-b696-663fcb5bbcfb\") " pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" May 21 14:57:03.511064 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.511042 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70aad2f1-209d-4ef9-b696-663fcb5bbcfb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fb6ff45b6-t98dz\" (UID: \"70aad2f1-209d-4ef9-b696-663fcb5bbcfb\") " pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" May 21 14:57:03.511165 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.511071 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/70aad2f1-209d-4ef9-b696-663fcb5bbcfb-secret-telemeter-client\") pod \"telemeter-client-fb6ff45b6-t98dz\" (UID: \"70aad2f1-209d-4ef9-b696-663fcb5bbcfb\") " pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" May 21 14:57:03.511356 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.511333 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/70aad2f1-209d-4ef9-b696-663fcb5bbcfb-telemeter-client-tls\") pod \"telemeter-client-fb6ff45b6-t98dz\" (UID: \"70aad2f1-209d-4ef9-b696-663fcb5bbcfb\") " pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" May 21 14:57:03.511485 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.511465 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/70aad2f1-209d-4ef9-b696-663fcb5bbcfb-federate-client-tls\") pod \"telemeter-client-fb6ff45b6-t98dz\" (UID: \"70aad2f1-209d-4ef9-b696-663fcb5bbcfb\") " pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" May 21 14:57:03.516327 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.516304 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h72vc\" (UniqueName: \"kubernetes.io/projected/70aad2f1-209d-4ef9-b696-663fcb5bbcfb-kube-api-access-h72vc\") pod \"telemeter-client-fb6ff45b6-t98dz\" (UID: \"70aad2f1-209d-4ef9-b696-663fcb5bbcfb\") " pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" May 21 14:57:03.677346 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.677252 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" May 21 14:57:03.815341 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:03.815278 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-fb6ff45b6-t98dz"] May 21 14:57:03.820115 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:57:03.820070 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70aad2f1_209d_4ef9_b696_663fcb5bbcfb.slice/crio-d7e3d377ec30a6d34e23d57a3dfb1f34d8643510962656d620bc0dafc824982a WatchSource:0}: Error finding container d7e3d377ec30a6d34e23d57a3dfb1f34d8643510962656d620bc0dafc824982a: Status 404 returned error can't find the container with id d7e3d377ec30a6d34e23d57a3dfb1f34d8643510962656d620bc0dafc824982a May 21 14:57:04.748197 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:04.748154 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" event={"ID":"70aad2f1-209d-4ef9-b696-663fcb5bbcfb","Type":"ContainerStarted","Data":"d7e3d377ec30a6d34e23d57a3dfb1f34d8643510962656d620bc0dafc824982a"} May 21 14:57:06.758728 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:06.758681 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" event={"ID":"70aad2f1-209d-4ef9-b696-663fcb5bbcfb","Type":"ContainerStarted","Data":"bd58fda3b7b89ab4f8fa835de73dc4d5a1871049ca36b312bc537fd0d57f36ea"} May 21 14:57:07.763928 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:07.763890 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" event={"ID":"70aad2f1-209d-4ef9-b696-663fcb5bbcfb","Type":"ContainerStarted","Data":"ff54e6dff762680f4abf7ded619ded8d27ff30f3ee0437c0846654a1ae8b8d5b"} May 21 14:57:07.763928 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:07.763929 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" event={"ID":"70aad2f1-209d-4ef9-b696-663fcb5bbcfb","Type":"ContainerStarted","Data":"e076f614c38756193f74338389069c903ef2b4779d6e3c73d216eefd8927885d"} May 21 14:57:07.788326 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:07.788271 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-fb6ff45b6-t98dz" podStartSLOduration=1.7241909899999999 podStartE2EDuration="4.78825198s" podCreationTimestamp="2026-05-21 14:57:03 +0000 UTC" firstStartedPulling="2026-05-21 14:57:03.822675079 +0000 UTC m=+151.118550972" lastFinishedPulling="2026-05-21 14:57:06.886736083 +0000 UTC m=+154.182611962" observedRunningTime="2026-05-21 14:57:07.787109253 +0000 UTC m=+155.082985153" watchObservedRunningTime="2026-05-21 14:57:07.78825198 +0000 UTC m=+155.084127906" May 21 14:57:09.303177 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:09.303145 2557 scope.go:117] "RemoveContainer" containerID="39e6ecc5678b7e84240b87e384b94fd6e263183fe060d35a09f3b97b70aeeedd" May 21 14:57:09.596105 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:57:09.596005 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-57vtw" podUID="c45651aa-fdb1-463b-a7cd-e3894c939874" May 21 14:57:09.615340 ip-10-0-137-49 kubenswrapper[2557]: E0521 14:57:09.615295 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-tpsq5" podUID="cf248aa5-1086-4c30-919a-df06b4850374" May 21 14:57:09.771604 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:09.771578 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qfg49_c1ee545c-62b8-4223-8c79-c00a1a036620/console-operator/2.log" May 21 14:57:09.771768 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:09.771698 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-57vtw" May 21 14:57:09.771768 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:09.771699 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-qfg49" event={"ID":"c1ee545c-62b8-4223-8c79-c00a1a036620","Type":"ContainerStarted","Data":"e6846acc361f5b5b3a5e1da44281820c3bac632b7904007f1c464a15172194dc"} May 21 14:57:09.774261 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:09.773150 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-qfg49" May 21 14:57:09.792401 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:09.792336 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-qfg49" podStartSLOduration=51.809131442 podStartE2EDuration="53.792318688s" podCreationTimestamp="2026-05-21 14:56:16 +0000 UTC" firstStartedPulling="2026-05-21 14:56:16.916635878 +0000 UTC m=+104.212511760" lastFinishedPulling="2026-05-21 14:56:18.899823124 +0000 UTC m=+106.195699006" observedRunningTime="2026-05-21 14:57:09.791181353 +0000 UTC m=+157.087057291" watchObservedRunningTime="2026-05-21 14:57:09.792318688 +0000 UTC m=+157.088194590" May 21 14:57:10.168458 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:10.168430 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-qfg49" May 21 14:57:14.504439 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:14.504344 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c45651aa-fdb1-463b-a7cd-e3894c939874-metrics-tls\") pod \"dns-default-57vtw\" (UID: \"c45651aa-fdb1-463b-a7cd-e3894c939874\") " pod="openshift-dns/dns-default-57vtw" May 21 14:57:14.504439 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:14.504413 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf248aa5-1086-4c30-919a-df06b4850374-cert\") pod \"ingress-canary-tpsq5\" (UID: \"cf248aa5-1086-4c30-919a-df06b4850374\") " pod="openshift-ingress-canary/ingress-canary-tpsq5" May 21 14:57:14.506690 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:14.506663 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c45651aa-fdb1-463b-a7cd-e3894c939874-metrics-tls\") pod \"dns-default-57vtw\" (UID: \"c45651aa-fdb1-463b-a7cd-e3894c939874\") " pod="openshift-dns/dns-default-57vtw" May 21 14:57:14.506912 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:14.506892 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf248aa5-1086-4c30-919a-df06b4850374-cert\") pod \"ingress-canary-tpsq5\" (UID: \"cf248aa5-1086-4c30-919a-df06b4850374\") " pod="openshift-ingress-canary/ingress-canary-tpsq5" May 21 14:57:14.576062 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:14.576027 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jrvl8\"" May 21 14:57:14.584233 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:14.584205 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-57vtw" May 21 14:57:14.718840 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:14.718803 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-57vtw"] May 21 14:57:14.722072 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:57:14.722033 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc45651aa_fdb1_463b_a7cd_e3894c939874.slice/crio-1e7d3384773a206c5b39840f7f1b709298178c34b3165f2ad841870186e7e6eb WatchSource:0}: Error finding container 1e7d3384773a206c5b39840f7f1b709298178c34b3165f2ad841870186e7e6eb: Status 404 returned error can't find the container with id 1e7d3384773a206c5b39840f7f1b709298178c34b3165f2ad841870186e7e6eb May 21 14:57:14.790247 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:14.790156 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-57vtw" event={"ID":"c45651aa-fdb1-463b-a7cd-e3894c939874","Type":"ContainerStarted","Data":"1e7d3384773a206c5b39840f7f1b709298178c34b3165f2ad841870186e7e6eb"} May 21 14:57:16.796703 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:16.796665 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-57vtw" event={"ID":"c45651aa-fdb1-463b-a7cd-e3894c939874","Type":"ContainerStarted","Data":"0cef7c0b1371b03f78ba63a66d6a29112109763b638afb84799a30ec5727f484"} May 21 14:57:16.796703 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:16.796707 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-57vtw" event={"ID":"c45651aa-fdb1-463b-a7cd-e3894c939874","Type":"ContainerStarted","Data":"d24ba8e9aa3f5c152fa834cd742fd5236d82f23cc9d24fa1497e371d9bbd5def"} May 21 14:57:16.797134 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:16.796766 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-57vtw" May 21 14:57:16.823611 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:16.823557 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-57vtw" podStartSLOduration=129.449949728 podStartE2EDuration="2m10.82354038s" podCreationTimestamp="2026-05-21 14:55:06 +0000 UTC" firstStartedPulling="2026-05-21 14:57:14.724035605 +0000 UTC m=+162.019911487" lastFinishedPulling="2026-05-21 14:57:16.09762626 +0000 UTC m=+163.393502139" observedRunningTime="2026-05-21 14:57:16.821436631 +0000 UTC m=+164.117312532" watchObservedRunningTime="2026-05-21 14:57:16.82354038 +0000 UTC m=+164.119416281" May 21 14:57:25.302660 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:25.302616 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tpsq5" May 21 14:57:25.305407 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:25.305381 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-j2cxw\"" May 21 14:57:25.313825 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:25.313802 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tpsq5" May 21 14:57:25.444513 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:25.444469 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tpsq5"] May 21 14:57:25.447534 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:57:25.447505 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf248aa5_1086_4c30_919a_df06b4850374.slice/crio-9c0a7069dad748d88db33992d96cfe4b6b9c0e6c09db747a9dda1f56ff99d650 WatchSource:0}: Error finding container 9c0a7069dad748d88db33992d96cfe4b6b9c0e6c09db747a9dda1f56ff99d650: Status 404 returned error can't find the container with id 9c0a7069dad748d88db33992d96cfe4b6b9c0e6c09db747a9dda1f56ff99d650 May 21 14:57:25.822065 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:25.822021 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tpsq5" event={"ID":"cf248aa5-1086-4c30-919a-df06b4850374","Type":"ContainerStarted","Data":"9c0a7069dad748d88db33992d96cfe4b6b9c0e6c09db747a9dda1f56ff99d650"} May 21 14:57:26.802737 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:26.802374 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-57vtw" May 21 14:57:27.497581 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:27.497475 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-57vtw_c45651aa-fdb1-463b-a7cd-e3894c939874/dns/0.log" May 21 14:57:27.693653 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:27.693625 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-57vtw_c45651aa-fdb1-463b-a7cd-e3894c939874/kube-rbac-proxy/0.log" May 21 14:57:27.830157 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:27.830069 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tpsq5" event={"ID":"cf248aa5-1086-4c30-919a-df06b4850374","Type":"ContainerStarted","Data":"00f34466a87412e71594e6a2c93795beb81dd2c13f991e180def26a5f670f3d0"} May 21 14:57:27.857305 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:27.857256 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tpsq5" podStartSLOduration=140.076895798 podStartE2EDuration="2m21.85723756s" podCreationTimestamp="2026-05-21 14:55:06 +0000 UTC" firstStartedPulling="2026-05-21 14:57:25.449462424 +0000 UTC m=+172.745338304" lastFinishedPulling="2026-05-21 14:57:27.229804184 +0000 UTC m=+174.525680066" observedRunningTime="2026-05-21 14:57:27.855706018 +0000 UTC m=+175.151581918" watchObservedRunningTime="2026-05-21 14:57:27.85723756 +0000 UTC m=+175.153113460" May 21 14:57:28.893073 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:28.893044 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5tqsh_575ad37b-aef2-41aa-8c72-53f7a515aa96/dns-node-resolver/0.log" May 21 14:57:29.293326 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:29.293294 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b98c464fb-pxm7b_ba458fb2-e7b0-4b6b-9127-e936f8f26f96/router/0.log" May 21 14:57:29.893342 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:57:29.893309 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tpsq5_cf248aa5-1086-4c30-919a-df06b4850374/serve-healthcheck-canary/0.log" May 21 14:58:47.939881 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:58:47.939798 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-7qqb9"] May 21 14:58:47.941883 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:58:47.941859 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7qqb9" May 21 14:58:47.945444 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:58:47.945415 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 21 14:58:47.952374 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:58:47.952344 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7qqb9"] May 21 14:58:48.030704 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:58:48.030664 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ad7e70f3-1d8a-4cbd-ba75-479a3dda1538-dbus\") pod \"global-pull-secret-syncer-7qqb9\" (UID: \"ad7e70f3-1d8a-4cbd-ba75-479a3dda1538\") " pod="kube-system/global-pull-secret-syncer-7qqb9" May 21 14:58:48.030907 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:58:48.030713 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ad7e70f3-1d8a-4cbd-ba75-479a3dda1538-kubelet-config\") pod \"global-pull-secret-syncer-7qqb9\" (UID: \"ad7e70f3-1d8a-4cbd-ba75-479a3dda1538\") " pod="kube-system/global-pull-secret-syncer-7qqb9" May 21 14:58:48.030907 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:58:48.030826 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad7e70f3-1d8a-4cbd-ba75-479a3dda1538-original-pull-secret\") pod \"global-pull-secret-syncer-7qqb9\" (UID: \"ad7e70f3-1d8a-4cbd-ba75-479a3dda1538\") " pod="kube-system/global-pull-secret-syncer-7qqb9" May 21 14:58:48.131611 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:58:48.131571 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad7e70f3-1d8a-4cbd-ba75-479a3dda1538-original-pull-secret\") pod \"global-pull-secret-syncer-7qqb9\" (UID: \"ad7e70f3-1d8a-4cbd-ba75-479a3dda1538\") " pod="kube-system/global-pull-secret-syncer-7qqb9" May 21 14:58:48.131787 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:58:48.131637 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ad7e70f3-1d8a-4cbd-ba75-479a3dda1538-dbus\") pod \"global-pull-secret-syncer-7qqb9\" (UID: \"ad7e70f3-1d8a-4cbd-ba75-479a3dda1538\") " pod="kube-system/global-pull-secret-syncer-7qqb9" May 21 14:58:48.131787 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:58:48.131666 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ad7e70f3-1d8a-4cbd-ba75-479a3dda1538-kubelet-config\") pod \"global-pull-secret-syncer-7qqb9\" (UID: \"ad7e70f3-1d8a-4cbd-ba75-479a3dda1538\") " pod="kube-system/global-pull-secret-syncer-7qqb9" May 21 14:58:48.131787 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:58:48.131740 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ad7e70f3-1d8a-4cbd-ba75-479a3dda1538-kubelet-config\") pod \"global-pull-secret-syncer-7qqb9\" (UID: \"ad7e70f3-1d8a-4cbd-ba75-479a3dda1538\") " pod="kube-system/global-pull-secret-syncer-7qqb9" May 21 14:58:48.131787 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:58:48.131776 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ad7e70f3-1d8a-4cbd-ba75-479a3dda1538-dbus\") pod \"global-pull-secret-syncer-7qqb9\" (UID: \"ad7e70f3-1d8a-4cbd-ba75-479a3dda1538\") " pod="kube-system/global-pull-secret-syncer-7qqb9" May 21 14:58:48.133892 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:58:48.133861 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ad7e70f3-1d8a-4cbd-ba75-479a3dda1538-original-pull-secret\") pod \"global-pull-secret-syncer-7qqb9\" (UID: \"ad7e70f3-1d8a-4cbd-ba75-479a3dda1538\") " pod="kube-system/global-pull-secret-syncer-7qqb9" May 21 14:58:48.253070 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:58:48.252959 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7qqb9" May 21 14:58:48.391848 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:58:48.391813 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7qqb9"] May 21 14:58:48.395040 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:58:48.395007 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad7e70f3_1d8a_4cbd_ba75_479a3dda1538.slice/crio-1a77fb2eda256de03c13a4a6ebff5988e1b61a8efe8d63d7174df7ee877de17f WatchSource:0}: Error finding container 1a77fb2eda256de03c13a4a6ebff5988e1b61a8efe8d63d7174df7ee877de17f: Status 404 returned error can't find the container with id 1a77fb2eda256de03c13a4a6ebff5988e1b61a8efe8d63d7174df7ee877de17f May 21 14:58:49.062439 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:58:49.062395 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7qqb9" event={"ID":"ad7e70f3-1d8a-4cbd-ba75-479a3dda1538","Type":"ContainerStarted","Data":"1a77fb2eda256de03c13a4a6ebff5988e1b61a8efe8d63d7174df7ee877de17f"} May 21 14:58:53.076599 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:58:53.076560 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7qqb9" event={"ID":"ad7e70f3-1d8a-4cbd-ba75-479a3dda1538","Type":"ContainerStarted","Data":"96b113a3279f5066ec5523d49735f26b92dae43c952d43c9e79b0fa043244936"} May 21 14:58:53.092926 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:58:53.092871 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7qqb9" podStartSLOduration=1.8602089309999998 podStartE2EDuration="6.092853853s" podCreationTimestamp="2026-05-21 14:58:47 +0000 UTC" firstStartedPulling="2026-05-21 14:58:48.396666675 +0000 UTC m=+255.692542559" lastFinishedPulling="2026-05-21 14:58:52.629311599 +0000 UTC m=+259.925187481" observedRunningTime="2026-05-21 14:58:53.091861195 +0000 UTC m=+260.387737097" watchObservedRunningTime="2026-05-21 14:58:53.092853853 +0000 UTC m=+260.388729754" May 21 14:59:22.087959 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.087908 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-94f48499b-45stv"] May 21 14:59:22.089949 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.089927 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-94f48499b-45stv" May 21 14:59:22.092290 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.092266 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 21 14:59:22.092425 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.092357 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 21 14:59:22.096495 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.093604 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 21 14:59:22.096495 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.093863 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-g856v\"" May 21 14:59:22.096495 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.094436 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" May 21 14:59:22.101112 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.101086 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-94f48499b-45stv"] May 21 14:59:22.104879 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.104844 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2c7w\" (UniqueName: \"kubernetes.io/projected/4fff8744-ab81-433b-a0b9-2d4e8c646428-kube-api-access-s2c7w\") pod \"managed-serviceaccount-addon-agent-94f48499b-45stv\" (UID: \"4fff8744-ab81-433b-a0b9-2d4e8c646428\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-94f48499b-45stv" May 21 14:59:22.105002 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.104933 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4fff8744-ab81-433b-a0b9-2d4e8c646428-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-94f48499b-45stv\" (UID: \"4fff8744-ab81-433b-a0b9-2d4e8c646428\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-94f48499b-45stv" May 21 14:59:22.205770 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.205727 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4fff8744-ab81-433b-a0b9-2d4e8c646428-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-94f48499b-45stv\" (UID: \"4fff8744-ab81-433b-a0b9-2d4e8c646428\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-94f48499b-45stv" May 21 14:59:22.205955 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.205817 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s2c7w\" (UniqueName: \"kubernetes.io/projected/4fff8744-ab81-433b-a0b9-2d4e8c646428-kube-api-access-s2c7w\") pod \"managed-serviceaccount-addon-agent-94f48499b-45stv\" (UID: \"4fff8744-ab81-433b-a0b9-2d4e8c646428\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-94f48499b-45stv" May 21 14:59:22.208612 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.208587 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4fff8744-ab81-433b-a0b9-2d4e8c646428-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-94f48499b-45stv\" (UID: \"4fff8744-ab81-433b-a0b9-2d4e8c646428\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-94f48499b-45stv" May 21 14:59:22.208913 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.208891 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf494c86c-c28ct"] May 21 14:59:22.211754 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.211730 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf494c86c-c28ct" May 21 14:59:22.214399 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.214371 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" May 21 14:59:22.214543 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.214412 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" May 21 14:59:22.214744 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.214718 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" May 21 14:59:22.214825 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.214809 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" May 21 14:59:22.222394 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.222238 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2c7w\" (UniqueName: \"kubernetes.io/projected/4fff8744-ab81-433b-a0b9-2d4e8c646428-kube-api-access-s2c7w\") pod \"managed-serviceaccount-addon-agent-94f48499b-45stv\" (UID: \"4fff8744-ab81-433b-a0b9-2d4e8c646428\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-94f48499b-45stv" May 21 14:59:22.223961 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.223939 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf494c86c-c28ct"] May 21 14:59:22.306864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.306821 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whqvp\" (UniqueName: \"kubernetes.io/projected/94ed28ce-c78a-460e-bea9-5cbc1b62dcec-kube-api-access-whqvp\") pod \"cluster-proxy-proxy-agent-5cf494c86c-c28ct\" (UID: \"94ed28ce-c78a-460e-bea9-5cbc1b62dcec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf494c86c-c28ct" May 21 14:59:22.306864 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.306861 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/94ed28ce-c78a-460e-bea9-5cbc1b62dcec-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5cf494c86c-c28ct\" (UID: \"94ed28ce-c78a-460e-bea9-5cbc1b62dcec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf494c86c-c28ct" May 21 14:59:22.307125 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.306881 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/94ed28ce-c78a-460e-bea9-5cbc1b62dcec-hub\") pod \"cluster-proxy-proxy-agent-5cf494c86c-c28ct\" (UID: \"94ed28ce-c78a-460e-bea9-5cbc1b62dcec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf494c86c-c28ct" May 21 14:59:22.307125 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.306955 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/94ed28ce-c78a-460e-bea9-5cbc1b62dcec-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5cf494c86c-c28ct\" (UID: \"94ed28ce-c78a-460e-bea9-5cbc1b62dcec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf494c86c-c28ct" May 21 14:59:22.307125 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.307049 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/94ed28ce-c78a-460e-bea9-5cbc1b62dcec-ca\") pod \"cluster-proxy-proxy-agent-5cf494c86c-c28ct\" (UID: \"94ed28ce-c78a-460e-bea9-5cbc1b62dcec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf494c86c-c28ct" May 21 14:59:22.307125 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.307098 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/94ed28ce-c78a-460e-bea9-5cbc1b62dcec-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-5cf494c86c-c28ct\" (UID: \"94ed28ce-c78a-460e-bea9-5cbc1b62dcec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf494c86c-c28ct" May 21 14:59:22.408446 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.408354 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/94ed28ce-c78a-460e-bea9-5cbc1b62dcec-ca\") pod \"cluster-proxy-proxy-agent-5cf494c86c-c28ct\" (UID: \"94ed28ce-c78a-460e-bea9-5cbc1b62dcec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf494c86c-c28ct" May 21 14:59:22.408446 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.408448 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/94ed28ce-c78a-460e-bea9-5cbc1b62dcec-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-5cf494c86c-c28ct\" (UID: \"94ed28ce-c78a-460e-bea9-5cbc1b62dcec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf494c86c-c28ct" May 21 14:59:22.408630 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.408496 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-whqvp\" (UniqueName: \"kubernetes.io/projected/94ed28ce-c78a-460e-bea9-5cbc1b62dcec-kube-api-access-whqvp\") pod \"cluster-proxy-proxy-agent-5cf494c86c-c28ct\" (UID: \"94ed28ce-c78a-460e-bea9-5cbc1b62dcec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf494c86c-c28ct" May 21 14:59:22.408630 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.408521 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/94ed28ce-c78a-460e-bea9-5cbc1b62dcec-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5cf494c86c-c28ct\" (UID: \"94ed28ce-c78a-460e-bea9-5cbc1b62dcec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf494c86c-c28ct" May 21 14:59:22.408630 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.408544 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/94ed28ce-c78a-460e-bea9-5cbc1b62dcec-hub\") pod \"cluster-proxy-proxy-agent-5cf494c86c-c28ct\" (UID: \"94ed28ce-c78a-460e-bea9-5cbc1b62dcec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf494c86c-c28ct" May 21 14:59:22.408630 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.408585 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/94ed28ce-c78a-460e-bea9-5cbc1b62dcec-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5cf494c86c-c28ct\" (UID: \"94ed28ce-c78a-460e-bea9-5cbc1b62dcec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf494c86c-c28ct" May 21 14:59:22.409371 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.409339 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/94ed28ce-c78a-460e-bea9-5cbc1b62dcec-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-5cf494c86c-c28ct\" (UID: \"94ed28ce-c78a-460e-bea9-5cbc1b62dcec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf494c86c-c28ct" May 21 14:59:22.410114 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.410092 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-94f48499b-45stv" May 21 14:59:22.411149 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.411129 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/94ed28ce-c78a-460e-bea9-5cbc1b62dcec-ca\") pod \"cluster-proxy-proxy-agent-5cf494c86c-c28ct\" (UID: \"94ed28ce-c78a-460e-bea9-5cbc1b62dcec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf494c86c-c28ct" May 21 14:59:22.411366 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.411348 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/94ed28ce-c78a-460e-bea9-5cbc1b62dcec-hub\") pod \"cluster-proxy-proxy-agent-5cf494c86c-c28ct\" (UID: \"94ed28ce-c78a-460e-bea9-5cbc1b62dcec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf494c86c-c28ct" May 21 14:59:22.411407 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.411379 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/94ed28ce-c78a-460e-bea9-5cbc1b62dcec-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5cf494c86c-c28ct\" (UID: \"94ed28ce-c78a-460e-bea9-5cbc1b62dcec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf494c86c-c28ct" May 21 14:59:22.411443 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.411404 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/94ed28ce-c78a-460e-bea9-5cbc1b62dcec-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5cf494c86c-c28ct\" (UID: \"94ed28ce-c78a-460e-bea9-5cbc1b62dcec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf494c86c-c28ct" May 21 14:59:22.416644 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.416624 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whqvp\" (UniqueName: \"kubernetes.io/projected/94ed28ce-c78a-460e-bea9-5cbc1b62dcec-kube-api-access-whqvp\") pod \"cluster-proxy-proxy-agent-5cf494c86c-c28ct\" (UID: \"94ed28ce-c78a-460e-bea9-5cbc1b62dcec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf494c86c-c28ct" May 21 14:59:22.531804 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.531771 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf494c86c-c28ct" May 21 14:59:22.550663 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.550636 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-94f48499b-45stv"] May 21 14:59:22.553506 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:59:22.553479 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4fff8744_ab81_433b_a0b9_2d4e8c646428.slice/crio-9a96ed5a6e371295db646ffb846b1f9285e5e8a631d52ecab95649f1de32f6c1 WatchSource:0}: Error finding container 9a96ed5a6e371295db646ffb846b1f9285e5e8a631d52ecab95649f1de32f6c1: Status 404 returned error can't find the container with id 9a96ed5a6e371295db646ffb846b1f9285e5e8a631d52ecab95649f1de32f6c1 May 21 14:59:22.664946 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:22.664919 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf494c86c-c28ct"] May 21 14:59:22.667378 ip-10-0-137-49 kubenswrapper[2557]: W0521 14:59:22.667350 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94ed28ce_c78a_460e_bea9_5cbc1b62dcec.slice/crio-e464a1474ff3ce96725d56eee50104a2802832f4383f5c92311ccffdaeb14028 WatchSource:0}: Error finding container e464a1474ff3ce96725d56eee50104a2802832f4383f5c92311ccffdaeb14028: Status 404 returned error can't find the container with id e464a1474ff3ce96725d56eee50104a2802832f4383f5c92311ccffdaeb14028 May 21 14:59:23.155402 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:23.155361 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf494c86c-c28ct" event={"ID":"94ed28ce-c78a-460e-bea9-5cbc1b62dcec","Type":"ContainerStarted","Data":"e464a1474ff3ce96725d56eee50104a2802832f4383f5c92311ccffdaeb14028"} May 21 14:59:23.156415 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:23.156392 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-94f48499b-45stv" event={"ID":"4fff8744-ab81-433b-a0b9-2d4e8c646428","Type":"ContainerStarted","Data":"9a96ed5a6e371295db646ffb846b1f9285e5e8a631d52ecab95649f1de32f6c1"} May 21 14:59:27.176926 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:27.176891 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf494c86c-c28ct" event={"ID":"94ed28ce-c78a-460e-bea9-5cbc1b62dcec","Type":"ContainerStarted","Data":"21504e45349c4ad714df16205106540551d2838ed0e80459d992b9e478a0840e"} May 21 14:59:27.178369 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:27.178342 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-94f48499b-45stv" event={"ID":"4fff8744-ab81-433b-a0b9-2d4e8c646428","Type":"ContainerStarted","Data":"9d2268b9cbffb1ae7d1be9dbb42a1fd89dedfb769c39406e883cb40e22644847"} May 21 14:59:27.198644 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:27.198572 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-94f48499b-45stv" podStartSLOduration=1.233600667 podStartE2EDuration="5.198557568s" podCreationTimestamp="2026-05-21 14:59:22 +0000 UTC" firstStartedPulling="2026-05-21 14:59:22.555297491 +0000 UTC m=+289.851173370" lastFinishedPulling="2026-05-21 14:59:26.520254392 +0000 UTC m=+293.816130271" observedRunningTime="2026-05-21 14:59:27.197470796 +0000 UTC m=+294.493346698" watchObservedRunningTime="2026-05-21 14:59:27.198557568 +0000 UTC m=+294.494433469" May 21 14:59:30.189896 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:30.189860 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf494c86c-c28ct" event={"ID":"94ed28ce-c78a-460e-bea9-5cbc1b62dcec","Type":"ContainerStarted","Data":"08b2a8b406817855d7919f927f3a9efe8cb2918b0d0d5e28ad643197d59e48e2"} May 21 14:59:30.189896 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:30.189901 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf494c86c-c28ct" event={"ID":"94ed28ce-c78a-460e-bea9-5cbc1b62dcec","Type":"ContainerStarted","Data":"422e0b6258b17597809b895655154a55cd65cd86d83a1255c0b6d0f0f65bc42f"} May 21 14:59:30.211954 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:30.211899 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5cf494c86c-c28ct" podStartSLOduration=1.688213698 podStartE2EDuration="8.211883145s" podCreationTimestamp="2026-05-21 14:59:22 +0000 UTC" firstStartedPulling="2026-05-21 14:59:22.669129724 +0000 UTC m=+289.965005604" lastFinishedPulling="2026-05-21 14:59:29.192799163 +0000 UTC m=+296.488675051" observedRunningTime="2026-05-21 14:59:30.21087251 +0000 UTC m=+297.506748434" watchObservedRunningTime="2026-05-21 14:59:30.211883145 +0000 UTC m=+297.507759045" May 21 14:59:33.193750 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:33.193709 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qfg49_c1ee545c-62b8-4223-8c79-c00a1a036620/console-operator/2.log" May 21 14:59:33.195308 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:33.195279 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qfg49_c1ee545c-62b8-4223-8c79-c00a1a036620/console-operator/2.log" May 21 14:59:33.203505 ip-10-0-137-49 kubenswrapper[2557]: I0521 14:59:33.203481 2557 kubelet.go:1628] "Image garbage collection succeeded" May 21 15:00:08.283696 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:08.283637 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-677f98f9b9-d6ztp"] May 21 15:00:08.291934 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:08.291913 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-d6ztp" May 21 15:00:08.296191 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:08.296166 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 21 15:00:08.296446 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:08.296431 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 21 15:00:08.305430 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:08.305401 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 21 15:00:08.305556 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:08.305408 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 21 15:00:08.305716 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:08.305699 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-s2xc7\"" May 21 15:00:08.313044 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:08.313016 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-677f98f9b9-d6ztp"] May 21 15:00:08.391367 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:08.391328 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmz78\" (UniqueName: \"kubernetes.io/projected/0cf3e54b-3c3d-4ba8-9bd0-af5e5c094c1e-kube-api-access-fmz78\") pod \"opendatahub-operator-controller-manager-677f98f9b9-d6ztp\" (UID: \"0cf3e54b-3c3d-4ba8-9bd0-af5e5c094c1e\") " pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-d6ztp" May 21 15:00:08.391542 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:08.391391 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0cf3e54b-3c3d-4ba8-9bd0-af5e5c094c1e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-677f98f9b9-d6ztp\" (UID: \"0cf3e54b-3c3d-4ba8-9bd0-af5e5c094c1e\") " pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-d6ztp" May 21 15:00:08.391542 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:08.391434 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0cf3e54b-3c3d-4ba8-9bd0-af5e5c094c1e-webhook-cert\") pod \"opendatahub-operator-controller-manager-677f98f9b9-d6ztp\" (UID: \"0cf3e54b-3c3d-4ba8-9bd0-af5e5c094c1e\") " pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-d6ztp" May 21 15:00:08.492648 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:08.492603 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fmz78\" (UniqueName: \"kubernetes.io/projected/0cf3e54b-3c3d-4ba8-9bd0-af5e5c094c1e-kube-api-access-fmz78\") pod \"opendatahub-operator-controller-manager-677f98f9b9-d6ztp\" (UID: \"0cf3e54b-3c3d-4ba8-9bd0-af5e5c094c1e\") " pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-d6ztp" May 21 15:00:08.492817 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:08.492661 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0cf3e54b-3c3d-4ba8-9bd0-af5e5c094c1e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-677f98f9b9-d6ztp\" (UID: \"0cf3e54b-3c3d-4ba8-9bd0-af5e5c094c1e\") " pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-d6ztp" May 21 15:00:08.492817 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:08.492695 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0cf3e54b-3c3d-4ba8-9bd0-af5e5c094c1e-webhook-cert\") pod \"opendatahub-operator-controller-manager-677f98f9b9-d6ztp\" (UID: \"0cf3e54b-3c3d-4ba8-9bd0-af5e5c094c1e\") " pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-d6ztp" May 21 15:00:08.495360 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:08.495322 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0cf3e54b-3c3d-4ba8-9bd0-af5e5c094c1e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-677f98f9b9-d6ztp\" (UID: \"0cf3e54b-3c3d-4ba8-9bd0-af5e5c094c1e\") " pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-d6ztp" May 21 15:00:08.495360 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:08.495331 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0cf3e54b-3c3d-4ba8-9bd0-af5e5c094c1e-webhook-cert\") pod \"opendatahub-operator-controller-manager-677f98f9b9-d6ztp\" (UID: \"0cf3e54b-3c3d-4ba8-9bd0-af5e5c094c1e\") " pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-d6ztp" May 21 15:00:08.503706 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:08.503681 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmz78\" (UniqueName: \"kubernetes.io/projected/0cf3e54b-3c3d-4ba8-9bd0-af5e5c094c1e-kube-api-access-fmz78\") pod \"opendatahub-operator-controller-manager-677f98f9b9-d6ztp\" (UID: \"0cf3e54b-3c3d-4ba8-9bd0-af5e5c094c1e\") " pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-d6ztp" May 21 15:00:08.602551 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:08.602459 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-d6ztp" May 21 15:00:08.744620 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:08.744580 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-677f98f9b9-d6ztp"] May 21 15:00:08.748446 ip-10-0-137-49 kubenswrapper[2557]: W0521 15:00:08.748407 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cf3e54b_3c3d_4ba8_9bd0_af5e5c094c1e.slice/crio-3e09f1628ddd6ccbe01be5e8fb281ed7686bc8b842f9a7d43fc16e13d146fd35 WatchSource:0}: Error finding container 3e09f1628ddd6ccbe01be5e8fb281ed7686bc8b842f9a7d43fc16e13d146fd35: Status 404 returned error can't find the container with id 3e09f1628ddd6ccbe01be5e8fb281ed7686bc8b842f9a7d43fc16e13d146fd35 May 21 15:00:08.750080 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:08.750062 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 15:00:09.300967 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:09.300921 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-d6ztp" event={"ID":"0cf3e54b-3c3d-4ba8-9bd0-af5e5c094c1e","Type":"ContainerStarted","Data":"3e09f1628ddd6ccbe01be5e8fb281ed7686bc8b842f9a7d43fc16e13d146fd35"} May 21 15:00:12.313580 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:12.313544 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-d6ztp" event={"ID":"0cf3e54b-3c3d-4ba8-9bd0-af5e5c094c1e","Type":"ContainerStarted","Data":"5323aa4d39b701a9529590af9d88240ce8043dea83e8a2e1723fee6854207df1"} May 21 15:00:12.314005 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:12.313594 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-d6ztp" May 21 15:00:12.354378 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:12.354318 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-d6ztp" podStartSLOduration=1.571425794 podStartE2EDuration="4.35429988s" podCreationTimestamp="2026-05-21 15:00:08 +0000 UTC" firstStartedPulling="2026-05-21 15:00:08.75018422 +0000 UTC m=+336.046060099" lastFinishedPulling="2026-05-21 15:00:11.533058306 +0000 UTC m=+338.828934185" observedRunningTime="2026-05-21 15:00:12.352054957 +0000 UTC m=+339.647930860" watchObservedRunningTime="2026-05-21 15:00:12.35429988 +0000 UTC m=+339.650175781" May 21 15:00:23.319603 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:23.319525 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-677f98f9b9-d6ztp" May 21 15:00:27.071969 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:27.071926 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-855b467995-gqhpp"] May 21 15:00:27.074353 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:27.074330 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-855b467995-gqhpp" May 21 15:00:27.076902 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:27.076878 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 21 15:00:27.077909 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:27.077885 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 21 15:00:27.078062 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:27.077919 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-drxx5\"" May 21 15:00:27.086001 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:27.085953 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-855b467995-gqhpp"] May 21 15:00:27.139276 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:27.139242 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c7v5\" (UniqueName: \"kubernetes.io/projected/ecf94b41-227e-4d71-969e-4f3177ff8025-kube-api-access-7c7v5\") pod \"kube-auth-proxy-855b467995-gqhpp\" (UID: \"ecf94b41-227e-4d71-969e-4f3177ff8025\") " pod="openshift-ingress/kube-auth-proxy-855b467995-gqhpp" May 21 15:00:27.139276 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:27.139288 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecf94b41-227e-4d71-969e-4f3177ff8025-tmp\") pod \"kube-auth-proxy-855b467995-gqhpp\" (UID: \"ecf94b41-227e-4d71-969e-4f3177ff8025\") " pod="openshift-ingress/kube-auth-proxy-855b467995-gqhpp" May 21 15:00:27.139501 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:27.139320 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecf94b41-227e-4d71-969e-4f3177ff8025-tls-certs\") pod \"kube-auth-proxy-855b467995-gqhpp\" (UID: \"ecf94b41-227e-4d71-969e-4f3177ff8025\") " pod="openshift-ingress/kube-auth-proxy-855b467995-gqhpp" May 21 15:00:27.240006 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:27.239946 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecf94b41-227e-4d71-969e-4f3177ff8025-tls-certs\") pod \"kube-auth-proxy-855b467995-gqhpp\" (UID: \"ecf94b41-227e-4d71-969e-4f3177ff8025\") " pod="openshift-ingress/kube-auth-proxy-855b467995-gqhpp" May 21 15:00:27.240186 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:27.240061 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7c7v5\" (UniqueName: \"kubernetes.io/projected/ecf94b41-227e-4d71-969e-4f3177ff8025-kube-api-access-7c7v5\") pod \"kube-auth-proxy-855b467995-gqhpp\" (UID: \"ecf94b41-227e-4d71-969e-4f3177ff8025\") " pod="openshift-ingress/kube-auth-proxy-855b467995-gqhpp" May 21 15:00:27.240186 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:27.240091 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecf94b41-227e-4d71-969e-4f3177ff8025-tmp\") pod \"kube-auth-proxy-855b467995-gqhpp\" (UID: \"ecf94b41-227e-4d71-969e-4f3177ff8025\") " pod="openshift-ingress/kube-auth-proxy-855b467995-gqhpp" May 21 15:00:27.242319 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:27.242291 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecf94b41-227e-4d71-969e-4f3177ff8025-tmp\") pod \"kube-auth-proxy-855b467995-gqhpp\" (UID: \"ecf94b41-227e-4d71-969e-4f3177ff8025\") " pod="openshift-ingress/kube-auth-proxy-855b467995-gqhpp" May 21 15:00:27.242628 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:27.242605 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecf94b41-227e-4d71-969e-4f3177ff8025-tls-certs\") pod \"kube-auth-proxy-855b467995-gqhpp\" (UID: \"ecf94b41-227e-4d71-969e-4f3177ff8025\") " pod="openshift-ingress/kube-auth-proxy-855b467995-gqhpp" May 21 15:00:27.250473 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:27.250446 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c7v5\" (UniqueName: \"kubernetes.io/projected/ecf94b41-227e-4d71-969e-4f3177ff8025-kube-api-access-7c7v5\") pod \"kube-auth-proxy-855b467995-gqhpp\" (UID: \"ecf94b41-227e-4d71-969e-4f3177ff8025\") " pod="openshift-ingress/kube-auth-proxy-855b467995-gqhpp" May 21 15:00:27.384031 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:27.383920 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-855b467995-gqhpp" May 21 15:00:27.520912 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:27.520882 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-855b467995-gqhpp"] May 21 15:00:27.523636 ip-10-0-137-49 kubenswrapper[2557]: W0521 15:00:27.523603 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecf94b41_227e_4d71_969e_4f3177ff8025.slice/crio-669a50411b3992efeaa91386093d13e961d962cc1da2b30aa58d00286589ac87 WatchSource:0}: Error finding container 669a50411b3992efeaa91386093d13e961d962cc1da2b30aa58d00286589ac87: Status 404 returned error can't find the container with id 669a50411b3992efeaa91386093d13e961d962cc1da2b30aa58d00286589ac87 May 21 15:00:28.362968 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:28.362905 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-855b467995-gqhpp" event={"ID":"ecf94b41-227e-4d71-969e-4f3177ff8025","Type":"ContainerStarted","Data":"669a50411b3992efeaa91386093d13e961d962cc1da2b30aa58d00286589ac87"} May 21 15:00:29.707703 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:29.707664 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-b226r"] May 21 15:00:29.709761 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:29.709741 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-b226r" May 21 15:00:29.712256 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:29.712231 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" May 21 15:00:29.712370 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:29.712232 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-6v4pj\"" May 21 15:00:29.719395 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:29.719351 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-b226r"] May 21 15:00:29.764086 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:29.764048 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1321bcaa-ae92-4c5f-a5fd-3d6f312850bd-cert\") pod \"odh-model-controller-858dbf95b8-b226r\" (UID: \"1321bcaa-ae92-4c5f-a5fd-3d6f312850bd\") " pod="opendatahub/odh-model-controller-858dbf95b8-b226r" May 21 15:00:29.764264 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:29.764101 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc8kf\" (UniqueName: \"kubernetes.io/projected/1321bcaa-ae92-4c5f-a5fd-3d6f312850bd-kube-api-access-vc8kf\") pod \"odh-model-controller-858dbf95b8-b226r\" (UID: \"1321bcaa-ae92-4c5f-a5fd-3d6f312850bd\") " pod="opendatahub/odh-model-controller-858dbf95b8-b226r" May 21 15:00:29.865302 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:29.865256 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1321bcaa-ae92-4c5f-a5fd-3d6f312850bd-cert\") pod \"odh-model-controller-858dbf95b8-b226r\" (UID: \"1321bcaa-ae92-4c5f-a5fd-3d6f312850bd\") " pod="opendatahub/odh-model-controller-858dbf95b8-b226r" May 21 15:00:29.865302 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:29.865308 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vc8kf\" (UniqueName: \"kubernetes.io/projected/1321bcaa-ae92-4c5f-a5fd-3d6f312850bd-kube-api-access-vc8kf\") pod \"odh-model-controller-858dbf95b8-b226r\" (UID: \"1321bcaa-ae92-4c5f-a5fd-3d6f312850bd\") " pod="opendatahub/odh-model-controller-858dbf95b8-b226r" May 21 15:00:29.865528 ip-10-0-137-49 kubenswrapper[2557]: E0521 15:00:29.865397 2557 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 21 15:00:29.865528 ip-10-0-137-49 kubenswrapper[2557]: E0521 15:00:29.865461 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1321bcaa-ae92-4c5f-a5fd-3d6f312850bd-cert podName:1321bcaa-ae92-4c5f-a5fd-3d6f312850bd nodeName:}" failed. No retries permitted until 2026-05-21 15:00:30.365444827 +0000 UTC m=+357.661320711 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1321bcaa-ae92-4c5f-a5fd-3d6f312850bd-cert") pod "odh-model-controller-858dbf95b8-b226r" (UID: "1321bcaa-ae92-4c5f-a5fd-3d6f312850bd") : secret "odh-model-controller-webhook-cert" not found May 21 15:00:29.874573 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:29.874542 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc8kf\" (UniqueName: \"kubernetes.io/projected/1321bcaa-ae92-4c5f-a5fd-3d6f312850bd-kube-api-access-vc8kf\") pod \"odh-model-controller-858dbf95b8-b226r\" (UID: \"1321bcaa-ae92-4c5f-a5fd-3d6f312850bd\") " pod="opendatahub/odh-model-controller-858dbf95b8-b226r" May 21 15:00:30.370552 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:30.370503 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1321bcaa-ae92-4c5f-a5fd-3d6f312850bd-cert\") pod \"odh-model-controller-858dbf95b8-b226r\" (UID: \"1321bcaa-ae92-4c5f-a5fd-3d6f312850bd\") " pod="opendatahub/odh-model-controller-858dbf95b8-b226r" May 21 15:00:30.370740 ip-10-0-137-49 kubenswrapper[2557]: E0521 15:00:30.370639 2557 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 21 15:00:30.370740 ip-10-0-137-49 kubenswrapper[2557]: E0521 15:00:30.370707 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1321bcaa-ae92-4c5f-a5fd-3d6f312850bd-cert podName:1321bcaa-ae92-4c5f-a5fd-3d6f312850bd nodeName:}" failed. No retries permitted until 2026-05-21 15:00:31.370685565 +0000 UTC m=+358.666561463 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1321bcaa-ae92-4c5f-a5fd-3d6f312850bd-cert") pod "odh-model-controller-858dbf95b8-b226r" (UID: "1321bcaa-ae92-4c5f-a5fd-3d6f312850bd") : secret "odh-model-controller-webhook-cert" not found May 21 15:00:31.374876 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:31.374837 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-855b467995-gqhpp" event={"ID":"ecf94b41-227e-4d71-969e-4f3177ff8025","Type":"ContainerStarted","Data":"7103cfe57ceb9809675a9dd3d96091b20ae4015fd1d0e2af06b627e9725aab38"} May 21 15:00:31.380507 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:31.380478 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1321bcaa-ae92-4c5f-a5fd-3d6f312850bd-cert\") pod \"odh-model-controller-858dbf95b8-b226r\" (UID: \"1321bcaa-ae92-4c5f-a5fd-3d6f312850bd\") " pod="opendatahub/odh-model-controller-858dbf95b8-b226r" May 21 15:00:31.382917 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:31.382897 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1321bcaa-ae92-4c5f-a5fd-3d6f312850bd-cert\") pod \"odh-model-controller-858dbf95b8-b226r\" (UID: \"1321bcaa-ae92-4c5f-a5fd-3d6f312850bd\") " pod="opendatahub/odh-model-controller-858dbf95b8-b226r" May 21 15:00:31.394356 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:31.394306 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-855b467995-gqhpp" podStartSLOduration=1.36548725 podStartE2EDuration="4.394292656s" podCreationTimestamp="2026-05-21 15:00:27 +0000 UTC" firstStartedPulling="2026-05-21 15:00:27.525356259 +0000 UTC m=+354.821232138" lastFinishedPulling="2026-05-21 15:00:30.554161666 +0000 UTC m=+357.850037544" observedRunningTime="2026-05-21 15:00:31.393145198 +0000 UTC m=+358.689021103" watchObservedRunningTime="2026-05-21 15:00:31.394292656 +0000 UTC m=+358.690168576" May 21 15:00:31.520425 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:31.520378 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-b226r" May 21 15:00:31.666361 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:31.666046 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-b226r"] May 21 15:00:31.668639 ip-10-0-137-49 kubenswrapper[2557]: W0521 15:00:31.668604 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1321bcaa_ae92_4c5f_a5fd_3d6f312850bd.slice/crio-5ec67dae4c23bbbd4f16eec34e90732635f8f53d2ddd1c7eea34052a027dcacf WatchSource:0}: Error finding container 5ec67dae4c23bbbd4f16eec34e90732635f8f53d2ddd1c7eea34052a027dcacf: Status 404 returned error can't find the container with id 5ec67dae4c23bbbd4f16eec34e90732635f8f53d2ddd1c7eea34052a027dcacf May 21 15:00:32.380820 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:32.380774 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-b226r" event={"ID":"1321bcaa-ae92-4c5f-a5fd-3d6f312850bd","Type":"ContainerStarted","Data":"5ec67dae4c23bbbd4f16eec34e90732635f8f53d2ddd1c7eea34052a027dcacf"} May 21 15:00:35.395156 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:35.395110 2557 generic.go:358] "Generic (PLEG): container finished" podID="1321bcaa-ae92-4c5f-a5fd-3d6f312850bd" containerID="ca2dcbb18bba7c2775bbba592a1fb262a40d1c53b949de943b746cf3f4eebcaa" exitCode=1 May 21 15:00:35.395593 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:35.395198 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-b226r" event={"ID":"1321bcaa-ae92-4c5f-a5fd-3d6f312850bd","Type":"ContainerDied","Data":"ca2dcbb18bba7c2775bbba592a1fb262a40d1c53b949de943b746cf3f4eebcaa"} May 21 15:00:35.395593 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:35.395514 2557 scope.go:117] "RemoveContainer" containerID="ca2dcbb18bba7c2775bbba592a1fb262a40d1c53b949de943b746cf3f4eebcaa" May 21 15:00:35.459866 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:35.459831 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-7n5mv"] May 21 15:00:35.462198 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:35.462181 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-7n5mv" May 21 15:00:35.464658 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:35.464638 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-m6w9d\"" May 21 15:00:35.464878 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:35.464861 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" May 21 15:00:35.473132 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:35.473107 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-7n5mv"] May 21 15:00:35.517394 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:35.517358 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec234a89-1af0-4d45-994f-798dcc61ef77-cert\") pod \"kserve-controller-manager-856948b99f-7n5mv\" (UID: \"ec234a89-1af0-4d45-994f-798dcc61ef77\") " pod="opendatahub/kserve-controller-manager-856948b99f-7n5mv" May 21 15:00:35.517541 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:35.517415 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mpqn\" (UniqueName: \"kubernetes.io/projected/ec234a89-1af0-4d45-994f-798dcc61ef77-kube-api-access-7mpqn\") pod \"kserve-controller-manager-856948b99f-7n5mv\" (UID: \"ec234a89-1af0-4d45-994f-798dcc61ef77\") " pod="opendatahub/kserve-controller-manager-856948b99f-7n5mv" May 21 15:00:35.618869 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:35.618822 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec234a89-1af0-4d45-994f-798dcc61ef77-cert\") pod \"kserve-controller-manager-856948b99f-7n5mv\" (UID: \"ec234a89-1af0-4d45-994f-798dcc61ef77\") " pod="opendatahub/kserve-controller-manager-856948b99f-7n5mv" May 21 15:00:35.618869 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:35.618875 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7mpqn\" (UniqueName: \"kubernetes.io/projected/ec234a89-1af0-4d45-994f-798dcc61ef77-kube-api-access-7mpqn\") pod \"kserve-controller-manager-856948b99f-7n5mv\" (UID: \"ec234a89-1af0-4d45-994f-798dcc61ef77\") " pod="opendatahub/kserve-controller-manager-856948b99f-7n5mv" May 21 15:00:35.619158 ip-10-0-137-49 kubenswrapper[2557]: E0521 15:00:35.619020 2557 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found May 21 15:00:35.619158 ip-10-0-137-49 kubenswrapper[2557]: E0521 15:00:35.619113 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec234a89-1af0-4d45-994f-798dcc61ef77-cert podName:ec234a89-1af0-4d45-994f-798dcc61ef77 nodeName:}" failed. No retries permitted until 2026-05-21 15:00:36.119089641 +0000 UTC m=+363.414965535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ec234a89-1af0-4d45-994f-798dcc61ef77-cert") pod "kserve-controller-manager-856948b99f-7n5mv" (UID: "ec234a89-1af0-4d45-994f-798dcc61ef77") : secret "kserve-webhook-server-cert" not found May 21 15:00:35.632108 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:35.632080 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mpqn\" (UniqueName: \"kubernetes.io/projected/ec234a89-1af0-4d45-994f-798dcc61ef77-kube-api-access-7mpqn\") pod \"kserve-controller-manager-856948b99f-7n5mv\" (UID: \"ec234a89-1af0-4d45-994f-798dcc61ef77\") " pod="opendatahub/kserve-controller-manager-856948b99f-7n5mv" May 21 15:00:36.124581 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:36.124487 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec234a89-1af0-4d45-994f-798dcc61ef77-cert\") pod \"kserve-controller-manager-856948b99f-7n5mv\" (UID: \"ec234a89-1af0-4d45-994f-798dcc61ef77\") " pod="opendatahub/kserve-controller-manager-856948b99f-7n5mv" May 21 15:00:36.126948 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:36.126912 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec234a89-1af0-4d45-994f-798dcc61ef77-cert\") pod \"kserve-controller-manager-856948b99f-7n5mv\" (UID: \"ec234a89-1af0-4d45-994f-798dcc61ef77\") " pod="opendatahub/kserve-controller-manager-856948b99f-7n5mv" May 21 15:00:36.372399 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:36.372356 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-7n5mv" May 21 15:00:36.402045 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:36.402002 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-b226r" event={"ID":"1321bcaa-ae92-4c5f-a5fd-3d6f312850bd","Type":"ContainerStarted","Data":"b1cde4d12ee2b87b23f78bda0f0e3f2ad50c11da96357a198807b685307daa63"} May 21 15:00:36.402532 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:36.402513 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-b226r" May 21 15:00:36.420966 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:36.420901 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-b226r" podStartSLOduration=3.4040492860000002 podStartE2EDuration="7.420878382s" podCreationTimestamp="2026-05-21 15:00:29 +0000 UTC" firstStartedPulling="2026-05-21 15:00:31.670090487 +0000 UTC m=+358.965966371" lastFinishedPulling="2026-05-21 15:00:35.686919571 +0000 UTC m=+362.982795467" observedRunningTime="2026-05-21 15:00:36.420048359 +0000 UTC m=+363.715924261" watchObservedRunningTime="2026-05-21 15:00:36.420878382 +0000 UTC m=+363.716754284" May 21 15:00:36.516297 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:36.516163 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-7n5mv"] May 21 15:00:36.519268 ip-10-0-137-49 kubenswrapper[2557]: W0521 15:00:36.519241 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec234a89_1af0_4d45_994f_798dcc61ef77.slice/crio-9afdbdb6f8331832a899859c1c7027fee4254e6565983bab0ade142b3190c806 WatchSource:0}: Error finding container 9afdbdb6f8331832a899859c1c7027fee4254e6565983bab0ade142b3190c806: Status 404 returned error can't find the container with id 9afdbdb6f8331832a899859c1c7027fee4254e6565983bab0ade142b3190c806 May 21 15:00:37.407791 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:37.407746 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-7n5mv" event={"ID":"ec234a89-1af0-4d45-994f-798dcc61ef77","Type":"ContainerStarted","Data":"9afdbdb6f8331832a899859c1c7027fee4254e6565983bab0ade142b3190c806"} May 21 15:00:40.418477 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:40.418373 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-7n5mv" event={"ID":"ec234a89-1af0-4d45-994f-798dcc61ef77","Type":"ContainerStarted","Data":"747b905e7e97ac4657dde4bd6e0be2168feb68d03658b459a3a8effd82de0851"} May 21 15:00:40.418477 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:40.418447 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-7n5mv" May 21 15:00:40.443059 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:40.443009 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-7n5mv" podStartSLOduration=1.9195749869999998 podStartE2EDuration="5.442992056s" podCreationTimestamp="2026-05-21 15:00:35 +0000 UTC" firstStartedPulling="2026-05-21 15:00:36.521369183 +0000 UTC m=+363.817245062" lastFinishedPulling="2026-05-21 15:00:40.044786252 +0000 UTC m=+367.340662131" observedRunningTime="2026-05-21 15:00:40.442006696 +0000 UTC m=+367.737882592" watchObservedRunningTime="2026-05-21 15:00:40.442992056 +0000 UTC m=+367.738867948" May 21 15:00:46.390564 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:46.390530 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-272nl"] May 21 15:00:46.398248 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:46.398222 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-272nl" May 21 15:00:46.401077 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:46.401044 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" May 21 15:00:46.401233 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:46.401095 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-l8n59\"" May 21 15:00:46.401547 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:46.401528 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" May 21 15:00:46.414019 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:46.409497 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-272nl"] May 21 15:00:46.520640 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:46.520599 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thrxg\" (UniqueName: \"kubernetes.io/projected/8ed2c706-3ce2-4a43-8186-32723b4d345d-kube-api-access-thrxg\") pod \"servicemesh-operator3-55f49c5f94-272nl\" (UID: \"8ed2c706-3ce2-4a43-8186-32723b4d345d\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-272nl" May 21 15:00:46.520821 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:46.520646 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/8ed2c706-3ce2-4a43-8186-32723b4d345d-operator-config\") pod \"servicemesh-operator3-55f49c5f94-272nl\" (UID: \"8ed2c706-3ce2-4a43-8186-32723b4d345d\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-272nl" May 21 15:00:46.621428 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:46.621380 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-thrxg\" (UniqueName: \"kubernetes.io/projected/8ed2c706-3ce2-4a43-8186-32723b4d345d-kube-api-access-thrxg\") pod \"servicemesh-operator3-55f49c5f94-272nl\" (UID: \"8ed2c706-3ce2-4a43-8186-32723b4d345d\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-272nl" May 21 15:00:46.621640 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:46.621434 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/8ed2c706-3ce2-4a43-8186-32723b4d345d-operator-config\") pod \"servicemesh-operator3-55f49c5f94-272nl\" (UID: \"8ed2c706-3ce2-4a43-8186-32723b4d345d\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-272nl" May 21 15:00:46.623971 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:46.623948 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/8ed2c706-3ce2-4a43-8186-32723b4d345d-operator-config\") pod \"servicemesh-operator3-55f49c5f94-272nl\" (UID: \"8ed2c706-3ce2-4a43-8186-32723b4d345d\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-272nl" May 21 15:00:46.630070 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:46.630038 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thrxg\" (UniqueName: \"kubernetes.io/projected/8ed2c706-3ce2-4a43-8186-32723b4d345d-kube-api-access-thrxg\") pod \"servicemesh-operator3-55f49c5f94-272nl\" (UID: \"8ed2c706-3ce2-4a43-8186-32723b4d345d\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-272nl" May 21 15:00:46.709057 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:46.709018 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-272nl" May 21 15:00:46.851158 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:46.851070 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-272nl"] May 21 15:00:46.854055 ip-10-0-137-49 kubenswrapper[2557]: W0521 15:00:46.854026 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ed2c706_3ce2_4a43_8186_32723b4d345d.slice/crio-bf717f1ca823a782dcacc1537308f73049860f1f87d3cbda07c471bc5e190397 WatchSource:0}: Error finding container bf717f1ca823a782dcacc1537308f73049860f1f87d3cbda07c471bc5e190397: Status 404 returned error can't find the container with id bf717f1ca823a782dcacc1537308f73049860f1f87d3cbda07c471bc5e190397 May 21 15:00:47.410200 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:47.410173 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-b226r" May 21 15:00:47.440685 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:47.440640 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-272nl" event={"ID":"8ed2c706-3ce2-4a43-8186-32723b4d345d","Type":"ContainerStarted","Data":"bf717f1ca823a782dcacc1537308f73049860f1f87d3cbda07c471bc5e190397"} May 21 15:00:51.457181 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:51.457144 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-272nl" event={"ID":"8ed2c706-3ce2-4a43-8186-32723b4d345d","Type":"ContainerStarted","Data":"f352681e30b75fda931c22ea4a7e30aa625cfbd55f8d59fc1c0aca4052d5f410"} May 21 15:00:51.457596 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:51.457360 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-272nl" May 21 15:00:51.478385 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:51.478332 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-272nl" podStartSLOduration=1.600164535 podStartE2EDuration="5.478314931s" podCreationTimestamp="2026-05-21 15:00:46 +0000 UTC" firstStartedPulling="2026-05-21 15:00:46.856822806 +0000 UTC m=+374.152698689" lastFinishedPulling="2026-05-21 15:00:50.734973202 +0000 UTC m=+378.030849085" observedRunningTime="2026-05-21 15:00:51.477342136 +0000 UTC m=+378.773218036" watchObservedRunningTime="2026-05-21 15:00:51.478314931 +0000 UTC m=+378.774190832" May 21 15:00:56.914215 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:56.914176 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4"] May 21 15:00:56.917801 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:56.917773 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4" May 21 15:00:56.921061 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:56.921034 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" May 21 15:00:56.921210 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:56.921034 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" May 21 15:00:56.921210 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:56.921046 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" May 21 15:00:56.921323 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:56.921299 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 21 15:00:56.921391 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:56.921375 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-22xcq\"" May 21 15:00:56.935609 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:56.935574 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4"] May 21 15:00:57.109520 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:57.109481 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4eb5a51-0c60-405e-9127-f1fedcfcf82e-istio-token\") pod \"istiod-openshift-gateway-798958bb55-d7lx4\" (UID: \"e4eb5a51-0c60-405e-9127-f1fedcfcf82e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4" May 21 15:00:57.109520 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:57.109525 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e4eb5a51-0c60-405e-9127-f1fedcfcf82e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-d7lx4\" (UID: \"e4eb5a51-0c60-405e-9127-f1fedcfcf82e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4" May 21 15:00:57.109749 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:57.109598 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e4eb5a51-0c60-405e-9127-f1fedcfcf82e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-d7lx4\" (UID: \"e4eb5a51-0c60-405e-9127-f1fedcfcf82e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4" May 21 15:00:57.109749 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:57.109661 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e4eb5a51-0c60-405e-9127-f1fedcfcf82e-cacerts\") pod \"istiod-openshift-gateway-798958bb55-d7lx4\" (UID: \"e4eb5a51-0c60-405e-9127-f1fedcfcf82e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4" May 21 15:00:57.109749 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:57.109686 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjtqs\" (UniqueName: \"kubernetes.io/projected/e4eb5a51-0c60-405e-9127-f1fedcfcf82e-kube-api-access-cjtqs\") pod \"istiod-openshift-gateway-798958bb55-d7lx4\" (UID: \"e4eb5a51-0c60-405e-9127-f1fedcfcf82e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4" May 21 15:00:57.109749 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:57.109711 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e4eb5a51-0c60-405e-9127-f1fedcfcf82e-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-d7lx4\" (UID: \"e4eb5a51-0c60-405e-9127-f1fedcfcf82e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4" May 21 15:00:57.109902 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:57.109774 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4eb5a51-0c60-405e-9127-f1fedcfcf82e-local-certs\") pod \"istiod-openshift-gateway-798958bb55-d7lx4\" (UID: \"e4eb5a51-0c60-405e-9127-f1fedcfcf82e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4" May 21 15:00:57.210342 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:57.210298 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e4eb5a51-0c60-405e-9127-f1fedcfcf82e-cacerts\") pod \"istiod-openshift-gateway-798958bb55-d7lx4\" (UID: \"e4eb5a51-0c60-405e-9127-f1fedcfcf82e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4" May 21 15:00:57.210545 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:57.210350 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cjtqs\" (UniqueName: \"kubernetes.io/projected/e4eb5a51-0c60-405e-9127-f1fedcfcf82e-kube-api-access-cjtqs\") pod \"istiod-openshift-gateway-798958bb55-d7lx4\" (UID: \"e4eb5a51-0c60-405e-9127-f1fedcfcf82e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4" May 21 15:00:57.210545 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:57.210385 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e4eb5a51-0c60-405e-9127-f1fedcfcf82e-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-d7lx4\" (UID: \"e4eb5a51-0c60-405e-9127-f1fedcfcf82e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4" May 21 15:00:57.210545 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:57.210431 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4eb5a51-0c60-405e-9127-f1fedcfcf82e-local-certs\") pod \"istiod-openshift-gateway-798958bb55-d7lx4\" (UID: \"e4eb5a51-0c60-405e-9127-f1fedcfcf82e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4" May 21 15:00:57.210545 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:57.210460 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4eb5a51-0c60-405e-9127-f1fedcfcf82e-istio-token\") pod \"istiod-openshift-gateway-798958bb55-d7lx4\" (UID: \"e4eb5a51-0c60-405e-9127-f1fedcfcf82e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4" May 21 15:00:57.210545 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:57.210495 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e4eb5a51-0c60-405e-9127-f1fedcfcf82e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-d7lx4\" (UID: \"e4eb5a51-0c60-405e-9127-f1fedcfcf82e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4" May 21 15:00:57.210545 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:57.210535 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e4eb5a51-0c60-405e-9127-f1fedcfcf82e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-d7lx4\" (UID: \"e4eb5a51-0c60-405e-9127-f1fedcfcf82e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4" May 21 15:00:57.211191 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:57.211128 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e4eb5a51-0c60-405e-9127-f1fedcfcf82e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-d7lx4\" (UID: \"e4eb5a51-0c60-405e-9127-f1fedcfcf82e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4" May 21 15:00:57.213179 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:57.213152 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e4eb5a51-0c60-405e-9127-f1fedcfcf82e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-d7lx4\" (UID: \"e4eb5a51-0c60-405e-9127-f1fedcfcf82e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4" May 21 15:00:57.213285 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:57.213192 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4eb5a51-0c60-405e-9127-f1fedcfcf82e-local-certs\") pod \"istiod-openshift-gateway-798958bb55-d7lx4\" (UID: \"e4eb5a51-0c60-405e-9127-f1fedcfcf82e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4" May 21 15:00:57.213342 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:57.213297 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e4eb5a51-0c60-405e-9127-f1fedcfcf82e-cacerts\") pod \"istiod-openshift-gateway-798958bb55-d7lx4\" (UID: \"e4eb5a51-0c60-405e-9127-f1fedcfcf82e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4" May 21 15:00:57.213342 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:57.213332 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e4eb5a51-0c60-405e-9127-f1fedcfcf82e-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-d7lx4\" (UID: \"e4eb5a51-0c60-405e-9127-f1fedcfcf82e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4" May 21 15:00:57.218070 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:57.217972 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4eb5a51-0c60-405e-9127-f1fedcfcf82e-istio-token\") pod \"istiod-openshift-gateway-798958bb55-d7lx4\" (UID: \"e4eb5a51-0c60-405e-9127-f1fedcfcf82e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4" May 21 15:00:57.218759 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:57.218742 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjtqs\" (UniqueName: \"kubernetes.io/projected/e4eb5a51-0c60-405e-9127-f1fedcfcf82e-kube-api-access-cjtqs\") pod \"istiod-openshift-gateway-798958bb55-d7lx4\" (UID: \"e4eb5a51-0c60-405e-9127-f1fedcfcf82e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4" May 21 15:00:57.227619 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:57.227591 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4" May 21 15:00:57.373502 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:57.373443 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4"] May 21 15:00:57.375908 ip-10-0-137-49 kubenswrapper[2557]: W0521 15:00:57.375874 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4eb5a51_0c60_405e_9127_f1fedcfcf82e.slice/crio-4914744673ad72d27e5c6886c8ad25ef8d0479b499de1138108c64dfc119a658 WatchSource:0}: Error finding container 4914744673ad72d27e5c6886c8ad25ef8d0479b499de1138108c64dfc119a658: Status 404 returned error can't find the container with id 4914744673ad72d27e5c6886c8ad25ef8d0479b499de1138108c64dfc119a658 May 21 15:00:57.478844 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:00:57.478739 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4" event={"ID":"e4eb5a51-0c60-405e-9127-f1fedcfcf82e","Type":"ContainerStarted","Data":"4914744673ad72d27e5c6886c8ad25ef8d0479b499de1138108c64dfc119a658"} May 21 15:01:00.119496 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:01:00.119452 2557 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 15:01:00.119810 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:01:00.119530 2557 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} May 21 15:01:00.491129 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:01:00.491084 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4" event={"ID":"e4eb5a51-0c60-405e-9127-f1fedcfcf82e","Type":"ContainerStarted","Data":"d5870142dc4be4134d859a488904ee573793b4fa6fd8b5c1e912e4f37064138c"} May 21 15:01:00.491129 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:01:00.491135 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4" May 21 15:01:00.514544 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:01:00.514479 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4" podStartSLOduration=1.774607169 podStartE2EDuration="4.514458898s" podCreationTimestamp="2026-05-21 15:00:56 +0000 UTC" firstStartedPulling="2026-05-21 15:00:57.379309583 +0000 UTC m=+384.675185479" lastFinishedPulling="2026-05-21 15:01:00.119161327 +0000 UTC m=+387.415037208" observedRunningTime="2026-05-21 15:01:00.512224598 +0000 UTC m=+387.808100524" watchObservedRunningTime="2026-05-21 15:01:00.514458898 +0000 UTC m=+387.810334803" May 21 15:01:01.496508 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:01:01.496477 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-d7lx4" May 21 15:01:02.462963 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:01:02.462934 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-272nl" May 21 15:01:11.428386 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:01:11.428353 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-7n5mv" May 21 15:02:03.113641 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:03.113600 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-l7jh2"] May 21 15:02:03.115914 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:03.115897 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-l7jh2" May 21 15:02:03.118541 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:03.118521 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-wctjh\"" May 21 15:02:03.119638 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:03.119602 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 21 15:02:03.119754 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:03.119653 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" May 21 15:02:03.119754 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:03.119665 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 21 15:02:03.128997 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:03.128291 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-l7jh2"] May 21 15:02:03.185758 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:03.185715 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb2qh\" (UniqueName: \"kubernetes.io/projected/824e0a25-8faa-46a7-ab55-ecf3c74621af-kube-api-access-tb2qh\") pod \"dns-operator-controller-manager-648d5c98bc-l7jh2\" (UID: \"824e0a25-8faa-46a7-ab55-ecf3c74621af\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-l7jh2" May 21 15:02:03.286910 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:03.286865 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tb2qh\" (UniqueName: \"kubernetes.io/projected/824e0a25-8faa-46a7-ab55-ecf3c74621af-kube-api-access-tb2qh\") pod \"dns-operator-controller-manager-648d5c98bc-l7jh2\" (UID: \"824e0a25-8faa-46a7-ab55-ecf3c74621af\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-l7jh2" May 21 15:02:03.297217 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:03.297190 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb2qh\" (UniqueName: \"kubernetes.io/projected/824e0a25-8faa-46a7-ab55-ecf3c74621af-kube-api-access-tb2qh\") pod \"dns-operator-controller-manager-648d5c98bc-l7jh2\" (UID: \"824e0a25-8faa-46a7-ab55-ecf3c74621af\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-l7jh2" May 21 15:02:03.431769 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:03.431673 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-l7jh2" May 21 15:02:03.580392 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:03.580351 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-l7jh2"] May 21 15:02:03.583463 ip-10-0-137-49 kubenswrapper[2557]: W0521 15:02:03.583432 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod824e0a25_8faa_46a7_ab55_ecf3c74621af.slice/crio-0aeaffb0009b9eb6697690952b4f90eccd4670025647e3357dc196dde9eeb754 WatchSource:0}: Error finding container 0aeaffb0009b9eb6697690952b4f90eccd4670025647e3357dc196dde9eeb754: Status 404 returned error can't find the container with id 0aeaffb0009b9eb6697690952b4f90eccd4670025647e3357dc196dde9eeb754 May 21 15:02:03.706428 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:03.706391 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-l7jh2" event={"ID":"824e0a25-8faa-46a7-ab55-ecf3c74621af","Type":"ContainerStarted","Data":"0aeaffb0009b9eb6697690952b4f90eccd4670025647e3357dc196dde9eeb754"} May 21 15:02:06.024788 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:06.024745 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-879hg"] May 21 15:02:06.027320 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:06.027301 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-879hg" May 21 15:02:06.030260 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:06.030236 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-qzg7b\"" May 21 15:02:06.050502 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:06.050429 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-879hg"] May 21 15:02:06.114569 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:06.114530 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9zsg\" (UniqueName: \"kubernetes.io/projected/5b885c1d-9272-4135-8d3d-9dce3b2cdb41-kube-api-access-m9zsg\") pod \"limitador-operator-controller-manager-85c4996f8c-879hg\" (UID: \"5b885c1d-9272-4135-8d3d-9dce3b2cdb41\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-879hg" May 21 15:02:06.215369 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:06.215333 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m9zsg\" (UniqueName: \"kubernetes.io/projected/5b885c1d-9272-4135-8d3d-9dce3b2cdb41-kube-api-access-m9zsg\") pod \"limitador-operator-controller-manager-85c4996f8c-879hg\" (UID: \"5b885c1d-9272-4135-8d3d-9dce3b2cdb41\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-879hg" May 21 15:02:06.224427 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:06.224402 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9zsg\" (UniqueName: \"kubernetes.io/projected/5b885c1d-9272-4135-8d3d-9dce3b2cdb41-kube-api-access-m9zsg\") pod \"limitador-operator-controller-manager-85c4996f8c-879hg\" (UID: \"5b885c1d-9272-4135-8d3d-9dce3b2cdb41\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-879hg" May 21 15:02:06.337475 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:06.337375 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-879hg" May 21 15:02:06.477938 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:06.477910 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-879hg"] May 21 15:02:06.480559 ip-10-0-137-49 kubenswrapper[2557]: W0521 15:02:06.480524 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b885c1d_9272_4135_8d3d_9dce3b2cdb41.slice/crio-297e338bc1f025e7d02c01150b52200a731964b077d9472fdb3289f279e665f0 WatchSource:0}: Error finding container 297e338bc1f025e7d02c01150b52200a731964b077d9472fdb3289f279e665f0: Status 404 returned error can't find the container with id 297e338bc1f025e7d02c01150b52200a731964b077d9472fdb3289f279e665f0 May 21 15:02:06.721478 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:06.721433 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-l7jh2" event={"ID":"824e0a25-8faa-46a7-ab55-ecf3c74621af","Type":"ContainerStarted","Data":"45917875fef8e5032c4459b6ad6437a7a09827b84b3cd471f0331e83d7ba5d0a"} May 21 15:02:06.721681 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:06.721643 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-l7jh2" May 21 15:02:06.722538 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:06.722516 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-879hg" event={"ID":"5b885c1d-9272-4135-8d3d-9dce3b2cdb41","Type":"ContainerStarted","Data":"297e338bc1f025e7d02c01150b52200a731964b077d9472fdb3289f279e665f0"} May 21 15:02:06.739133 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:06.739072 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-l7jh2" podStartSLOduration=1.5377934739999999 podStartE2EDuration="3.739057545s" podCreationTimestamp="2026-05-21 15:02:03 +0000 UTC" firstStartedPulling="2026-05-21 15:02:03.585440935 +0000 UTC m=+450.881316813" lastFinishedPulling="2026-05-21 15:02:05.786704999 +0000 UTC m=+453.082580884" observedRunningTime="2026-05-21 15:02:06.737388437 +0000 UTC m=+454.033264339" watchObservedRunningTime="2026-05-21 15:02:06.739057545 +0000 UTC m=+454.034933446" May 21 15:02:08.732037 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:08.731965 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-879hg" event={"ID":"5b885c1d-9272-4135-8d3d-9dce3b2cdb41","Type":"ContainerStarted","Data":"625a98ecfcb1e2b2187ed1cf43c27e6c68ee9e90af9b6638d8022b760fbbca4a"} May 21 15:02:08.732536 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:08.732138 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-879hg" May 21 15:02:08.754044 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:08.753932 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-879hg" podStartSLOduration=0.749611191 podStartE2EDuration="2.753913462s" podCreationTimestamp="2026-05-21 15:02:06 +0000 UTC" firstStartedPulling="2026-05-21 15:02:06.482569667 +0000 UTC m=+453.778445546" lastFinishedPulling="2026-05-21 15:02:08.486871939 +0000 UTC m=+455.782747817" observedRunningTime="2026-05-21 15:02:08.752186513 +0000 UTC m=+456.048062414" watchObservedRunningTime="2026-05-21 15:02:08.753913462 +0000 UTC m=+456.049789362" May 21 15:02:17.728966 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:17.728931 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-l7jh2" May 21 15:02:19.738808 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:19.738777 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-879hg" May 21 15:02:20.736019 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:20.735957 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-879hg"] May 21 15:02:20.736258 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:20.736230 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-879hg" podUID="5b885c1d-9272-4135-8d3d-9dce3b2cdb41" containerName="manager" containerID="cri-o://625a98ecfcb1e2b2187ed1cf43c27e6c68ee9e90af9b6638d8022b760fbbca4a" gracePeriod=2 May 21 15:02:20.763587 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:20.763546 2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-879hg"] May 21 15:02:20.778371 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:20.778335 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k8m4f"] May 21 15:02:20.778885 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:20.778870 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b885c1d-9272-4135-8d3d-9dce3b2cdb41" containerName="manager" May 21 15:02:20.778926 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:20.778889 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b885c1d-9272-4135-8d3d-9dce3b2cdb41" containerName="manager" May 21 15:02:20.778986 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:20.778966 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="5b885c1d-9272-4135-8d3d-9dce3b2cdb41" containerName="manager" May 21 15:02:20.781762 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:20.781728 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k8m4f" May 21 15:02:20.795991 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:20.795940 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k8m4f"] May 21 15:02:20.811872 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:20.811829 2557 status_manager.go:895] "Failed to get status for pod" podUID="5b885c1d-9272-4135-8d3d-9dce3b2cdb41" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-879hg" err="pods \"limitador-operator-controller-manager-85c4996f8c-879hg\" is forbidden: User \"system:node:ip-10-0-137-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-49.ec2.internal' and this object" May 21 15:02:20.847278 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:20.847250 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnqtr\" (UniqueName: \"kubernetes.io/projected/18bdb597-c401-426e-8af5-7905e3e50e02-kube-api-access-qnqtr\") pod \"limitador-operator-controller-manager-85c4996f8c-k8m4f\" (UID: \"18bdb597-c401-426e-8af5-7905e3e50e02\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k8m4f" May 21 15:02:20.948469 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:20.948435 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qnqtr\" (UniqueName: \"kubernetes.io/projected/18bdb597-c401-426e-8af5-7905e3e50e02-kube-api-access-qnqtr\") pod \"limitador-operator-controller-manager-85c4996f8c-k8m4f\" (UID: \"18bdb597-c401-426e-8af5-7905e3e50e02\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k8m4f" May 21 15:02:20.960647 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:20.960619 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnqtr\" (UniqueName: \"kubernetes.io/projected/18bdb597-c401-426e-8af5-7905e3e50e02-kube-api-access-qnqtr\") pod \"limitador-operator-controller-manager-85c4996f8c-k8m4f\" (UID: \"18bdb597-c401-426e-8af5-7905e3e50e02\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k8m4f" May 21 15:02:20.971657 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:20.971634 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-879hg" May 21 15:02:20.974154 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:20.974127 2557 status_manager.go:895] "Failed to get status for pod" podUID="5b885c1d-9272-4135-8d3d-9dce3b2cdb41" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-879hg" err="pods \"limitador-operator-controller-manager-85c4996f8c-879hg\" is forbidden: User \"system:node:ip-10-0-137-49.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-49.ec2.internal' and this object" May 21 15:02:21.049901 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:21.049801 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9zsg\" (UniqueName: \"kubernetes.io/projected/5b885c1d-9272-4135-8d3d-9dce3b2cdb41-kube-api-access-m9zsg\") pod \"5b885c1d-9272-4135-8d3d-9dce3b2cdb41\" (UID: \"5b885c1d-9272-4135-8d3d-9dce3b2cdb41\") " May 21 15:02:21.052002 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:21.051965 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b885c1d-9272-4135-8d3d-9dce3b2cdb41-kube-api-access-m9zsg" (OuterVolumeSpecName: "kube-api-access-m9zsg") pod "5b885c1d-9272-4135-8d3d-9dce3b2cdb41" (UID: "5b885c1d-9272-4135-8d3d-9dce3b2cdb41"). InnerVolumeSpecName "kube-api-access-m9zsg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:02:21.115427 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:21.115369 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k8m4f" May 21 15:02:21.151642 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:21.151584 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9zsg\" (UniqueName: \"kubernetes.io/projected/5b885c1d-9272-4135-8d3d-9dce3b2cdb41-kube-api-access-m9zsg\") on node \"ip-10-0-137-49.ec2.internal\" DevicePath \"\"" May 21 15:02:21.276631 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:21.276506 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k8m4f"] May 21 15:02:21.279433 ip-10-0-137-49 kubenswrapper[2557]: W0521 15:02:21.279408 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18bdb597_c401_426e_8af5_7905e3e50e02.slice/crio-fff8c1104898d8ff2d18e47547895a1c0135c2a878d4e1a43886ddf9a570d001 WatchSource:0}: Error finding container fff8c1104898d8ff2d18e47547895a1c0135c2a878d4e1a43886ddf9a570d001: Status 404 returned error can't find the container with id fff8c1104898d8ff2d18e47547895a1c0135c2a878d4e1a43886ddf9a570d001 May 21 15:02:21.307358 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:21.307329 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b885c1d-9272-4135-8d3d-9dce3b2cdb41" path="/var/lib/kubelet/pods/5b885c1d-9272-4135-8d3d-9dce3b2cdb41/volumes" May 21 15:02:21.761402 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:21.761368 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l2g2q"] May 21 15:02:21.763749 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:21.763731 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l2g2q" May 21 15:02:21.766338 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:21.766306 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-54j4h\"" May 21 15:02:21.775928 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:21.775906 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l2g2q"] May 21 15:02:21.780822 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:21.780792 2557 generic.go:358] "Generic (PLEG): container finished" podID="5b885c1d-9272-4135-8d3d-9dce3b2cdb41" containerID="625a98ecfcb1e2b2187ed1cf43c27e6c68ee9e90af9b6638d8022b760fbbca4a" exitCode=0 May 21 15:02:21.780944 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:21.780839 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-879hg" May 21 15:02:21.780944 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:21.780886 2557 scope.go:117] "RemoveContainer" containerID="625a98ecfcb1e2b2187ed1cf43c27e6c68ee9e90af9b6638d8022b760fbbca4a" May 21 15:02:21.782561 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:21.782538 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k8m4f" event={"ID":"18bdb597-c401-426e-8af5-7905e3e50e02","Type":"ContainerStarted","Data":"3c420e7747d94a3fc5101a02e11d6f0c3b2017d86b830379b7ae11456356acc2"} May 21 15:02:21.782655 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:21.782571 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k8m4f" event={"ID":"18bdb597-c401-426e-8af5-7905e3e50e02","Type":"ContainerStarted","Data":"fff8c1104898d8ff2d18e47547895a1c0135c2a878d4e1a43886ddf9a570d001"} May 21 15:02:21.782760 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:21.782725 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k8m4f" May 21 15:02:21.789755 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:21.789734 2557 scope.go:117] "RemoveContainer" containerID="625a98ecfcb1e2b2187ed1cf43c27e6c68ee9e90af9b6638d8022b760fbbca4a" May 21 15:02:21.790074 ip-10-0-137-49 kubenswrapper[2557]: E0521 15:02:21.790052 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"625a98ecfcb1e2b2187ed1cf43c27e6c68ee9e90af9b6638d8022b760fbbca4a\": container with ID starting with 625a98ecfcb1e2b2187ed1cf43c27e6c68ee9e90af9b6638d8022b760fbbca4a not found: ID does not exist" containerID="625a98ecfcb1e2b2187ed1cf43c27e6c68ee9e90af9b6638d8022b760fbbca4a" May 21 15:02:21.790130 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:21.790083 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"625a98ecfcb1e2b2187ed1cf43c27e6c68ee9e90af9b6638d8022b760fbbca4a"} err="failed to get container status \"625a98ecfcb1e2b2187ed1cf43c27e6c68ee9e90af9b6638d8022b760fbbca4a\": rpc error: code = NotFound desc = could not find container \"625a98ecfcb1e2b2187ed1cf43c27e6c68ee9e90af9b6638d8022b760fbbca4a\": container with ID starting with 625a98ecfcb1e2b2187ed1cf43c27e6c68ee9e90af9b6638d8022b760fbbca4a not found: ID does not exist" May 21 15:02:21.819810 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:21.819756 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k8m4f" podStartSLOduration=1.819741687 podStartE2EDuration="1.819741687s" podCreationTimestamp="2026-05-21 15:02:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:02:21.818280079 +0000 UTC m=+469.114156020" watchObservedRunningTime="2026-05-21 15:02:21.819741687 +0000 UTC m=+469.115617587" May 21 15:02:21.857300 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:21.857261 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jctj6\" (UniqueName: \"kubernetes.io/projected/d2f817ee-e2b6-4dc8-8dbb-1b9641baab34-kube-api-access-jctj6\") pod \"kuadrant-operator-controller-manager-55c7f4c975-l2g2q\" (UID: \"d2f817ee-e2b6-4dc8-8dbb-1b9641baab34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l2g2q" May 21 15:02:21.857463 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:21.857353 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2f817ee-e2b6-4dc8-8dbb-1b9641baab34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-l2g2q\" (UID: \"d2f817ee-e2b6-4dc8-8dbb-1b9641baab34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l2g2q" May 21 15:02:21.958614 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:21.958566 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jctj6\" (UniqueName: \"kubernetes.io/projected/d2f817ee-e2b6-4dc8-8dbb-1b9641baab34-kube-api-access-jctj6\") pod \"kuadrant-operator-controller-manager-55c7f4c975-l2g2q\" (UID: \"d2f817ee-e2b6-4dc8-8dbb-1b9641baab34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l2g2q" May 21 15:02:21.958802 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:21.958662 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2f817ee-e2b6-4dc8-8dbb-1b9641baab34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-l2g2q\" (UID: \"d2f817ee-e2b6-4dc8-8dbb-1b9641baab34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l2g2q" May 21 15:02:21.959148 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:21.959125 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2f817ee-e2b6-4dc8-8dbb-1b9641baab34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-l2g2q\" (UID: \"d2f817ee-e2b6-4dc8-8dbb-1b9641baab34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l2g2q" May 21 15:02:21.971465 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:21.971440 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jctj6\" (UniqueName: \"kubernetes.io/projected/d2f817ee-e2b6-4dc8-8dbb-1b9641baab34-kube-api-access-jctj6\") pod \"kuadrant-operator-controller-manager-55c7f4c975-l2g2q\" (UID: \"d2f817ee-e2b6-4dc8-8dbb-1b9641baab34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l2g2q" May 21 15:02:22.074691 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:22.074596 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l2g2q" May 21 15:02:22.209818 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:22.209784 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l2g2q"] May 21 15:02:22.213871 ip-10-0-137-49 kubenswrapper[2557]: W0521 15:02:22.213841 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2f817ee_e2b6_4dc8_8dbb_1b9641baab34.slice/crio-549583b7846f98e79d24ae3781a5035d10560c8da70481cc7fd131bb61faafee WatchSource:0}: Error finding container 549583b7846f98e79d24ae3781a5035d10560c8da70481cc7fd131bb61faafee: Status 404 returned error can't find the container with id 549583b7846f98e79d24ae3781a5035d10560c8da70481cc7fd131bb61faafee May 21 15:02:22.788699 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:22.788653 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l2g2q" event={"ID":"d2f817ee-e2b6-4dc8-8dbb-1b9641baab34","Type":"ContainerStarted","Data":"549583b7846f98e79d24ae3781a5035d10560c8da70481cc7fd131bb61faafee"} May 21 15:02:26.807515 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:26.807473 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l2g2q" event={"ID":"d2f817ee-e2b6-4dc8-8dbb-1b9641baab34","Type":"ContainerStarted","Data":"2daa2b6722a9ecc319e3013314f4d8db54854ac1f2b9d1a76a5d6981ec9cab3d"} May 21 15:02:26.808003 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:26.807548 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l2g2q" May 21 15:02:26.827297 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:26.827245 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l2g2q" podStartSLOduration=1.998538383 podStartE2EDuration="5.827228204s" podCreationTimestamp="2026-05-21 15:02:21 +0000 UTC" firstStartedPulling="2026-05-21 15:02:22.216201984 +0000 UTC m=+469.512077866" lastFinishedPulling="2026-05-21 15:02:26.044891808 +0000 UTC m=+473.340767687" observedRunningTime="2026-05-21 15:02:26.82475066 +0000 UTC m=+474.120626583" watchObservedRunningTime="2026-05-21 15:02:26.827228204 +0000 UTC m=+474.123104104" May 21 15:02:32.793025 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:32.792964 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k8m4f" May 21 15:02:37.813472 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:02:37.813442 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l2g2q" May 21 15:03:31.177760 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:03:31.177666 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-zqc8j"] May 21 15:03:31.180284 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:03:31.180258 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-zqc8j" May 21 15:03:31.183029 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:03:31.183005 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 21 15:03:31.183168 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:03:31.183100 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vx9s9\"" May 21 15:03:31.191880 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:03:31.191851 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-zqc8j"] May 21 15:03:31.350167 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:03:31.350122 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44djx\" (UniqueName: \"kubernetes.io/projected/92273182-dd16-4e4f-8aa4-90fdf85aec20-kube-api-access-44djx\") pod \"maas-controller-68fb5d86bc-zqc8j\" (UID: \"92273182-dd16-4e4f-8aa4-90fdf85aec20\") " pod="opendatahub/maas-controller-68fb5d86bc-zqc8j" May 21 15:03:31.440001 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:03:31.439948 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-zqc8j"] May 21 15:03:31.440233 ip-10-0-137-49 kubenswrapper[2557]: E0521 15:03:31.440213 2557 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-44djx], unattached volumes=[], failed to process volumes=[]: context canceled" pod="opendatahub/maas-controller-68fb5d86bc-zqc8j" podUID="92273182-dd16-4e4f-8aa4-90fdf85aec20" May 21 15:03:31.451477 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:03:31.451449 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-44djx\" (UniqueName: \"kubernetes.io/projected/92273182-dd16-4e4f-8aa4-90fdf85aec20-kube-api-access-44djx\") pod \"maas-controller-68fb5d86bc-zqc8j\" (UID: \"92273182-dd16-4e4f-8aa4-90fdf85aec20\") " pod="opendatahub/maas-controller-68fb5d86bc-zqc8j" May 21 15:03:31.465656 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:03:31.465632 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44djx\" (UniqueName: \"kubernetes.io/projected/92273182-dd16-4e4f-8aa4-90fdf85aec20-kube-api-access-44djx\") pod \"maas-controller-68fb5d86bc-zqc8j\" (UID: \"92273182-dd16-4e4f-8aa4-90fdf85aec20\") " pod="opendatahub/maas-controller-68fb5d86bc-zqc8j" May 21 15:03:32.043005 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:03:32.042948 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-zqc8j" May 21 15:03:32.048131 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:03:32.048105 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-zqc8j" May 21 15:03:32.157392 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:03:32.157355 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44djx\" (UniqueName: \"kubernetes.io/projected/92273182-dd16-4e4f-8aa4-90fdf85aec20-kube-api-access-44djx\") pod \"92273182-dd16-4e4f-8aa4-90fdf85aec20\" (UID: \"92273182-dd16-4e4f-8aa4-90fdf85aec20\") " May 21 15:03:32.163004 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:03:32.160479 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92273182-dd16-4e4f-8aa4-90fdf85aec20-kube-api-access-44djx" (OuterVolumeSpecName: "kube-api-access-44djx") pod "92273182-dd16-4e4f-8aa4-90fdf85aec20" (UID: "92273182-dd16-4e4f-8aa4-90fdf85aec20"). InnerVolumeSpecName "kube-api-access-44djx". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:03:32.258261 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:03:32.258202 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44djx\" (UniqueName: \"kubernetes.io/projected/92273182-dd16-4e4f-8aa4-90fdf85aec20-kube-api-access-44djx\") on node \"ip-10-0-137-49.ec2.internal\" DevicePath \"\"" May 21 15:03:33.046757 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:03:33.046726 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68fb5d86bc-zqc8j" May 21 15:03:33.076179 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:03:33.076141 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-zqc8j"] May 21 15:03:33.079209 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:03:33.079175 2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68fb5d86bc-zqc8j"] May 21 15:03:33.307058 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:03:33.306968 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92273182-dd16-4e4f-8aa4-90fdf85aec20" path="/var/lib/kubelet/pods/92273182-dd16-4e4f-8aa4-90fdf85aec20/volumes" May 21 15:04:20.883014 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:20.882964 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5464f4fffc-4tb5v"] May 21 15:04:20.885258 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:20.885242 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5464f4fffc-4tb5v" May 21 15:04:20.887534 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:20.887507 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" May 21 15:04:20.887675 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:20.887604 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" May 21 15:04:20.894022 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:20.893995 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5464f4fffc-4tb5v"] May 21 15:04:21.000771 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:21.000737 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc7770eb-db09-4a56-8820-b38851f7c2bb-maas-api-tls\") pod \"maas-api-5464f4fffc-4tb5v\" (UID: \"bc7770eb-db09-4a56-8820-b38851f7c2bb\") " pod="opendatahub/maas-api-5464f4fffc-4tb5v" May 21 15:04:21.000994 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:21.000856 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgjch\" (UniqueName: \"kubernetes.io/projected/bc7770eb-db09-4a56-8820-b38851f7c2bb-kube-api-access-xgjch\") pod \"maas-api-5464f4fffc-4tb5v\" (UID: \"bc7770eb-db09-4a56-8820-b38851f7c2bb\") " pod="opendatahub/maas-api-5464f4fffc-4tb5v" May 21 15:04:21.101704 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:21.101666 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xgjch\" (UniqueName: \"kubernetes.io/projected/bc7770eb-db09-4a56-8820-b38851f7c2bb-kube-api-access-xgjch\") pod \"maas-api-5464f4fffc-4tb5v\" (UID: \"bc7770eb-db09-4a56-8820-b38851f7c2bb\") " pod="opendatahub/maas-api-5464f4fffc-4tb5v" May 21 15:04:21.101942 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:21.101747 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc7770eb-db09-4a56-8820-b38851f7c2bb-maas-api-tls\") pod \"maas-api-5464f4fffc-4tb5v\" (UID: \"bc7770eb-db09-4a56-8820-b38851f7c2bb\") " pod="opendatahub/maas-api-5464f4fffc-4tb5v" May 21 15:04:21.101942 ip-10-0-137-49 kubenswrapper[2557]: E0521 15:04:21.101925 2557 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found May 21 15:04:21.102721 ip-10-0-137-49 kubenswrapper[2557]: E0521 15:04:21.102514 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc7770eb-db09-4a56-8820-b38851f7c2bb-maas-api-tls podName:bc7770eb-db09-4a56-8820-b38851f7c2bb nodeName:}" failed. No retries permitted until 2026-05-21 15:04:21.60209537 +0000 UTC m=+588.897971254 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bc7770eb-db09-4a56-8820-b38851f7c2bb-maas-api-tls") pod "maas-api-5464f4fffc-4tb5v" (UID: "bc7770eb-db09-4a56-8820-b38851f7c2bb") : secret "maas-api-serving-cert" not found May 21 15:04:21.111971 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:21.111943 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgjch\" (UniqueName: \"kubernetes.io/projected/bc7770eb-db09-4a56-8820-b38851f7c2bb-kube-api-access-xgjch\") pod \"maas-api-5464f4fffc-4tb5v\" (UID: \"bc7770eb-db09-4a56-8820-b38851f7c2bb\") " pod="opendatahub/maas-api-5464f4fffc-4tb5v" May 21 15:04:21.606730 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:21.606683 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc7770eb-db09-4a56-8820-b38851f7c2bb-maas-api-tls\") pod \"maas-api-5464f4fffc-4tb5v\" (UID: \"bc7770eb-db09-4a56-8820-b38851f7c2bb\") " pod="opendatahub/maas-api-5464f4fffc-4tb5v" May 21 15:04:21.609336 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:21.609308 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc7770eb-db09-4a56-8820-b38851f7c2bb-maas-api-tls\") pod \"maas-api-5464f4fffc-4tb5v\" (UID: \"bc7770eb-db09-4a56-8820-b38851f7c2bb\") " pod="opendatahub/maas-api-5464f4fffc-4tb5v" May 21 15:04:21.797291 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:21.797252 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5464f4fffc-4tb5v" May 21 15:04:21.934229 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:21.934193 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5464f4fffc-4tb5v"] May 21 15:04:21.937814 ip-10-0-137-49 kubenswrapper[2557]: W0521 15:04:21.937780 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc7770eb_db09_4a56_8820_b38851f7c2bb.slice/crio-e2968012a21687250f1cc08106709da5a20f149042701e64625a2801ea9216a4 WatchSource:0}: Error finding container e2968012a21687250f1cc08106709da5a20f149042701e64625a2801ea9216a4: Status 404 returned error can't find the container with id e2968012a21687250f1cc08106709da5a20f149042701e64625a2801ea9216a4 May 21 15:04:22.224122 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:22.224089 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5464f4fffc-4tb5v" event={"ID":"bc7770eb-db09-4a56-8820-b38851f7c2bb","Type":"ContainerStarted","Data":"e2968012a21687250f1cc08106709da5a20f149042701e64625a2801ea9216a4"} May 21 15:04:25.236284 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:25.236248 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5464f4fffc-4tb5v" event={"ID":"bc7770eb-db09-4a56-8820-b38851f7c2bb","Type":"ContainerStarted","Data":"00f2da24e9996f5d83034d97480ef68c5159fa2c053dcaa56f425cebde20b7e6"} May 21 15:04:25.236662 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:25.236305 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5464f4fffc-4tb5v" May 21 15:04:25.252310 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:25.252255 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-5464f4fffc-4tb5v" podStartSLOduration=2.744483562 podStartE2EDuration="5.252241252s" podCreationTimestamp="2026-05-21 15:04:20 +0000 UTC" firstStartedPulling="2026-05-21 15:04:21.93933344 +0000 UTC m=+589.235209320" lastFinishedPulling="2026-05-21 15:04:24.447091128 +0000 UTC m=+591.742967010" observedRunningTime="2026-05-21 15:04:25.25159661 +0000 UTC m=+592.547472511" watchObservedRunningTime="2026-05-21 15:04:25.252241252 +0000 UTC m=+592.548117153" May 21 15:04:31.246144 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:31.246111 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5464f4fffc-4tb5v" May 21 15:04:33.228014 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:33.227969 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qfg49_c1ee545c-62b8-4223-8c79-c00a1a036620/console-operator/2.log" May 21 15:04:33.228434 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:33.228187 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qfg49_c1ee545c-62b8-4223-8c79-c00a1a036620/console-operator/2.log" May 21 15:04:53.142967 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.142888 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2"] May 21 15:04:53.146827 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.146805 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2" May 21 15:04:53.150440 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.150416 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 21 15:04:53.150592 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.150467 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" May 21 15:04:53.150592 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.150535 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6htq4\"" May 21 15:04:53.150753 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.150548 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 21 15:04:53.156148 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.156124 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2"] May 21 15:04:53.297166 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.297115 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96507378-7ee5-4018-a385-e8f2c1d0c5f5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2\" (UID: \"96507378-7ee5-4018-a385-e8f2c1d0c5f5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2" May 21 15:04:53.297374 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.297201 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96507378-7ee5-4018-a385-e8f2c1d0c5f5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2\" (UID: \"96507378-7ee5-4018-a385-e8f2c1d0c5f5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2" May 21 15:04:53.297374 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.297291 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/96507378-7ee5-4018-a385-e8f2c1d0c5f5-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2\" (UID: \"96507378-7ee5-4018-a385-e8f2c1d0c5f5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2" May 21 15:04:53.297506 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.297397 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96507378-7ee5-4018-a385-e8f2c1d0c5f5-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2\" (UID: \"96507378-7ee5-4018-a385-e8f2c1d0c5f5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2" May 21 15:04:53.297506 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.297483 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w49h\" (UniqueName: \"kubernetes.io/projected/96507378-7ee5-4018-a385-e8f2c1d0c5f5-kube-api-access-9w49h\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2\" (UID: \"96507378-7ee5-4018-a385-e8f2c1d0c5f5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2" May 21 15:04:53.297613 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.297585 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96507378-7ee5-4018-a385-e8f2c1d0c5f5-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2\" (UID: \"96507378-7ee5-4018-a385-e8f2c1d0c5f5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2" May 21 15:04:53.398963 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.398863 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96507378-7ee5-4018-a385-e8f2c1d0c5f5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2\" (UID: \"96507378-7ee5-4018-a385-e8f2c1d0c5f5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2" May 21 15:04:53.398963 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.398919 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96507378-7ee5-4018-a385-e8f2c1d0c5f5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2\" (UID: \"96507378-7ee5-4018-a385-e8f2c1d0c5f5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2" May 21 15:04:53.398963 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.398956 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/96507378-7ee5-4018-a385-e8f2c1d0c5f5-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2\" (UID: \"96507378-7ee5-4018-a385-e8f2c1d0c5f5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2" May 21 15:04:53.399279 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.399014 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96507378-7ee5-4018-a385-e8f2c1d0c5f5-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2\" (UID: \"96507378-7ee5-4018-a385-e8f2c1d0c5f5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2" May 21 15:04:53.399279 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.399052 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9w49h\" (UniqueName: \"kubernetes.io/projected/96507378-7ee5-4018-a385-e8f2c1d0c5f5-kube-api-access-9w49h\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2\" (UID: \"96507378-7ee5-4018-a385-e8f2c1d0c5f5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2" May 21 15:04:53.399279 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.399108 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96507378-7ee5-4018-a385-e8f2c1d0c5f5-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2\" (UID: \"96507378-7ee5-4018-a385-e8f2c1d0c5f5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2" May 21 15:04:53.399597 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.399570 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96507378-7ee5-4018-a385-e8f2c1d0c5f5-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2\" (UID: \"96507378-7ee5-4018-a385-e8f2c1d0c5f5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2" May 21 15:04:53.399860 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.399831 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96507378-7ee5-4018-a385-e8f2c1d0c5f5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2\" (UID: \"96507378-7ee5-4018-a385-e8f2c1d0c5f5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2" May 21 15:04:53.400635 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.400608 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/96507378-7ee5-4018-a385-e8f2c1d0c5f5-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2\" (UID: \"96507378-7ee5-4018-a385-e8f2c1d0c5f5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2" May 21 15:04:53.402718 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.402688 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96507378-7ee5-4018-a385-e8f2c1d0c5f5-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2\" (UID: \"96507378-7ee5-4018-a385-e8f2c1d0c5f5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2" May 21 15:04:53.402965 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.402940 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96507378-7ee5-4018-a385-e8f2c1d0c5f5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2\" (UID: \"96507378-7ee5-4018-a385-e8f2c1d0c5f5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2" May 21 15:04:53.408035 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.408011 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w49h\" (UniqueName: \"kubernetes.io/projected/96507378-7ee5-4018-a385-e8f2c1d0c5f5-kube-api-access-9w49h\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2\" (UID: \"96507378-7ee5-4018-a385-e8f2c1d0c5f5\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2" May 21 15:04:53.459375 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.459334 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2" May 21 15:04:53.606112 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.606073 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2"] May 21 15:04:53.609341 ip-10-0-137-49 kubenswrapper[2557]: W0521 15:04:53.609308 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96507378_7ee5_4018_a385_e8f2c1d0c5f5.slice/crio-9e25cf38c26c00eb4f720141fdd75be52266de562f9d3acc0f203b85a2312552 WatchSource:0}: Error finding container 9e25cf38c26c00eb4f720141fdd75be52266de562f9d3acc0f203b85a2312552: Status 404 returned error can't find the container with id 9e25cf38c26c00eb4f720141fdd75be52266de562f9d3acc0f203b85a2312552 May 21 15:04:53.937918 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.937883 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-5bbg8"] May 21 15:04:53.943025 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.943001 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bbg8" May 21 15:04:53.945597 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.945577 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 21 15:04:53.951939 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:53.951911 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-5bbg8"] May 21 15:04:54.008383 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:54.008351 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/908878f3-586c-4c6d-8086-84860849b99e-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bbg8\" (UID: \"908878f3-586c-4c6d-8086-84860849b99e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bbg8" May 21 15:04:54.008565 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:54.008398 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/908878f3-586c-4c6d-8086-84860849b99e-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bbg8\" (UID: \"908878f3-586c-4c6d-8086-84860849b99e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bbg8" May 21 15:04:54.008565 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:54.008430 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/908878f3-586c-4c6d-8086-84860849b99e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bbg8\" (UID: \"908878f3-586c-4c6d-8086-84860849b99e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bbg8" May 21 15:04:54.008565 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:54.008492 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw5q2\" (UniqueName: \"kubernetes.io/projected/908878f3-586c-4c6d-8086-84860849b99e-kube-api-access-zw5q2\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bbg8\" (UID: \"908878f3-586c-4c6d-8086-84860849b99e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bbg8" May 21 15:04:54.008565 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:54.008563 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/908878f3-586c-4c6d-8086-84860849b99e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bbg8\" (UID: \"908878f3-586c-4c6d-8086-84860849b99e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bbg8" May 21 15:04:54.008738 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:54.008616 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/908878f3-586c-4c6d-8086-84860849b99e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bbg8\" (UID: \"908878f3-586c-4c6d-8086-84860849b99e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bbg8" May 21 15:04:54.109301 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:54.109263 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/908878f3-586c-4c6d-8086-84860849b99e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bbg8\" (UID: \"908878f3-586c-4c6d-8086-84860849b99e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bbg8" May 21 15:04:54.109494 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:54.109320 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zw5q2\" (UniqueName: \"kubernetes.io/projected/908878f3-586c-4c6d-8086-84860849b99e-kube-api-access-zw5q2\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bbg8\" (UID: \"908878f3-586c-4c6d-8086-84860849b99e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bbg8" May 21 15:04:54.109494 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:54.109376 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/908878f3-586c-4c6d-8086-84860849b99e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bbg8\" (UID: \"908878f3-586c-4c6d-8086-84860849b99e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bbg8" May 21 15:04:54.109494 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:54.109429 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/908878f3-586c-4c6d-8086-84860849b99e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bbg8\" (UID: \"908878f3-586c-4c6d-8086-84860849b99e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bbg8" May 21 15:04:54.109494 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:54.109468 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/908878f3-586c-4c6d-8086-84860849b99e-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bbg8\" (UID: \"908878f3-586c-4c6d-8086-84860849b99e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bbg8" May 21 15:04:54.109704 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:54.109514 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/908878f3-586c-4c6d-8086-84860849b99e-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bbg8\" (UID: \"908878f3-586c-4c6d-8086-84860849b99e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bbg8" May 21 15:04:54.109931 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:54.109905 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/908878f3-586c-4c6d-8086-84860849b99e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bbg8\" (UID: \"908878f3-586c-4c6d-8086-84860849b99e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bbg8" May 21 15:04:54.109931 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:54.109920 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/908878f3-586c-4c6d-8086-84860849b99e-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bbg8\" (UID: \"908878f3-586c-4c6d-8086-84860849b99e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bbg8" May 21 15:04:54.110091 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:54.109971 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/908878f3-586c-4c6d-8086-84860849b99e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bbg8\" (UID: \"908878f3-586c-4c6d-8086-84860849b99e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bbg8" May 21 15:04:54.112039 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:54.112010 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/908878f3-586c-4c6d-8086-84860849b99e-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bbg8\" (UID: \"908878f3-586c-4c6d-8086-84860849b99e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bbg8" May 21 15:04:54.112150 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:54.112129 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/908878f3-586c-4c6d-8086-84860849b99e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bbg8\" (UID: \"908878f3-586c-4c6d-8086-84860849b99e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bbg8" May 21 15:04:54.122367 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:54.122338 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw5q2\" (UniqueName: \"kubernetes.io/projected/908878f3-586c-4c6d-8086-84860849b99e-kube-api-access-zw5q2\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bbg8\" (UID: \"908878f3-586c-4c6d-8086-84860849b99e\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bbg8" May 21 15:04:54.254452 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:54.254369 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bbg8" May 21 15:04:54.344861 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:54.344807 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2" event={"ID":"96507378-7ee5-4018-a385-e8f2c1d0c5f5","Type":"ContainerStarted","Data":"9e25cf38c26c00eb4f720141fdd75be52266de562f9d3acc0f203b85a2312552"} May 21 15:04:54.410107 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:54.410061 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-5bbg8"] May 21 15:04:54.413459 ip-10-0-137-49 kubenswrapper[2557]: W0521 15:04:54.413422 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod908878f3_586c_4c6d_8086_84860849b99e.slice/crio-9ee40f76bd59b5c9f89f80fe5f4fe241f486f4c4adce19023daaea44733a87eb WatchSource:0}: Error finding container 9ee40f76bd59b5c9f89f80fe5f4fe241f486f4c4adce19023daaea44733a87eb: Status 404 returned error can't find the container with id 9ee40f76bd59b5c9f89f80fe5f4fe241f486f4c4adce19023daaea44733a87eb May 21 15:04:55.350844 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:04:55.350782 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bbg8" event={"ID":"908878f3-586c-4c6d-8086-84860849b99e","Type":"ContainerStarted","Data":"9ee40f76bd59b5c9f89f80fe5f4fe241f486f4c4adce19023daaea44733a87eb"} May 21 15:05:00.379907 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:00.379875 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bbg8" event={"ID":"908878f3-586c-4c6d-8086-84860849b99e","Type":"ContainerStarted","Data":"6690142131dc420c1eee18042d89b292eff1b4beb6111e3b898d84a50eba55ec"} May 21 15:05:00.381877 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:00.381838 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2" event={"ID":"96507378-7ee5-4018-a385-e8f2c1d0c5f5","Type":"ContainerStarted","Data":"b0f69b29accff57eb3a0726eadc1e6efed336a2561c3b9d74f7acea53f29e25b"} May 21 15:05:06.408356 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:06.408317 2557 generic.go:358] "Generic (PLEG): container finished" podID="908878f3-586c-4c6d-8086-84860849b99e" containerID="6690142131dc420c1eee18042d89b292eff1b4beb6111e3b898d84a50eba55ec" exitCode=0 May 21 15:05:06.408818 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:06.408389 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bbg8" event={"ID":"908878f3-586c-4c6d-8086-84860849b99e","Type":"ContainerDied","Data":"6690142131dc420c1eee18042d89b292eff1b4beb6111e3b898d84a50eba55ec"} May 21 15:05:06.409735 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:06.409702 2557 generic.go:358] "Generic (PLEG): container finished" podID="96507378-7ee5-4018-a385-e8f2c1d0c5f5" containerID="b0f69b29accff57eb3a0726eadc1e6efed336a2561c3b9d74f7acea53f29e25b" exitCode=0 May 21 15:05:06.409814 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:06.409774 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2" event={"ID":"96507378-7ee5-4018-a385-e8f2c1d0c5f5","Type":"ContainerDied","Data":"b0f69b29accff57eb3a0726eadc1e6efed336a2561c3b9d74f7acea53f29e25b"} May 21 15:05:10.428032 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:10.427949 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2" event={"ID":"96507378-7ee5-4018-a385-e8f2c1d0c5f5","Type":"ContainerStarted","Data":"8bd5546250bee10e2f93e0ee801ba07bc9e7c1fbe10564fa8d273155bbd82151"} May 21 15:05:10.428518 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:10.428247 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2" May 21 15:05:10.429630 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:10.429606 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bbg8" event={"ID":"908878f3-586c-4c6d-8086-84860849b99e","Type":"ContainerStarted","Data":"2804db73fa01b0cc05c2b1d967331266117d925bf06eba2a1c3971c43f23d3fd"} May 21 15:05:10.429802 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:10.429786 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bbg8" May 21 15:05:10.451356 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:10.451286 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2" podStartSLOduration=1.7158764290000001 podStartE2EDuration="17.451266093s" podCreationTimestamp="2026-05-21 15:04:53 +0000 UTC" firstStartedPulling="2026-05-21 15:04:53.611127553 +0000 UTC m=+620.907003438" lastFinishedPulling="2026-05-21 15:05:09.346517216 +0000 UTC m=+636.642393102" observedRunningTime="2026-05-21 15:05:10.449158118 +0000 UTC m=+637.745034021" watchObservedRunningTime="2026-05-21 15:05:10.451266093 +0000 UTC m=+637.747141994" May 21 15:05:10.469059 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:10.469003 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bbg8" podStartSLOduration=2.533703355 podStartE2EDuration="17.468971403s" podCreationTimestamp="2026-05-21 15:04:53 +0000 UTC" firstStartedPulling="2026-05-21 15:04:54.415459744 +0000 UTC m=+621.711335636" lastFinishedPulling="2026-05-21 15:05:09.350727801 +0000 UTC m=+636.646603684" observedRunningTime="2026-05-21 15:05:10.467158605 +0000 UTC m=+637.763034541" watchObservedRunningTime="2026-05-21 15:05:10.468971403 +0000 UTC m=+637.764847347" May 21 15:05:21.445960 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:21.445927 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2" May 21 15:05:21.446758 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:21.446736 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bbg8" May 21 15:05:42.140201 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:42.140159 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm"] May 21 15:05:42.165432 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:42.165405 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm"] May 21 15:05:42.165584 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:42.165529 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm" May 21 15:05:42.168077 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:42.168051 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 21 15:05:42.258956 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:42.258922 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a8ce25a-ca05-4a54-a07c-a4e2baac97d7-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm\" (UID: \"4a8ce25a-ca05-4a54-a07c-a4e2baac97d7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm" May 21 15:05:42.258956 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:42.258973 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lbp5\" (UniqueName: \"kubernetes.io/projected/4a8ce25a-ca05-4a54-a07c-a4e2baac97d7-kube-api-access-5lbp5\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm\" (UID: \"4a8ce25a-ca05-4a54-a07c-a4e2baac97d7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm" May 21 15:05:42.259213 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:42.259101 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4a8ce25a-ca05-4a54-a07c-a4e2baac97d7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm\" (UID: \"4a8ce25a-ca05-4a54-a07c-a4e2baac97d7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm" May 21 15:05:42.259213 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:42.259149 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a8ce25a-ca05-4a54-a07c-a4e2baac97d7-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm\" (UID: \"4a8ce25a-ca05-4a54-a07c-a4e2baac97d7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm" May 21 15:05:42.259297 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:42.259219 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a8ce25a-ca05-4a54-a07c-a4e2baac97d7-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm\" (UID: \"4a8ce25a-ca05-4a54-a07c-a4e2baac97d7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm" May 21 15:05:42.259297 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:42.259241 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a8ce25a-ca05-4a54-a07c-a4e2baac97d7-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm\" (UID: \"4a8ce25a-ca05-4a54-a07c-a4e2baac97d7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm" May 21 15:05:42.360118 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:42.360074 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4a8ce25a-ca05-4a54-a07c-a4e2baac97d7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm\" (UID: \"4a8ce25a-ca05-4a54-a07c-a4e2baac97d7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm" May 21 15:05:42.360118 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:42.360122 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a8ce25a-ca05-4a54-a07c-a4e2baac97d7-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm\" (UID: \"4a8ce25a-ca05-4a54-a07c-a4e2baac97d7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm" May 21 15:05:42.360370 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:42.360170 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a8ce25a-ca05-4a54-a07c-a4e2baac97d7-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm\" (UID: \"4a8ce25a-ca05-4a54-a07c-a4e2baac97d7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm" May 21 15:05:42.360370 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:42.360188 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a8ce25a-ca05-4a54-a07c-a4e2baac97d7-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm\" (UID: \"4a8ce25a-ca05-4a54-a07c-a4e2baac97d7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm" May 21 15:05:42.360370 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:42.360219 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a8ce25a-ca05-4a54-a07c-a4e2baac97d7-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm\" (UID: \"4a8ce25a-ca05-4a54-a07c-a4e2baac97d7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm" May 21 15:05:42.360370 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:42.360248 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5lbp5\" (UniqueName: \"kubernetes.io/projected/4a8ce25a-ca05-4a54-a07c-a4e2baac97d7-kube-api-access-5lbp5\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm\" (UID: \"4a8ce25a-ca05-4a54-a07c-a4e2baac97d7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm" May 21 15:05:42.360608 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:42.360577 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4a8ce25a-ca05-4a54-a07c-a4e2baac97d7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm\" (UID: \"4a8ce25a-ca05-4a54-a07c-a4e2baac97d7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm" May 21 15:05:42.360779 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:42.360609 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a8ce25a-ca05-4a54-a07c-a4e2baac97d7-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm\" (UID: \"4a8ce25a-ca05-4a54-a07c-a4e2baac97d7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm" May 21 15:05:42.360779 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:42.360658 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a8ce25a-ca05-4a54-a07c-a4e2baac97d7-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm\" (UID: \"4a8ce25a-ca05-4a54-a07c-a4e2baac97d7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm" May 21 15:05:42.362536 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:42.362506 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a8ce25a-ca05-4a54-a07c-a4e2baac97d7-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm\" (UID: \"4a8ce25a-ca05-4a54-a07c-a4e2baac97d7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm" May 21 15:05:42.362872 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:42.362851 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a8ce25a-ca05-4a54-a07c-a4e2baac97d7-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm\" (UID: \"4a8ce25a-ca05-4a54-a07c-a4e2baac97d7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm" May 21 15:05:42.368119 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:42.368100 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lbp5\" (UniqueName: \"kubernetes.io/projected/4a8ce25a-ca05-4a54-a07c-a4e2baac97d7-kube-api-access-5lbp5\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm\" (UID: \"4a8ce25a-ca05-4a54-a07c-a4e2baac97d7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm" May 21 15:05:42.475675 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:42.475636 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm" May 21 15:05:42.625353 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:42.625325 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm"] May 21 15:05:42.627866 ip-10-0-137-49 kubenswrapper[2557]: W0521 15:05:42.627836 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a8ce25a_ca05_4a54_a07c_a4e2baac97d7.slice/crio-41133d51b79382856186795015856db06061009e75f158f7e6eda255fed56ef3 WatchSource:0}: Error finding container 41133d51b79382856186795015856db06061009e75f158f7e6eda255fed56ef3: Status 404 returned error can't find the container with id 41133d51b79382856186795015856db06061009e75f158f7e6eda255fed56ef3 May 21 15:05:42.632297 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:42.632279 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 15:05:43.558158 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:43.558114 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm" event={"ID":"4a8ce25a-ca05-4a54-a07c-a4e2baac97d7","Type":"ContainerStarted","Data":"5ef61b6e4d88b3e2c2ae598f03ec2ed78dba125dc1e68b4da9a1770dbdeaaa9b"} May 21 15:05:43.558158 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:43.558157 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm" event={"ID":"4a8ce25a-ca05-4a54-a07c-a4e2baac97d7","Type":"ContainerStarted","Data":"41133d51b79382856186795015856db06061009e75f158f7e6eda255fed56ef3"} May 21 15:05:48.577919 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:48.577830 2557 generic.go:358] "Generic (PLEG): container finished" podID="4a8ce25a-ca05-4a54-a07c-a4e2baac97d7" containerID="5ef61b6e4d88b3e2c2ae598f03ec2ed78dba125dc1e68b4da9a1770dbdeaaa9b" exitCode=0 May 21 15:05:48.577919 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:48.577903 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm" event={"ID":"4a8ce25a-ca05-4a54-a07c-a4e2baac97d7","Type":"ContainerDied","Data":"5ef61b6e4d88b3e2c2ae598f03ec2ed78dba125dc1e68b4da9a1770dbdeaaa9b"} May 21 15:05:49.583128 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:49.583093 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm" event={"ID":"4a8ce25a-ca05-4a54-a07c-a4e2baac97d7","Type":"ContainerStarted","Data":"1e0294ec25179850027a514485a0df74ab8e672d6493aaae7232cf0ab264c22d"} May 21 15:05:49.583556 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:49.583315 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm" May 21 15:05:49.606120 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:05:49.606050 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm" podStartSLOduration=7.253561495 podStartE2EDuration="7.60602793s" podCreationTimestamp="2026-05-21 15:05:42 +0000 UTC" firstStartedPulling="2026-05-21 15:05:48.578558075 +0000 UTC m=+675.874433954" lastFinishedPulling="2026-05-21 15:05:48.931024507 +0000 UTC m=+676.226900389" observedRunningTime="2026-05-21 15:05:49.604099705 +0000 UTC m=+676.899975606" watchObservedRunningTime="2026-05-21 15:05:49.60602793 +0000 UTC m=+676.901903833" May 21 15:06:00.601106 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:06:00.601072 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm" May 21 15:09:33.253746 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:09:33.253662 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qfg49_c1ee545c-62b8-4223-8c79-c00a1a036620/console-operator/2.log" May 21 15:09:33.255630 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:09:33.255604 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qfg49_c1ee545c-62b8-4223-8c79-c00a1a036620/console-operator/2.log" May 21 15:14:33.278541 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:14:33.278504 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qfg49_c1ee545c-62b8-4223-8c79-c00a1a036620/console-operator/2.log" May 21 15:14:33.280928 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:14:33.280905 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qfg49_c1ee545c-62b8-4223-8c79-c00a1a036620/console-operator/2.log" May 21 15:17:48.731392 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:17:48.731350 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l2g2q"] May 21 15:17:48.731937 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:17:48.731621 2557 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l2g2q" podUID="d2f817ee-e2b6-4dc8-8dbb-1b9641baab34" containerName="manager" containerID="cri-o://2daa2b6722a9ecc319e3013314f4d8db54854ac1f2b9d1a76a5d6981ec9cab3d" gracePeriod=10 May 21 15:17:49.689654 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:17:49.689624 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l2g2q" May 21 15:17:49.776696 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:17:49.776601 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jctj6\" (UniqueName: \"kubernetes.io/projected/d2f817ee-e2b6-4dc8-8dbb-1b9641baab34-kube-api-access-jctj6\") pod \"d2f817ee-e2b6-4dc8-8dbb-1b9641baab34\" (UID: \"d2f817ee-e2b6-4dc8-8dbb-1b9641baab34\") " May 21 15:17:49.776696 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:17:49.776650 2557 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2f817ee-e2b6-4dc8-8dbb-1b9641baab34-extensions-socket-volume\") pod \"d2f817ee-e2b6-4dc8-8dbb-1b9641baab34\" (UID: \"d2f817ee-e2b6-4dc8-8dbb-1b9641baab34\") " May 21 15:17:49.777223 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:17:49.777053 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2f817ee-e2b6-4dc8-8dbb-1b9641baab34-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d2f817ee-e2b6-4dc8-8dbb-1b9641baab34" (UID: "d2f817ee-e2b6-4dc8-8dbb-1b9641baab34"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 21 15:17:49.778910 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:17:49.778882 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2f817ee-e2b6-4dc8-8dbb-1b9641baab34-kube-api-access-jctj6" (OuterVolumeSpecName: "kube-api-access-jctj6") pod "d2f817ee-e2b6-4dc8-8dbb-1b9641baab34" (UID: "d2f817ee-e2b6-4dc8-8dbb-1b9641baab34"). InnerVolumeSpecName "kube-api-access-jctj6". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 21 15:17:49.877334 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:17:49.877298 2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d2f817ee-e2b6-4dc8-8dbb-1b9641baab34-extensions-socket-volume\") on node \"ip-10-0-137-49.ec2.internal\" DevicePath \"\"" May 21 15:17:49.877334 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:17:49.877331 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jctj6\" (UniqueName: \"kubernetes.io/projected/d2f817ee-e2b6-4dc8-8dbb-1b9641baab34-kube-api-access-jctj6\") on node \"ip-10-0-137-49.ec2.internal\" DevicePath \"\"" May 21 15:17:50.265342 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:17:50.265309 2557 generic.go:358] "Generic (PLEG): container finished" podID="d2f817ee-e2b6-4dc8-8dbb-1b9641baab34" containerID="2daa2b6722a9ecc319e3013314f4d8db54854ac1f2b9d1a76a5d6981ec9cab3d" exitCode=0 May 21 15:17:50.265342 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:17:50.265347 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l2g2q" event={"ID":"d2f817ee-e2b6-4dc8-8dbb-1b9641baab34","Type":"ContainerDied","Data":"2daa2b6722a9ecc319e3013314f4d8db54854ac1f2b9d1a76a5d6981ec9cab3d"} May 21 15:17:50.265548 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:17:50.265371 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l2g2q" event={"ID":"d2f817ee-e2b6-4dc8-8dbb-1b9641baab34","Type":"ContainerDied","Data":"549583b7846f98e79d24ae3781a5035d10560c8da70481cc7fd131bb61faafee"} May 21 15:17:50.265548 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:17:50.265395 2557 scope.go:117] "RemoveContainer" containerID="2daa2b6722a9ecc319e3013314f4d8db54854ac1f2b9d1a76a5d6981ec9cab3d" May 21 15:17:50.265548 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:17:50.265402 2557 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l2g2q" May 21 15:17:50.274496 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:17:50.274477 2557 scope.go:117] "RemoveContainer" containerID="2daa2b6722a9ecc319e3013314f4d8db54854ac1f2b9d1a76a5d6981ec9cab3d" May 21 15:17:50.274780 ip-10-0-137-49 kubenswrapper[2557]: E0521 15:17:50.274759 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2daa2b6722a9ecc319e3013314f4d8db54854ac1f2b9d1a76a5d6981ec9cab3d\": container with ID starting with 2daa2b6722a9ecc319e3013314f4d8db54854ac1f2b9d1a76a5d6981ec9cab3d not found: ID does not exist" containerID="2daa2b6722a9ecc319e3013314f4d8db54854ac1f2b9d1a76a5d6981ec9cab3d" May 21 15:17:50.274831 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:17:50.274790 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2daa2b6722a9ecc319e3013314f4d8db54854ac1f2b9d1a76a5d6981ec9cab3d"} err="failed to get container status \"2daa2b6722a9ecc319e3013314f4d8db54854ac1f2b9d1a76a5d6981ec9cab3d\": rpc error: code = NotFound desc = could not find container \"2daa2b6722a9ecc319e3013314f4d8db54854ac1f2b9d1a76a5d6981ec9cab3d\": container with ID starting with 2daa2b6722a9ecc319e3013314f4d8db54854ac1f2b9d1a76a5d6981ec9cab3d not found: ID does not exist" May 21 15:17:50.286111 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:17:50.286071 2557 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l2g2q"] May 21 15:17:50.289921 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:17:50.289892 2557 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-l2g2q"] May 21 15:17:51.312131 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:17:51.312090 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2f817ee-e2b6-4dc8-8dbb-1b9641baab34" path="/var/lib/kubelet/pods/d2f817ee-e2b6-4dc8-8dbb-1b9641baab34/volumes" May 21 15:18:54.850341 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:18:54.850307 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qdvqp"] May 21 15:18:54.850824 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:18:54.850685 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2f817ee-e2b6-4dc8-8dbb-1b9641baab34" containerName="manager" May 21 15:18:54.850824 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:18:54.850698 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2f817ee-e2b6-4dc8-8dbb-1b9641baab34" containerName="manager" May 21 15:18:54.850824 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:18:54.850767 2557 memory_manager.go:356] "RemoveStaleState removing state" podUID="d2f817ee-e2b6-4dc8-8dbb-1b9641baab34" containerName="manager" May 21 15:18:54.853805 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:18:54.853786 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qdvqp" May 21 15:18:54.856504 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:18:54.856482 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-54j4h\"" May 21 15:18:54.863787 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:18:54.863765 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qdvqp"] May 21 15:18:54.970138 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:18:54.970100 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7c67d2d-8256-485d-aa33-7f4edafa78f7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-qdvqp\" (UID: \"f7c67d2d-8256-485d-aa33-7f4edafa78f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qdvqp" May 21 15:18:54.970138 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:18:54.970141 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfxs2\" (UniqueName: \"kubernetes.io/projected/f7c67d2d-8256-485d-aa33-7f4edafa78f7-kube-api-access-pfxs2\") pod \"kuadrant-operator-controller-manager-55c7f4c975-qdvqp\" (UID: \"f7c67d2d-8256-485d-aa33-7f4edafa78f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qdvqp" May 21 15:18:55.071215 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:18:55.071160 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7c67d2d-8256-485d-aa33-7f4edafa78f7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-qdvqp\" (UID: \"f7c67d2d-8256-485d-aa33-7f4edafa78f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qdvqp" May 21 15:18:55.071397 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:18:55.071232 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pfxs2\" (UniqueName: \"kubernetes.io/projected/f7c67d2d-8256-485d-aa33-7f4edafa78f7-kube-api-access-pfxs2\") pod \"kuadrant-operator-controller-manager-55c7f4c975-qdvqp\" (UID: \"f7c67d2d-8256-485d-aa33-7f4edafa78f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qdvqp" May 21 15:18:55.071604 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:18:55.071570 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7c67d2d-8256-485d-aa33-7f4edafa78f7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-qdvqp\" (UID: \"f7c67d2d-8256-485d-aa33-7f4edafa78f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qdvqp" May 21 15:18:55.083862 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:18:55.083829 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfxs2\" (UniqueName: \"kubernetes.io/projected/f7c67d2d-8256-485d-aa33-7f4edafa78f7-kube-api-access-pfxs2\") pod \"kuadrant-operator-controller-manager-55c7f4c975-qdvqp\" (UID: \"f7c67d2d-8256-485d-aa33-7f4edafa78f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qdvqp" May 21 15:18:55.165028 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:18:55.164910 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qdvqp" May 21 15:18:55.309517 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:18:55.309492 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qdvqp"] May 21 15:18:55.311932 ip-10-0-137-49 kubenswrapper[2557]: W0521 15:18:55.311904 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7c67d2d_8256_485d_aa33_7f4edafa78f7.slice/crio-567a04bbbf24dae6e996e96b023b952cb4f3640b3a47a1c904212b260b161742 WatchSource:0}: Error finding container 567a04bbbf24dae6e996e96b023b952cb4f3640b3a47a1c904212b260b161742: Status 404 returned error can't find the container with id 567a04bbbf24dae6e996e96b023b952cb4f3640b3a47a1c904212b260b161742 May 21 15:18:55.314295 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:18:55.314275 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 15:18:55.497389 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:18:55.497355 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qdvqp" event={"ID":"f7c67d2d-8256-485d-aa33-7f4edafa78f7","Type":"ContainerStarted","Data":"142efc4a6fe72bc2382aa2295dae9e4502733e51c7d2cdc520f50364ad6586c6"} May 21 15:18:55.497389 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:18:55.497393 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qdvqp" event={"ID":"f7c67d2d-8256-485d-aa33-7f4edafa78f7","Type":"ContainerStarted","Data":"567a04bbbf24dae6e996e96b023b952cb4f3640b3a47a1c904212b260b161742"} May 21 15:18:55.497650 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:18:55.497516 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qdvqp" May 21 15:18:55.518678 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:18:55.518604 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qdvqp" podStartSLOduration=1.518588235 podStartE2EDuration="1.518588235s" podCreationTimestamp="2026-05-21 15:18:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:18:55.517963634 +0000 UTC m=+1462.813839538" watchObservedRunningTime="2026-05-21 15:18:55.518588235 +0000 UTC m=+1462.814464137" May 21 15:19:06.503682 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:19:06.503647 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-qdvqp" May 21 15:19:33.307657 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:19:33.307628 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qfg49_c1ee545c-62b8-4223-8c79-c00a1a036620/console-operator/2.log" May 21 15:19:33.310896 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:19:33.310869 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qfg49_c1ee545c-62b8-4223-8c79-c00a1a036620/console-operator/2.log" May 21 15:24:33.335224 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:24:33.335096 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qfg49_c1ee545c-62b8-4223-8c79-c00a1a036620/console-operator/2.log" May 21 15:24:33.339118 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:24:33.339092 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qfg49_c1ee545c-62b8-4223-8c79-c00a1a036620/console-operator/2.log" May 21 15:28:38.748743 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:38.748704 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-7n5mv_ec234a89-1af0-4d45-994f-798dcc61ef77/manager/0.log" May 21 15:28:38.874223 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:38.874190 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5464f4fffc-4tb5v_bc7770eb-db09-4a56-8820-b38851f7c2bb/maas-api/0.log" May 21 15:28:39.237456 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:39.237410 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-b226r_1321bcaa-ae92-4c5f-a5fd-3d6f312850bd/manager/1.log" May 21 15:28:39.345656 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:39.345617 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-677f98f9b9-d6ztp_0cf3e54b-3c3d-4ba8-9bd0-af5e5c094c1e/manager/0.log" May 21 15:28:41.125684 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:41.125653 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-l7jh2_824e0a25-8faa-46a7-ab55-ecf3c74621af/manager/0.log" May 21 15:28:41.505335 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:41.505299 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-qdvqp_f7c67d2d-8256-485d-aa33-7f4edafa78f7/manager/0.log" May 21 15:28:41.733588 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:41.733554 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-k8m4f_18bdb597-c401-426e-8af5-7905e3e50e02/manager/0.log" May 21 15:28:42.182988 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:42.182958 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-d7lx4_e4eb5a51-0c60-405e-9127-f1fedcfcf82e/discovery/0.log" May 21 15:28:42.295227 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:42.295174 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-855b467995-gqhpp_ecf94b41-227e-4d71-969e-4f3177ff8025/kube-auth-proxy/0.log" May 21 15:28:42.757021 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:42.756953 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b98c464fb-pxm7b_ba458fb2-e7b0-4b6b-9127-e936f8f26f96/router/0.log" May 21 15:28:43.096231 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:43.096144 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2_96507378-7ee5-4018-a385-e8f2c1d0c5f5/storage-initializer/0.log" May 21 15:28:43.104336 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:43.104305 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-p74s2_96507378-7ee5-4018-a385-e8f2c1d0c5f5/main/0.log" May 21 15:28:43.218194 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:43.218166 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm_4a8ce25a-ca05-4a54-a07c-a4e2baac97d7/storage-initializer/0.log" May 21 15:28:43.225323 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:43.225303 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-fmhdm_4a8ce25a-ca05-4a54-a07c-a4e2baac97d7/main/0.log" May 21 15:28:43.339561 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:43.339528 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-5bbg8_908878f3-586c-4c6d-8086-84860849b99e/storage-initializer/0.log" May 21 15:28:43.346667 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:43.346596 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-5bbg8_908878f3-586c-4c6d-8086-84860849b99e/main/0.log" May 21 15:28:50.510053 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:50.510019 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7qqb9_ad7e70f3-1d8a-4cbd-ba75-479a3dda1538/global-pull-secret-syncer/0.log" May 21 15:28:50.713709 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:50.713677 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-v85zc_bd5269e8-4aa4-489a-a650-e45b4f8a99d7/konnectivity-agent/0.log" May 21 15:28:50.730036 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:50.730001 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-49.ec2.internal_424ec5f97454f8128494aaae5c30ac05/haproxy/0.log" May 21 15:28:54.953405 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:54.953377 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-l7jh2_824e0a25-8faa-46a7-ab55-ecf3c74621af/manager/0.log" May 21 15:28:55.075696 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:55.075662 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-qdvqp_f7c67d2d-8256-485d-aa33-7f4edafa78f7/manager/0.log" May 21 15:28:55.170794 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:55.170760 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-k8m4f_18bdb597-c401-426e-8af5-7905e3e50e02/manager/0.log" May 21 15:28:56.579156 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:56.579125 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-lm77b_abea9f6a-e038-4f3e-acba-28ffcd808874/cluster-monitoring-operator/0.log" May 21 15:28:56.630274 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:56.630246 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-xdrg8_8b61588a-a197-40da-a81f-35bd70515b6f/kube-state-metrics/0.log" May 21 15:28:56.669568 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:56.669540 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-xdrg8_8b61588a-a197-40da-a81f-35bd70515b6f/kube-rbac-proxy-main/0.log" May 21 15:28:56.697516 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:56.697481 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-xdrg8_8b61588a-a197-40da-a81f-35bd70515b6f/kube-rbac-proxy-self/0.log" May 21 15:28:56.781800 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:56.781742 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9xmnp_f4aea9bc-fe76-4096-b336-75fd2f2c891a/node-exporter/0.log" May 21 15:28:56.809179 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:56.809151 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9xmnp_f4aea9bc-fe76-4096-b336-75fd2f2c891a/kube-rbac-proxy/0.log" May 21 15:28:56.838494 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:56.838415 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9xmnp_f4aea9bc-fe76-4096-b336-75fd2f2c891a/init-textfile/0.log" May 21 15:28:57.330825 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:57.330797 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-74df5_5949dbe3-9662-4c63-99aa-4a4935f0d84f/prometheus-operator/0.log" May 21 15:28:57.351728 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:57.351690 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-74df5_5949dbe3-9662-4c63-99aa-4a4935f0d84f/kube-rbac-proxy/0.log" May 21 15:28:57.376960 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:57.376935 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-drv2v_a9963900-501f-402a-af30-87253063a7ea/prometheus-operator-admission-webhook/0.log" May 21 15:28:57.413332 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:57.413307 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fb6ff45b6-t98dz_70aad2f1-209d-4ef9-b696-663fcb5bbcfb/telemeter-client/0.log" May 21 15:28:57.433872 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:57.433843 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fb6ff45b6-t98dz_70aad2f1-209d-4ef9-b696-663fcb5bbcfb/reload/0.log" May 21 15:28:57.456509 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:57.456481 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fb6ff45b6-t98dz_70aad2f1-209d-4ef9-b696-663fcb5bbcfb/kube-rbac-proxy/0.log" May 21 15:28:59.249937 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:59.249905 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qfg49_c1ee545c-62b8-4223-8c79-c00a1a036620/console-operator/2.log" May 21 15:28:59.254404 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:59.254385 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qfg49_c1ee545c-62b8-4223-8c79-c00a1a036620/console-operator/3.log" May 21 15:28:59.662915 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:59.662837 2557 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zxzd6/perf-node-gather-daemonset-8tg72"] May 21 15:28:59.666535 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:59.666512 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-8tg72" May 21 15:28:59.669056 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:59.669035 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zxzd6\"/\"openshift-service-ca.crt\"" May 21 15:28:59.670148 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:59.670122 2557 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zxzd6\"/\"default-dockercfg-g8d8k\"" May 21 15:28:59.670256 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:59.670129 2557 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zxzd6\"/\"kube-root-ca.crt\"" May 21 15:28:59.676807 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:59.676782 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zxzd6/perf-node-gather-daemonset-8tg72"] May 21 15:28:59.708994 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:59.708948 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c2308014-4f59-4059-9d2f-bc849e4296df-proc\") pod \"perf-node-gather-daemonset-8tg72\" (UID: \"c2308014-4f59-4059-9d2f-bc849e4296df\") " pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-8tg72" May 21 15:28:59.709163 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:59.709009 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7l28\" (UniqueName: \"kubernetes.io/projected/c2308014-4f59-4059-9d2f-bc849e4296df-kube-api-access-k7l28\") pod \"perf-node-gather-daemonset-8tg72\" (UID: \"c2308014-4f59-4059-9d2f-bc849e4296df\") " pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-8tg72" May 21 15:28:59.709163 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:59.709053 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2308014-4f59-4059-9d2f-bc849e4296df-lib-modules\") pod \"perf-node-gather-daemonset-8tg72\" (UID: \"c2308014-4f59-4059-9d2f-bc849e4296df\") " pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-8tg72" May 21 15:28:59.709163 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:59.709096 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2308014-4f59-4059-9d2f-bc849e4296df-sys\") pod \"perf-node-gather-daemonset-8tg72\" (UID: \"c2308014-4f59-4059-9d2f-bc849e4296df\") " pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-8tg72" May 21 15:28:59.709163 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:59.709118 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c2308014-4f59-4059-9d2f-bc849e4296df-podres\") pod \"perf-node-gather-daemonset-8tg72\" (UID: \"c2308014-4f59-4059-9d2f-bc849e4296df\") " pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-8tg72" May 21 15:28:59.810227 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:59.810191 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7l28\" (UniqueName: \"kubernetes.io/projected/c2308014-4f59-4059-9d2f-bc849e4296df-kube-api-access-k7l28\") pod \"perf-node-gather-daemonset-8tg72\" (UID: \"c2308014-4f59-4059-9d2f-bc849e4296df\") " pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-8tg72" May 21 15:28:59.810433 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:59.810280 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2308014-4f59-4059-9d2f-bc849e4296df-lib-modules\") pod \"perf-node-gather-daemonset-8tg72\" (UID: \"c2308014-4f59-4059-9d2f-bc849e4296df\") " pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-8tg72" May 21 15:28:59.810433 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:59.810351 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2308014-4f59-4059-9d2f-bc849e4296df-sys\") pod \"perf-node-gather-daemonset-8tg72\" (UID: \"c2308014-4f59-4059-9d2f-bc849e4296df\") " pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-8tg72" May 21 15:28:59.810433 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:59.810386 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c2308014-4f59-4059-9d2f-bc849e4296df-podres\") pod \"perf-node-gather-daemonset-8tg72\" (UID: \"c2308014-4f59-4059-9d2f-bc849e4296df\") " pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-8tg72" May 21 15:28:59.810433 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:59.810427 2557 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c2308014-4f59-4059-9d2f-bc849e4296df-proc\") pod \"perf-node-gather-daemonset-8tg72\" (UID: \"c2308014-4f59-4059-9d2f-bc849e4296df\") " pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-8tg72" May 21 15:28:59.810678 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:59.810485 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c2308014-4f59-4059-9d2f-bc849e4296df-lib-modules\") pod \"perf-node-gather-daemonset-8tg72\" (UID: \"c2308014-4f59-4059-9d2f-bc849e4296df\") " pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-8tg72" May 21 15:28:59.810678 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:59.810490 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2308014-4f59-4059-9d2f-bc849e4296df-sys\") pod \"perf-node-gather-daemonset-8tg72\" (UID: \"c2308014-4f59-4059-9d2f-bc849e4296df\") " pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-8tg72" May 21 15:28:59.810678 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:59.810522 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c2308014-4f59-4059-9d2f-bc849e4296df-proc\") pod \"perf-node-gather-daemonset-8tg72\" (UID: \"c2308014-4f59-4059-9d2f-bc849e4296df\") " pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-8tg72" May 21 15:28:59.810678 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:59.810539 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c2308014-4f59-4059-9d2f-bc849e4296df-podres\") pod \"perf-node-gather-daemonset-8tg72\" (UID: \"c2308014-4f59-4059-9d2f-bc849e4296df\") " pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-8tg72" May 21 15:28:59.818433 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:59.818408 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7l28\" (UniqueName: \"kubernetes.io/projected/c2308014-4f59-4059-9d2f-bc849e4296df-kube-api-access-k7l28\") pod \"perf-node-gather-daemonset-8tg72\" (UID: \"c2308014-4f59-4059-9d2f-bc849e4296df\") " pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-8tg72" May 21 15:28:59.977815 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:28:59.977779 2557 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-8tg72" May 21 15:29:00.116821 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:00.116792 2557 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zxzd6/perf-node-gather-daemonset-8tg72"] May 21 15:29:00.119946 ip-10-0-137-49 kubenswrapper[2557]: W0521 15:29:00.119915 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc2308014_4f59_4059_9d2f_bc849e4296df.slice/crio-0ec61cb271874becc4515e18d72e5cf462948e81acc6a3f2ecc4aa8dd173e6a6 WatchSource:0}: Error finding container 0ec61cb271874becc4515e18d72e5cf462948e81acc6a3f2ecc4aa8dd173e6a6: Status 404 returned error can't find the container with id 0ec61cb271874becc4515e18d72e5cf462948e81acc6a3f2ecc4aa8dd173e6a6 May 21 15:29:00.121661 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:00.121644 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 21 15:29:00.331965 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:00.331858 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-x6m8s_7540dbe5-45d7-4c07-888b-14d5a25a5d23/volume-data-source-validator/0.log" May 21 15:29:00.730817 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:00.730780 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-8tg72" event={"ID":"c2308014-4f59-4059-9d2f-bc849e4296df","Type":"ContainerStarted","Data":"65a10d0ebc5667b261d75bbcd90426ba587960d8912c4452ff9d789d1316159e"} May 21 15:29:00.731009 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:00.730824 2557 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-8tg72" event={"ID":"c2308014-4f59-4059-9d2f-bc849e4296df","Type":"ContainerStarted","Data":"0ec61cb271874becc4515e18d72e5cf462948e81acc6a3f2ecc4aa8dd173e6a6"} May 21 15:29:00.731009 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:00.730923 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-8tg72" May 21 15:29:00.749387 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:00.749337 2557 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-8tg72" podStartSLOduration=1.74931894 podStartE2EDuration="1.74931894s" podCreationTimestamp="2026-05-21 15:28:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:29:00.747242053 +0000 UTC m=+2068.043117957" watchObservedRunningTime="2026-05-21 15:29:00.74931894 +0000 UTC m=+2068.045194840" May 21 15:29:01.118762 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:01.118658 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-57vtw_c45651aa-fdb1-463b-a7cd-e3894c939874/dns/0.log" May 21 15:29:01.140345 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:01.140316 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-57vtw_c45651aa-fdb1-463b-a7cd-e3894c939874/kube-rbac-proxy/0.log" May 21 15:29:01.290969 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:01.290940 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5tqsh_575ad37b-aef2-41aa-8c72-53f7a515aa96/dns-node-resolver/0.log" May 21 15:29:01.934416 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:01.934384 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w4lgs_a6293d82-33a8-4156-998f-c0ed8232df8c/node-ca/0.log" May 21 15:29:02.871909 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:02.871861 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-d7lx4_e4eb5a51-0c60-405e-9127-f1fedcfcf82e/discovery/0.log" May 21 15:29:02.890895 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:02.890862 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-855b467995-gqhpp_ecf94b41-227e-4d71-969e-4f3177ff8025/kube-auth-proxy/0.log" May 21 15:29:03.063126 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:03.063095 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b98c464fb-pxm7b_ba458fb2-e7b0-4b6b-9127-e936f8f26f96/router/0.log" May 21 15:29:03.632997 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:03.632957 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tpsq5_cf248aa5-1086-4c30-919a-df06b4850374/serve-healthcheck-canary/0.log" May 21 15:29:04.165466 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:04.165435 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2xmdh_ceebc474-22a2-4fe2-8a53-05e42c8b77a5/kube-rbac-proxy/0.log" May 21 15:29:04.193473 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:04.193445 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2xmdh_ceebc474-22a2-4fe2-8a53-05e42c8b77a5/exporter/0.log" May 21 15:29:04.227177 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:04.227143 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2xmdh_ceebc474-22a2-4fe2-8a53-05e42c8b77a5/extractor/0.log" May 21 15:29:06.490042 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:06.490005 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-7n5mv_ec234a89-1af0-4d45-994f-798dcc61ef77/manager/0.log" May 21 15:29:06.529720 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:06.529691 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5464f4fffc-4tb5v_bc7770eb-db09-4a56-8820-b38851f7c2bb/maas-api/0.log" May 21 15:29:06.673122 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:06.673092 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-b226r_1321bcaa-ae92-4c5f-a5fd-3d6f312850bd/manager/0.log" May 21 15:29:06.684509 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:06.684484 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-b226r_1321bcaa-ae92-4c5f-a5fd-3d6f312850bd/manager/1.log" May 21 15:29:06.706124 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:06.706095 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-677f98f9b9-d6ztp_0cf3e54b-3c3d-4ba8-9bd0-af5e5c094c1e/manager/0.log" May 21 15:29:06.744418 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:06.744345 2557 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zxzd6/perf-node-gather-daemonset-8tg72" May 21 15:29:14.028477 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:14.028446 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hsxn8_460bd20d-6a98-47e3-9a2a-a1438b7cc63c/kube-multus-additional-cni-plugins/0.log" May 21 15:29:14.049708 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:14.049676 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hsxn8_460bd20d-6a98-47e3-9a2a-a1438b7cc63c/egress-router-binary-copy/0.log" May 21 15:29:14.071076 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:14.071045 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hsxn8_460bd20d-6a98-47e3-9a2a-a1438b7cc63c/cni-plugins/0.log" May 21 15:29:14.137341 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:14.137311 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hsxn8_460bd20d-6a98-47e3-9a2a-a1438b7cc63c/bond-cni-plugin/0.log" May 21 15:29:14.158579 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:14.158548 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hsxn8_460bd20d-6a98-47e3-9a2a-a1438b7cc63c/routeoverride-cni/0.log" May 21 15:29:14.207093 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:14.207064 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hsxn8_460bd20d-6a98-47e3-9a2a-a1438b7cc63c/whereabouts-cni-bincopy/0.log" May 21 15:29:14.254394 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:14.254366 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hsxn8_460bd20d-6a98-47e3-9a2a-a1438b7cc63c/whereabouts-cni/0.log" May 21 15:29:14.506453 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:14.506412 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nbh7v_4a5605b1-be58-4e18-85a7-35718abc3e2f/kube-multus/0.log" May 21 15:29:14.641611 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:14.641581 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qtgkj_4a47bc04-1f5f-4dc4-824a-5fa35b392b73/network-metrics-daemon/0.log" May 21 15:29:14.660620 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:14.660588 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qtgkj_4a47bc04-1f5f-4dc4-824a-5fa35b392b73/kube-rbac-proxy/0.log" May 21 15:29:15.486831 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:15.486800 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qjxf_04d69156-db3f-4353-ada5-f84ea0fadc0c/ovn-controller/0.log" May 21 15:29:15.516665 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:15.516635 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qjxf_04d69156-db3f-4353-ada5-f84ea0fadc0c/ovn-acl-logging/0.log" May 21 15:29:15.534938 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:15.534908 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qjxf_04d69156-db3f-4353-ada5-f84ea0fadc0c/kube-rbac-proxy-node/0.log" May 21 15:29:15.556445 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:15.556414 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qjxf_04d69156-db3f-4353-ada5-f84ea0fadc0c/kube-rbac-proxy-ovn-metrics/0.log" May 21 15:29:15.574122 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:15.574102 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qjxf_04d69156-db3f-4353-ada5-f84ea0fadc0c/northd/0.log" May 21 15:29:15.593483 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:15.593461 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qjxf_04d69156-db3f-4353-ada5-f84ea0fadc0c/nbdb/0.log" May 21 15:29:15.617021 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:15.616996 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qjxf_04d69156-db3f-4353-ada5-f84ea0fadc0c/sbdb/0.log" May 21 15:29:15.710478 ip-10-0-137-49 kubenswrapper[2557]: I0521 15:29:15.710450 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2qjxf_04d69156-db3f-4353-ada5-f84ea0fadc0c/ovnkube-controller/0.log"