May 28 11:00:29.842140 ip-10-0-130-105 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 28 11:00:29.842190 ip-10-0-130-105 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 28 11:00:29.842197 ip-10-0-130-105 systemd[1]: kubelet.service: Failed with result 'resources'. May 28 11:00:29.842414 ip-10-0-130-105 systemd[1]: Failed to start Kubernetes Kubelet. May 28 11:00:39.850199 ip-10-0-130-105 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 28 11:00:39.850218 ip-10-0-130-105 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 901fc24e739643a5a288dfa03aace6a3 -- May 28 11:03:01.634379 ip-10-0-130-105 systemd[1]: Starting Kubernetes Kubelet... May 28 11:03:02.093377 ip-10-0-130-105 kubenswrapper[2551]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 11:03:02.093377 ip-10-0-130-105 kubenswrapper[2551]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 28 11:03:02.093377 ip-10-0-130-105 kubenswrapper[2551]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 11:03:02.093377 ip-10-0-130-105 kubenswrapper[2551]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 28 11:03:02.093377 ip-10-0-130-105 kubenswrapper[2551]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 28 11:03:02.095861 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.095767 2551 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 28 11:03:02.098528 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098513 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 11:03:02.098528 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098528 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 11:03:02.098590 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098532 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 11:03:02.098590 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098536 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 11:03:02.098590 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098539 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 11:03:02.098590 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098543 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 11:03:02.098590 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098546 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 11:03:02.098590 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098549 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 11:03:02.098590 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098552 2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 11:03:02.098590 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098562 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 11:03:02.098590 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098565 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 11:03:02.098590 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098568 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 11:03:02.098590 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098571 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 11:03:02.098590 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098573 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 11:03:02.098590 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098576 2551 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 11:03:02.098590 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098579 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 11:03:02.098590 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098582 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 11:03:02.098590 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098585 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 11:03:02.098590 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098587 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 11:03:02.098590 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098590 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 11:03:02.098590 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098593 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 11:03:02.098590 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098595 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 11:03:02.099071 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098598 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 11:03:02.099071 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098601 2551 feature_gate.go:328] unrecognized feature gate: Example2 May 28 11:03:02.099071 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098604 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 11:03:02.099071 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098607 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 11:03:02.099071 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098609 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 11:03:02.099071 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098612 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 11:03:02.099071 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098616 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 11:03:02.099071 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098621 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 11:03:02.099071 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098624 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 11:03:02.099071 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098626 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 11:03:02.099071 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098629 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 11:03:02.099071 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098631 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 11:03:02.099071 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098634 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 11:03:02.099071 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098636 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 11:03:02.099071 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098638 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 11:03:02.099071 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098642 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 11:03:02.099071 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098645 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 11:03:02.099071 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098647 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 11:03:02.099071 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098650 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 11:03:02.099564 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098652 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 11:03:02.099564 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098657 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 11:03:02.099564 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098660 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 11:03:02.099564 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098664 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 11:03:02.099564 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098666 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 11:03:02.099564 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098669 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 11:03:02.099564 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098672 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 11:03:02.099564 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098675 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 11:03:02.099564 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098677 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 11:03:02.099564 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098680 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 11:03:02.099564 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098682 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 11:03:02.099564 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098684 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 11:03:02.099564 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098688 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 11:03:02.099564 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098691 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 11:03:02.099564 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098695 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 11:03:02.099564 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098697 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 11:03:02.099564 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098700 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 11:03:02.099564 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098702 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 11:03:02.099564 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098705 2551 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 11:03:02.100028 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098708 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 11:03:02.100028 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098710 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 11:03:02.100028 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098713 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 11:03:02.100028 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098715 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 11:03:02.100028 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098718 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 11:03:02.100028 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098720 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 11:03:02.100028 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098723 2551 feature_gate.go:328] unrecognized feature gate: Example May 28 11:03:02.100028 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098725 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 11:03:02.100028 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098728 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 11:03:02.100028 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098730 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 11:03:02.100028 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098733 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 11:03:02.100028 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098736 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 11:03:02.100028 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098738 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 11:03:02.100028 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098740 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 11:03:02.100028 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098743 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 11:03:02.100028 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098746 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 11:03:02.100028 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098748 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 11:03:02.100028 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098751 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 11:03:02.100028 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098753 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 11:03:02.100028 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098756 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 11:03:02.100532 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098758 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 11:03:02.100532 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098761 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 11:03:02.100532 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098763 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 11:03:02.100532 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098766 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 11:03:02.100532 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098768 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 11:03:02.100532 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.098771 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 11:03:02.100727 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100715 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 11:03:02.100727 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100727 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 11:03:02.100782 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100731 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 11:03:02.100782 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100734 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 11:03:02.100782 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100737 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 11:03:02.100782 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100740 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 11:03:02.100782 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100743 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 11:03:02.100782 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100746 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 11:03:02.100782 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100749 2551 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 11:03:02.100782 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100752 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 11:03:02.100782 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100756 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 11:03:02.100782 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100760 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 11:03:02.100782 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100762 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 11:03:02.100782 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100765 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 11:03:02.100782 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100768 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 11:03:02.100782 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100770 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 11:03:02.100782 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100773 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 11:03:02.100782 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100775 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 11:03:02.100782 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100778 2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 11:03:02.100782 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100780 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 11:03:02.100782 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100783 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 11:03:02.100782 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100786 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 11:03:02.101310 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100789 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 11:03:02.101310 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100792 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 11:03:02.101310 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100795 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 11:03:02.101310 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100798 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 11:03:02.101310 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100801 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 11:03:02.101310 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100804 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 11:03:02.101310 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100806 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 11:03:02.101310 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100809 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 11:03:02.101310 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100811 2551 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 11:03:02.101310 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100814 2551 feature_gate.go:328] unrecognized feature gate: Example May 28 11:03:02.101310 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100817 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 11:03:02.101310 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100820 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 11:03:02.101310 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100822 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 11:03:02.101310 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100825 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 11:03:02.101310 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100827 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 11:03:02.101310 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100830 2551 feature_gate.go:328] unrecognized feature gate: Example2 May 28 11:03:02.101310 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100833 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 11:03:02.101310 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100835 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 11:03:02.101310 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100837 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 11:03:02.101310 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100840 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 11:03:02.101810 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100843 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 11:03:02.101810 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100845 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 11:03:02.101810 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100848 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 11:03:02.101810 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100850 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 11:03:02.101810 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100853 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 11:03:02.101810 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100855 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 11:03:02.101810 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100858 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 11:03:02.101810 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100860 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 11:03:02.101810 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100863 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 11:03:02.101810 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100866 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 11:03:02.101810 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100868 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 11:03:02.101810 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100871 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 11:03:02.101810 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100873 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 11:03:02.101810 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100877 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 11:03:02.101810 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100880 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 11:03:02.101810 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100883 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 11:03:02.101810 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100886 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 11:03:02.101810 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100888 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 11:03:02.101810 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100891 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 11:03:02.102315 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100893 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 11:03:02.102315 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100895 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 11:03:02.102315 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100898 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 11:03:02.102315 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100901 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 11:03:02.102315 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100903 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 11:03:02.102315 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100906 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 11:03:02.102315 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100909 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 11:03:02.102315 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100912 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 11:03:02.102315 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100914 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 11:03:02.102315 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100917 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 11:03:02.102315 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100919 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 11:03:02.102315 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100923 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 11:03:02.102315 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100927 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 11:03:02.102315 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100930 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 11:03:02.102315 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100933 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 11:03:02.102315 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100936 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 11:03:02.102315 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100938 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 11:03:02.102315 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100941 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 11:03:02.102315 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100943 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 11:03:02.102773 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100946 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 11:03:02.102773 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100949 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 11:03:02.102773 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100951 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 11:03:02.102773 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100954 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 11:03:02.102773 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100956 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 11:03:02.102773 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.100959 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 11:03:02.102773 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101021 2551 flags.go:64] FLAG: --address="0.0.0.0" May 28 11:03:02.102773 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101030 2551 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 28 11:03:02.102773 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101036 2551 flags.go:64] FLAG: --anonymous-auth="true" May 28 11:03:02.102773 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101041 2551 flags.go:64] FLAG: --application-metrics-count-limit="100" May 28 11:03:02.102773 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101046 2551 flags.go:64] FLAG: --authentication-token-webhook="false" May 28 11:03:02.102773 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101049 2551 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 28 11:03:02.102773 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101054 2551 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 28 11:03:02.102773 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101073 2551 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 28 11:03:02.102773 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101078 2551 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 28 11:03:02.102773 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101083 2551 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 28 11:03:02.102773 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101089 2551 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 28 11:03:02.102773 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101092 2551 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 28 11:03:02.102773 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101096 2551 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 28 11:03:02.102773 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101099 2551 flags.go:64] FLAG: --cgroup-root="" May 28 11:03:02.102773 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101102 2551 flags.go:64] FLAG: --cgroups-per-qos="true" May 28 11:03:02.102773 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101105 2551 flags.go:64] FLAG: --client-ca-file="" May 28 11:03:02.102773 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101107 2551 flags.go:64] FLAG: --cloud-config="" May 28 11:03:02.103345 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101110 2551 flags.go:64] FLAG: --cloud-provider="external" May 28 11:03:02.103345 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101113 2551 flags.go:64] FLAG: --cluster-dns="[]" May 28 11:03:02.103345 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101118 2551 flags.go:64] FLAG: --cluster-domain="" May 28 11:03:02.103345 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101121 2551 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 28 11:03:02.103345 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101124 2551 flags.go:64] FLAG: --config-dir="" May 28 11:03:02.103345 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101127 2551 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 28 11:03:02.103345 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101131 2551 flags.go:64] FLAG: --container-log-max-files="5" May 28 11:03:02.103345 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101135 2551 flags.go:64] FLAG: --container-log-max-size="10Mi" May 28 11:03:02.103345 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101138 2551 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 28 11:03:02.103345 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101141 2551 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 28 11:03:02.103345 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101145 2551 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 28 11:03:02.103345 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101148 2551 flags.go:64] FLAG: --contention-profiling="false" May 28 11:03:02.103345 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101151 2551 flags.go:64] FLAG: --cpu-cfs-quota="true" May 28 11:03:02.103345 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101154 2551 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 28 11:03:02.103345 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101158 2551 flags.go:64] FLAG: --cpu-manager-policy="none" May 28 11:03:02.103345 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101161 2551 flags.go:64] FLAG: --cpu-manager-policy-options="" May 28 11:03:02.103345 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101167 2551 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 28 11:03:02.103345 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101171 2551 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 28 11:03:02.103345 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101175 2551 flags.go:64] FLAG: --enable-debugging-handlers="true" May 28 11:03:02.103345 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101178 2551 flags.go:64] FLAG: --enable-load-reader="false" May 28 11:03:02.103345 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101181 2551 flags.go:64] FLAG: --enable-server="true" May 28 11:03:02.103345 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101184 2551 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 28 11:03:02.103345 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101188 2551 flags.go:64] FLAG: --event-burst="100" May 28 11:03:02.103345 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101191 2551 flags.go:64] FLAG: --event-qps="50" May 28 11:03:02.103345 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101194 2551 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 28 11:03:02.103978 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101197 2551 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 28 11:03:02.103978 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101201 2551 flags.go:64] FLAG: --eviction-hard="" May 28 11:03:02.103978 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101204 2551 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 28 11:03:02.103978 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101207 2551 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 28 11:03:02.103978 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101210 2551 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 28 11:03:02.103978 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101213 2551 flags.go:64] FLAG: --eviction-soft="" May 28 11:03:02.103978 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101216 2551 flags.go:64] FLAG: --eviction-soft-grace-period="" May 28 11:03:02.103978 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101219 2551 flags.go:64] FLAG: --exit-on-lock-contention="false" May 28 11:03:02.103978 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101222 2551 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 28 11:03:02.103978 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101225 2551 flags.go:64] FLAG: --experimental-mounter-path="" May 28 11:03:02.103978 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101228 2551 flags.go:64] FLAG: --fail-cgroupv1="false" May 28 11:03:02.103978 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101231 2551 flags.go:64] FLAG: --fail-swap-on="true" May 28 11:03:02.103978 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101234 2551 flags.go:64] FLAG: --feature-gates="" May 28 11:03:02.103978 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101238 2551 flags.go:64] FLAG: --file-check-frequency="20s" May 28 11:03:02.103978 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101241 2551 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 28 11:03:02.103978 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101244 2551 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 28 11:03:02.103978 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101247 2551 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 28 11:03:02.103978 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101250 2551 flags.go:64] FLAG: --healthz-port="10248" May 28 11:03:02.103978 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101253 2551 flags.go:64] FLAG: --help="false" May 28 11:03:02.103978 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101256 2551 flags.go:64] FLAG: --hostname-override="ip-10-0-130-105.ec2.internal" May 28 11:03:02.103978 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101259 2551 flags.go:64] FLAG: --housekeeping-interval="10s" May 28 11:03:02.103978 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101263 2551 flags.go:64] FLAG: --http-check-frequency="20s" May 28 11:03:02.103978 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101266 2551 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 28 11:03:02.104551 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101269 2551 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 28 11:03:02.104551 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101273 2551 flags.go:64] FLAG: --image-gc-high-threshold="85" May 28 11:03:02.104551 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101276 2551 flags.go:64] FLAG: --image-gc-low-threshold="80" May 28 11:03:02.104551 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101279 2551 flags.go:64] FLAG: --image-service-endpoint="" May 28 11:03:02.104551 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101282 2551 flags.go:64] FLAG: --kernel-memcg-notification="false" May 28 11:03:02.104551 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101285 2551 flags.go:64] FLAG: --kube-api-burst="100" May 28 11:03:02.104551 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101288 2551 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 28 11:03:02.104551 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101291 2551 flags.go:64] FLAG: --kube-api-qps="50" May 28 11:03:02.104551 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101294 2551 flags.go:64] FLAG: --kube-reserved="" May 28 11:03:02.104551 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101297 2551 flags.go:64] FLAG: --kube-reserved-cgroup="" May 28 11:03:02.104551 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101300 2551 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 28 11:03:02.104551 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101303 2551 flags.go:64] FLAG: --kubelet-cgroups="" May 28 11:03:02.104551 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101306 2551 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 28 11:03:02.104551 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101309 2551 flags.go:64] FLAG: --lock-file="" May 28 11:03:02.104551 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101312 2551 flags.go:64] FLAG: --log-cadvisor-usage="false" May 28 11:03:02.104551 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101315 2551 flags.go:64] FLAG: --log-flush-frequency="5s" May 28 11:03:02.104551 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101318 2551 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 28 11:03:02.104551 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101323 2551 flags.go:64] FLAG: --log-json-split-stream="false" May 28 11:03:02.104551 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101327 2551 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 28 11:03:02.104551 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101330 2551 flags.go:64] FLAG: --log-text-split-stream="false" May 28 11:03:02.104551 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101333 2551 flags.go:64] FLAG: --logging-format="text" May 28 11:03:02.104551 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101336 2551 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 28 11:03:02.104551 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101340 2551 flags.go:64] FLAG: --make-iptables-util-chains="true" May 28 11:03:02.104551 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101342 2551 flags.go:64] FLAG: --manifest-url="" May 28 11:03:02.105152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101345 2551 flags.go:64] FLAG: --manifest-url-header="" May 28 11:03:02.105152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101350 2551 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 28 11:03:02.105152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101352 2551 flags.go:64] FLAG: --max-open-files="1000000" May 28 11:03:02.105152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101362 2551 flags.go:64] FLAG: --max-pods="110" May 28 11:03:02.105152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101365 2551 flags.go:64] FLAG: --maximum-dead-containers="-1" May 28 11:03:02.105152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101368 2551 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 28 11:03:02.105152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101371 2551 flags.go:64] FLAG: --memory-manager-policy="None" May 28 11:03:02.105152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101374 2551 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 28 11:03:02.105152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101377 2551 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 28 11:03:02.105152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101380 2551 flags.go:64] FLAG: --node-ip="0.0.0.0" May 28 11:03:02.105152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101383 2551 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 28 11:03:02.105152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101391 2551 flags.go:64] FLAG: --node-status-max-images="50" May 28 11:03:02.105152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101394 2551 flags.go:64] FLAG: --node-status-update-frequency="10s" May 28 11:03:02.105152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101397 2551 flags.go:64] FLAG: --oom-score-adj="-999" May 28 11:03:02.105152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101400 2551 flags.go:64] FLAG: --pod-cidr="" May 28 11:03:02.105152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101403 2551 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 28 11:03:02.105152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101409 2551 flags.go:64] FLAG: --pod-manifest-path="" May 28 11:03:02.105152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101412 2551 flags.go:64] FLAG: --pod-max-pids="-1" May 28 11:03:02.105152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101415 2551 flags.go:64] FLAG: --pods-per-core="0" May 28 11:03:02.105152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101418 2551 flags.go:64] FLAG: --port="10250" May 28 11:03:02.105152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101422 2551 flags.go:64] FLAG: --protect-kernel-defaults="false" May 28 11:03:02.105152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101425 2551 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01deff35ff18bfa17" May 28 11:03:02.105152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101428 2551 flags.go:64] FLAG: --qos-reserved="" May 28 11:03:02.105152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101431 2551 flags.go:64] FLAG: --read-only-port="10255" May 28 11:03:02.105744 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101434 2551 flags.go:64] FLAG: --register-node="true" May 28 11:03:02.105744 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101437 2551 flags.go:64] FLAG: --register-schedulable="true" May 28 11:03:02.105744 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101439 2551 flags.go:64] FLAG: --register-with-taints="" May 28 11:03:02.105744 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101443 2551 flags.go:64] FLAG: --registry-burst="10" May 28 11:03:02.105744 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101447 2551 flags.go:64] FLAG: --registry-qps="5" May 28 11:03:02.105744 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101450 2551 flags.go:64] FLAG: --reserved-cpus="" May 28 11:03:02.105744 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101453 2551 flags.go:64] FLAG: --reserved-memory="" May 28 11:03:02.105744 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101457 2551 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 28 11:03:02.105744 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101460 2551 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 28 11:03:02.105744 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101462 2551 flags.go:64] FLAG: --rotate-certificates="false" May 28 11:03:02.105744 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101466 2551 flags.go:64] FLAG: --rotate-server-certificates="false" May 28 11:03:02.105744 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101469 2551 flags.go:64] FLAG: --runonce="false" May 28 11:03:02.105744 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101472 2551 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 28 11:03:02.105744 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101475 2551 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 28 11:03:02.105744 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101478 2551 flags.go:64] FLAG: --seccomp-default="false" May 28 11:03:02.105744 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101480 2551 flags.go:64] FLAG: --serialize-image-pulls="true" May 28 11:03:02.105744 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101483 2551 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 28 11:03:02.105744 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101486 2551 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 28 11:03:02.105744 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101489 2551 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 28 11:03:02.105744 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101492 2551 flags.go:64] FLAG: --storage-driver-password="root" May 28 11:03:02.105744 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101495 2551 flags.go:64] FLAG: --storage-driver-secure="false" May 28 11:03:02.105744 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101498 2551 flags.go:64] FLAG: --storage-driver-table="stats" May 28 11:03:02.105744 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101502 2551 flags.go:64] FLAG: --storage-driver-user="root" May 28 11:03:02.105744 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101505 2551 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 28 11:03:02.105744 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101508 2551 flags.go:64] FLAG: --sync-frequency="1m0s" May 28 11:03:02.105744 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101511 2551 flags.go:64] FLAG: --system-cgroups="" May 28 11:03:02.106370 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101513 2551 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 28 11:03:02.106370 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101519 2551 flags.go:64] FLAG: --system-reserved-cgroup="" May 28 11:03:02.106370 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101525 2551 flags.go:64] FLAG: --tls-cert-file="" May 28 11:03:02.106370 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101527 2551 flags.go:64] FLAG: --tls-cipher-suites="[]" May 28 11:03:02.106370 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101532 2551 flags.go:64] FLAG: --tls-min-version="" May 28 11:03:02.106370 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101535 2551 flags.go:64] FLAG: --tls-private-key-file="" May 28 11:03:02.106370 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101538 2551 flags.go:64] FLAG: --topology-manager-policy="none" May 28 11:03:02.106370 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101541 2551 flags.go:64] FLAG: --topology-manager-policy-options="" May 28 11:03:02.106370 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101544 2551 flags.go:64] FLAG: --topology-manager-scope="container" May 28 11:03:02.106370 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101547 2551 flags.go:64] FLAG: --v="2" May 28 11:03:02.106370 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101552 2551 flags.go:64] FLAG: --version="false" May 28 11:03:02.106370 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101556 2551 flags.go:64] FLAG: --vmodule="" May 28 11:03:02.106370 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101560 2551 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 28 11:03:02.106370 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.101564 2551 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 28 11:03:02.106370 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101656 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 11:03:02.106370 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101661 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 11:03:02.106370 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101665 2551 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 11:03:02.106370 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101668 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 11:03:02.106370 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101671 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 11:03:02.106370 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101674 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 11:03:02.106370 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101676 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 11:03:02.106370 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101679 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 11:03:02.106370 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101682 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 11:03:02.106915 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101685 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 11:03:02.106915 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101688 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 11:03:02.106915 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101690 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 11:03:02.106915 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101693 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 11:03:02.106915 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101696 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 11:03:02.106915 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101698 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 11:03:02.106915 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101701 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 11:03:02.106915 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101703 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 11:03:02.106915 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101706 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 11:03:02.106915 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101708 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 11:03:02.106915 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101711 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 11:03:02.106915 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101715 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 11:03:02.106915 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101717 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 11:03:02.106915 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101720 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 11:03:02.106915 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101723 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 11:03:02.106915 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101725 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 11:03:02.106915 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101728 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 11:03:02.106915 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101730 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 11:03:02.106915 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101733 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 11:03:02.106915 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101736 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 11:03:02.107482 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101738 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 11:03:02.107482 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101741 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 11:03:02.107482 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101744 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 11:03:02.107482 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101747 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 11:03:02.107482 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101749 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 11:03:02.107482 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101752 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 11:03:02.107482 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101754 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 11:03:02.107482 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101756 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 11:03:02.107482 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101759 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 11:03:02.107482 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101761 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 11:03:02.107482 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101764 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 11:03:02.107482 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101766 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 11:03:02.107482 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101769 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 11:03:02.107482 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101771 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 11:03:02.107482 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101774 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 11:03:02.107482 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101776 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 11:03:02.107482 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101779 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 11:03:02.107482 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101782 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 11:03:02.107482 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101784 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 11:03:02.108002 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101787 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 11:03:02.108002 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101789 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 11:03:02.108002 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101792 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 11:03:02.108002 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101794 2551 feature_gate.go:328] unrecognized feature gate: Example May 28 11:03:02.108002 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101798 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 11:03:02.108002 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101801 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 11:03:02.108002 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101804 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 11:03:02.108002 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101806 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 11:03:02.108002 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101809 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 11:03:02.108002 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101811 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 11:03:02.108002 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101814 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 11:03:02.108002 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101820 2551 feature_gate.go:328] unrecognized feature gate: Example2 May 28 11:03:02.108002 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101823 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 11:03:02.108002 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101826 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 11:03:02.108002 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101829 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 11:03:02.108002 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101831 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 11:03:02.108002 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101834 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 11:03:02.108002 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101837 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 11:03:02.108002 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101839 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 11:03:02.108640 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101841 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 11:03:02.108640 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101845 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 11:03:02.108640 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101849 2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 11:03:02.108640 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101853 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 11:03:02.108640 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101856 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 11:03:02.108640 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101859 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 11:03:02.108640 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101862 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 11:03:02.108640 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101864 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 11:03:02.108640 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101867 2551 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 11:03:02.108640 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101870 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 11:03:02.108640 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101873 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 11:03:02.108640 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101875 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 11:03:02.108640 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101878 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 11:03:02.108640 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101881 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 11:03:02.108640 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101883 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 11:03:02.108640 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101886 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 11:03:02.108640 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101888 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 11:03:02.108640 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101892 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 11:03:02.108640 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.101895 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 11:03:02.109262 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.102438 2551 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 11:03:02.110676 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.110655 2551 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 28 11:03:02.110710 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.110678 2551 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 28 11:03:02.110737 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110726 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 11:03:02.110737 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110731 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 11:03:02.110737 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110734 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 11:03:02.110823 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110738 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 11:03:02.110823 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110742 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 11:03:02.110823 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110744 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 11:03:02.110823 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110747 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 11:03:02.110823 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110750 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 11:03:02.110823 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110753 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 11:03:02.110823 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110756 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 11:03:02.110823 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110759 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 11:03:02.110823 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110761 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 11:03:02.110823 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110764 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 11:03:02.110823 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110767 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 11:03:02.110823 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110769 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 11:03:02.110823 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110772 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 11:03:02.110823 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110775 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 11:03:02.110823 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110777 2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 11:03:02.110823 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110780 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 11:03:02.110823 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110782 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 11:03:02.110823 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110785 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 11:03:02.110823 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110788 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 11:03:02.111298 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110790 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 11:03:02.111298 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110793 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 11:03:02.111298 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110795 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 11:03:02.111298 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110799 2551 feature_gate.go:328] unrecognized feature gate: Example2 May 28 11:03:02.111298 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110801 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 11:03:02.111298 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110804 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 11:03:02.111298 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110807 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 11:03:02.111298 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110809 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 11:03:02.111298 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110812 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 11:03:02.111298 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110814 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 11:03:02.111298 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110817 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 11:03:02.111298 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110819 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 11:03:02.111298 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110822 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 11:03:02.111298 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110825 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 11:03:02.111298 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110828 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 11:03:02.111298 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110831 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 11:03:02.111298 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110834 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 11:03:02.111298 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110837 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 11:03:02.111298 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110839 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 11:03:02.111298 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110842 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 11:03:02.111801 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110845 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 11:03:02.111801 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110847 2551 feature_gate.go:328] unrecognized feature gate: Example May 28 11:03:02.111801 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110850 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 11:03:02.111801 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110853 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 11:03:02.111801 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110855 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 11:03:02.111801 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110858 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 11:03:02.111801 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110863 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 11:03:02.111801 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110867 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 11:03:02.111801 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110870 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 11:03:02.111801 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110873 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 11:03:02.111801 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110876 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 11:03:02.111801 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110879 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 11:03:02.111801 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110881 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 11:03:02.111801 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110885 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 11:03:02.111801 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110888 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 11:03:02.111801 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110891 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 11:03:02.111801 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110894 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 11:03:02.111801 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110898 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 11:03:02.111801 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110900 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 11:03:02.112284 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110904 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 11:03:02.112284 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110906 2551 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 11:03:02.112284 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110909 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 11:03:02.112284 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110912 2551 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 11:03:02.112284 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110915 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 11:03:02.112284 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110918 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 11:03:02.112284 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110921 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 11:03:02.112284 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110924 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 11:03:02.112284 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110927 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 11:03:02.112284 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110930 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 11:03:02.112284 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110932 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 11:03:02.112284 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110935 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 11:03:02.112284 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110938 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 11:03:02.112284 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110941 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 11:03:02.112284 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110943 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 11:03:02.112284 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110947 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 11:03:02.112284 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110949 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 11:03:02.112284 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110953 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 11:03:02.112284 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110957 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 11:03:02.112284 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110960 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 11:03:02.112783 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110962 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 11:03:02.112783 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110965 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 11:03:02.112783 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110967 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 11:03:02.112783 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110970 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 11:03:02.112783 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.110973 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 11:03:02.112783 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.110978 2551 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 11:03:02.112783 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111089 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 28 11:03:02.112783 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111097 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 28 11:03:02.112783 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111100 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 28 11:03:02.112783 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111104 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 28 11:03:02.112783 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111106 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 28 11:03:02.112783 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111109 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 28 11:03:02.112783 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111112 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 28 11:03:02.112783 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111115 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 28 11:03:02.112783 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111118 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 28 11:03:02.112783 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111121 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability May 28 11:03:02.113194 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111123 2551 feature_gate.go:328] unrecognized feature gate: Example May 28 11:03:02.113194 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111126 2551 feature_gate.go:328] unrecognized feature gate: DualReplica May 28 11:03:02.113194 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111129 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 28 11:03:02.113194 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111131 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 28 11:03:02.113194 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111133 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 28 11:03:02.113194 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111136 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 28 11:03:02.113194 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111139 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 28 11:03:02.113194 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111141 2551 feature_gate.go:328] unrecognized feature gate: Example2 May 28 11:03:02.113194 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111144 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 28 11:03:02.113194 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111146 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 28 11:03:02.113194 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111167 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages May 28 11:03:02.113194 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111172 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 28 11:03:02.113194 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111176 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 28 11:03:02.113194 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111179 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 28 11:03:02.113194 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111182 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 28 11:03:02.113194 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111185 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 28 11:03:02.113194 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111188 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 28 11:03:02.113194 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111190 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 28 11:03:02.113194 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111193 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 28 11:03:02.113194 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111195 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 28 11:03:02.113681 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111198 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 28 11:03:02.113681 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111200 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 28 11:03:02.113681 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111203 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 28 11:03:02.113681 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111206 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 28 11:03:02.113681 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111209 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 28 11:03:02.113681 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111211 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 28 11:03:02.113681 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111214 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 28 11:03:02.113681 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111216 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 28 11:03:02.113681 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111219 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 28 11:03:02.113681 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111221 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 28 11:03:02.113681 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111225 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 28 11:03:02.113681 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111227 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 28 11:03:02.113681 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111230 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 28 11:03:02.113681 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111233 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 28 11:03:02.113681 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111235 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores May 28 11:03:02.113681 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111237 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 28 11:03:02.113681 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111240 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 28 11:03:02.113681 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111243 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 28 11:03:02.113681 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111245 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 28 11:03:02.114163 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111247 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 28 11:03:02.114163 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111250 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 28 11:03:02.114163 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111253 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 28 11:03:02.114163 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111256 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 28 11:03:02.114163 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111258 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 28 11:03:02.114163 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111261 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 28 11:03:02.114163 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111264 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 28 11:03:02.114163 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111267 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 28 11:03:02.114163 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111269 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 28 11:03:02.114163 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111272 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 28 11:03:02.114163 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111274 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 28 11:03:02.114163 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111277 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 28 11:03:02.114163 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111279 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 28 11:03:02.114163 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111282 2551 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 28 11:03:02.114163 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111284 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 28 11:03:02.114163 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111287 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 28 11:03:02.114163 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111290 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 28 11:03:02.114163 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111293 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 28 11:03:02.114163 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111296 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 28 11:03:02.114163 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111299 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 28 11:03:02.114646 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111302 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 28 11:03:02.114646 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111305 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 28 11:03:02.114646 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111307 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 28 11:03:02.114646 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111312 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 28 11:03:02.114646 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111315 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 28 11:03:02.114646 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111318 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 28 11:03:02.114646 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111320 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 28 11:03:02.114646 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111323 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 28 11:03:02.114646 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111325 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 28 11:03:02.114646 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111328 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 28 11:03:02.114646 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111330 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 28 11:03:02.114646 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111333 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 28 11:03:02.114646 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111335 2551 feature_gate.go:328] unrecognized feature gate: NewOLM May 28 11:03:02.114646 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111337 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 28 11:03:02.114646 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111340 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 28 11:03:02.114646 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111342 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 28 11:03:02.114646 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:02.111346 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 28 11:03:02.115073 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.111351 2551 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 28 11:03:02.115073 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.111466 2551 server.go:962] "Client rotation is on, will bootstrap in background" May 28 11:03:02.116749 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.116633 2551 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 28 11:03:02.117757 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.117744 2551 server.go:1019] "Starting client certificate rotation" May 28 11:03:02.117868 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.117851 2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 28 11:03:02.117902 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.117893 2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 28 11:03:02.147439 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.147418 2551 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 28 11:03:02.149874 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.149853 2551 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 28 11:03:02.167218 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.167200 2551 log.go:25] "Validated CRI v1 runtime API" May 28 11:03:02.172308 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.172293 2551 log.go:25] "Validated CRI v1 image API" May 28 11:03:02.174183 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.174163 2551 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 28 11:03:02.176688 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.176667 2551 fs.go:135] Filesystem UUIDs: map[308c125f-35c1-4498-8c5f-c814bd6b93dc:/dev/nvme0n1p4 594cd17e-fcc4-4099-8536-f67f226f4dcf:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] May 28 11:03:02.176775 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.176689 2551 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 28 11:03:02.181308 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.181203 2551 manager.go:217] Machine: {Timestamp:2026-05-28 11:03:02.180701373 +0000 UTC m=+0.422361257 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099770 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2537427d8540b3b3d57432c22d0ed4 SystemUUID:ec253742-7d85-40b3-b3d5-7432c22d0ed4 BootID:901fc24e-7396-43a5-a288-dfa03aace6a3 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fd:f8:27:22:4b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fd:f8:27:22:4b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:7c:0b:27:14:68 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 28 11:03:02.181935 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.181922 2551 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 28 11:03:02.182029 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.182017 2551 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 28 11:03:02.184691 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.184672 2551 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 28 11:03:02.185739 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.185706 2551 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 28 11:03:02.185905 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.185742 2551 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-105.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 28 11:03:02.185982 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.185915 2551 topology_manager.go:138] "Creating topology manager with none policy" May 28 11:03:02.185982 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.185923 2551 container_manager_linux.go:306] "Creating device plugin manager" May 28 11:03:02.185982 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.185931 2551 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 28 11:03:02.187208 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.187196 2551 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 28 11:03:02.188752 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.188741 2551 state_mem.go:36] "Initialized new in-memory state store" May 28 11:03:02.188859 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.188851 2551 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 28 11:03:02.191586 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.191576 2551 kubelet.go:491] "Attempting to sync node with API server" May 28 11:03:02.191620 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.191589 2551 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 28 11:03:02.191620 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.191602 2551 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 28 11:03:02.191620 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.191611 2551 kubelet.go:397] "Adding apiserver pod source" May 28 11:03:02.191620 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.191619 2551 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 28 11:03:02.192737 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.192724 2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 28 11:03:02.192788 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.192743 2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 28 11:03:02.195675 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.195658 2551 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 28 11:03:02.197831 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.197813 2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9zkmq" May 28 11:03:02.198421 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.198407 2551 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 28 11:03:02.200926 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.200913 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 28 11:03:02.201004 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.200930 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 28 11:03:02.201004 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.200940 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 28 11:03:02.201004 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.200948 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 28 11:03:02.201004 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.200958 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 28 11:03:02.201004 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.200963 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 28 11:03:02.201004 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.200969 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 28 11:03:02.201004 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.200974 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 28 11:03:02.201004 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.200981 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 28 11:03:02.201004 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.200987 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 28 11:03:02.201004 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.200995 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 28 11:03:02.201004 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.201001 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 28 11:03:02.201759 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.201746 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 28 11:03:02.201759 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.201757 2551 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 28 11:03:02.204999 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.204983 2551 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 28 11:03:02.205080 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.205024 2551 server.go:1295] "Started kubelet" May 28 11:03:02.205141 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.205092 2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9zkmq" May 28 11:03:02.205199 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.205114 2551 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 28 11:03:02.205199 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.205166 2551 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 28 11:03:02.205199 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.205183 2551 server_v1.go:47] "podresources" method="list" useActivePods=true May 28 11:03:02.205991 ip-10-0-130-105 systemd[1]: Started Kubernetes Kubelet. May 28 11:03:02.206424 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.206311 2551 server.go:317] "Adding debug handlers to kubelet server" May 28 11:03:02.206728 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:02.206704 2551 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 28 11:03:02.206815 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:02.206796 2551 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-105.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 28 11:03:02.207088 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.206994 2551 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-105.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 28 11:03:02.207882 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.207865 2551 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 28 11:03:02.212728 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.212709 2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 28 11:03:02.213315 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.213301 2551 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 28 11:03:02.213457 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.213434 2551 volume_manager.go:295] "The desired_state_of_world populator starts" May 28 11:03:02.213457 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.213453 2551 volume_manager.go:297] "Starting Kubelet Volume Manager" May 28 11:03:02.217760 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.217736 2551 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 28 11:03:02.217876 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.217828 2551 reconstruct.go:97] "Volume reconstruction finished" May 28 11:03:02.217876 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.217844 2551 reconciler.go:26] "Reconciler: start to sync state" May 28 11:03:02.218016 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:02.217994 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-105.ec2.internal\" not found" May 28 11:03:02.219667 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.219495 2551 factory.go:55] Registering systemd factory May 28 11:03:02.219667 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.219555 2551 factory.go:223] Registration of the systemd container factory successfully May 28 11:03:02.220206 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.220189 2551 factory.go:153] Registering CRI-O factory May 28 11:03:02.220317 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.220305 2551 factory.go:223] Registration of the crio container factory successfully May 28 11:03:02.220552 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:02.220206 2551 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 28 11:03:02.220666 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.220490 2551 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 28 11:03:02.220835 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.220819 2551 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 28 11:03:02.221288 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.221104 2551 factory.go:103] Registering Raw factory May 28 11:03:02.221288 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.221141 2551 manager.go:1196] Started watching for new ooms in manager May 28 11:03:02.221563 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.221549 2551 manager.go:319] Starting recovery of all containers May 28 11:03:02.221652 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:02.221625 2551 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-105.ec2.internal\" not found" node="ip-10-0-130-105.ec2.internal" May 28 11:03:02.232287 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.232269 2551 manager.go:324] Recovery completed May 28 11:03:02.236338 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.236323 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 11:03:02.238306 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.238288 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-105.ec2.internal" event="NodeHasSufficientMemory" May 28 11:03:02.238362 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.238317 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-105.ec2.internal" event="NodeHasNoDiskPressure" May 28 11:03:02.238362 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.238327 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-105.ec2.internal" event="NodeHasSufficientPID" May 28 11:03:02.238857 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.238842 2551 cpu_manager.go:222] "Starting CPU manager" policy="none" May 28 11:03:02.238857 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.238855 2551 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 28 11:03:02.238970 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.238872 2551 state_mem.go:36] "Initialized new in-memory state store" May 28 11:03:02.241293 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.241273 2551 policy_none.go:49] "None policy: Start" May 28 11:03:02.241293 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.241295 2551 memory_manager.go:186] "Starting memorymanager" policy="None" May 28 11:03:02.241428 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.241306 2551 state_mem.go:35] "Initializing new in-memory state store" May 28 11:03:02.293566 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.283454 2551 manager.go:341] "Starting Device Plugin manager" May 28 11:03:02.293566 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:02.283529 2551 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 28 11:03:02.293566 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.283544 2551 server.go:85] "Starting device plugin registration server" May 28 11:03:02.293566 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.283771 2551 eviction_manager.go:189] "Eviction manager: starting control loop" May 28 11:03:02.293566 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.283780 2551 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 28 11:03:02.293566 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.283879 2551 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 28 11:03:02.293566 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.283949 2551 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 28 11:03:02.293566 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.283957 2551 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 28 11:03:02.293566 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:02.284713 2551 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 28 11:03:02.293566 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:02.284746 2551 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-105.ec2.internal\" not found" May 28 11:03:02.353363 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.353276 2551 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 28 11:03:02.354519 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.354503 2551 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 28 11:03:02.354577 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.354531 2551 status_manager.go:230] "Starting to sync pod status with apiserver" May 28 11:03:02.354577 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.354550 2551 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 28 11:03:02.354577 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.354556 2551 kubelet.go:2451] "Starting kubelet main sync loop" May 28 11:03:02.354700 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:02.354650 2551 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 28 11:03:02.358537 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.358517 2551 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 28 11:03:02.384839 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.384813 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 11:03:02.385699 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.385682 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-105.ec2.internal" event="NodeHasSufficientMemory" May 28 11:03:02.385804 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.385715 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-105.ec2.internal" event="NodeHasNoDiskPressure" May 28 11:03:02.385804 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.385730 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-105.ec2.internal" event="NodeHasSufficientPID" May 28 11:03:02.385804 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.385763 2551 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-105.ec2.internal" May 28 11:03:02.394822 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.394804 2551 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-105.ec2.internal" May 28 11:03:02.394904 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:02.394828 2551 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-105.ec2.internal\": node \"ip-10-0-130-105.ec2.internal\" not found" May 28 11:03:02.412755 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:02.412726 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-105.ec2.internal\" not found" May 28 11:03:02.454988 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.454942 2551 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-105.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-105.ec2.internal"] May 28 11:03:02.455132 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.455087 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 11:03:02.456044 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.456018 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-105.ec2.internal" event="NodeHasSufficientMemory" May 28 11:03:02.456178 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.456051 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-105.ec2.internal" event="NodeHasNoDiskPressure" May 28 11:03:02.456178 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.456082 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-105.ec2.internal" event="NodeHasSufficientPID" May 28 11:03:02.457383 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.457368 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 11:03:02.457553 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.457538 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-105.ec2.internal" May 28 11:03:02.457600 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.457568 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 11:03:02.458034 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.458013 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-105.ec2.internal" event="NodeHasSufficientMemory" May 28 11:03:02.458034 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.458029 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-105.ec2.internal" event="NodeHasSufficientMemory" May 28 11:03:02.458174 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.458045 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-105.ec2.internal" event="NodeHasNoDiskPressure" May 28 11:03:02.458174 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.458049 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-105.ec2.internal" event="NodeHasNoDiskPressure" May 28 11:03:02.458174 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.458074 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-105.ec2.internal" event="NodeHasSufficientPID" May 28 11:03:02.458174 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.458085 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-105.ec2.internal" event="NodeHasSufficientPID" May 28 11:03:02.459230 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.459216 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-105.ec2.internal" May 28 11:03:02.459310 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.459244 2551 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 28 11:03:02.459846 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.459827 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-105.ec2.internal" event="NodeHasSufficientMemory" May 28 11:03:02.459988 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.459854 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-105.ec2.internal" event="NodeHasNoDiskPressure" May 28 11:03:02.459988 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.459866 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-105.ec2.internal" event="NodeHasSufficientPID" May 28 11:03:02.480790 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:02.480769 2551 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-105.ec2.internal\" not found" node="ip-10-0-130-105.ec2.internal" May 28 11:03:02.485337 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:02.485322 2551 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-105.ec2.internal\" not found" node="ip-10-0-130-105.ec2.internal" May 28 11:03:02.513705 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:02.513685 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-105.ec2.internal\" not found" May 28 11:03:02.519028 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.519001 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b00054eda24f863510bc2e4dadf784ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-105.ec2.internal\" (UID: \"b00054eda24f863510bc2e4dadf784ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-105.ec2.internal" May 28 11:03:02.519157 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.519040 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bfe7c384ac44926637b571b166b49362-config\") pod \"kube-apiserver-proxy-ip-10-0-130-105.ec2.internal\" (UID: \"bfe7c384ac44926637b571b166b49362\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-105.ec2.internal" May 28 11:03:02.519157 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.519082 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b00054eda24f863510bc2e4dadf784ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-105.ec2.internal\" (UID: \"b00054eda24f863510bc2e4dadf784ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-105.ec2.internal" May 28 11:03:02.614770 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:02.614702 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-105.ec2.internal\" not found" May 28 11:03:02.619976 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.619958 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b00054eda24f863510bc2e4dadf784ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-105.ec2.internal\" (UID: \"b00054eda24f863510bc2e4dadf784ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-105.ec2.internal" May 28 11:03:02.620083 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.619982 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b00054eda24f863510bc2e4dadf784ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-105.ec2.internal\" (UID: \"b00054eda24f863510bc2e4dadf784ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-105.ec2.internal" May 28 11:03:02.620083 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.620000 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bfe7c384ac44926637b571b166b49362-config\") pod \"kube-apiserver-proxy-ip-10-0-130-105.ec2.internal\" (UID: \"bfe7c384ac44926637b571b166b49362\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-105.ec2.internal" May 28 11:03:02.620083 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.620040 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bfe7c384ac44926637b571b166b49362-config\") pod \"kube-apiserver-proxy-ip-10-0-130-105.ec2.internal\" (UID: \"bfe7c384ac44926637b571b166b49362\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-105.ec2.internal" May 28 11:03:02.620208 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.620096 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b00054eda24f863510bc2e4dadf784ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-105.ec2.internal\" (UID: \"b00054eda24f863510bc2e4dadf784ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-105.ec2.internal" May 28 11:03:02.620208 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.620097 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b00054eda24f863510bc2e4dadf784ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-105.ec2.internal\" (UID: \"b00054eda24f863510bc2e4dadf784ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-105.ec2.internal" May 28 11:03:02.715549 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:02.715507 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-105.ec2.internal\" not found" May 28 11:03:02.784994 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.784964 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-105.ec2.internal" May 28 11:03:02.788691 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:02.788673 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-105.ec2.internal" May 28 11:03:02.816671 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:02.816633 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-105.ec2.internal\" not found" May 28 11:03:02.917260 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:02.917175 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-105.ec2.internal\" not found" May 28 11:03:03.017717 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:03.017683 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-105.ec2.internal\" not found" May 28 11:03:03.117490 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:03.117460 2551 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 28 11:03:03.118217 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:03.117601 2551 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 28 11:03:03.118217 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:03.117628 2551 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 28 11:03:03.118557 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:03.118542 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-105.ec2.internal\" not found" May 28 11:03:03.207319 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:03.207281 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 10:58:02 +0000 UTC" deadline="2027-12-15 05:37:51.52139802 +0000 UTC" May 28 11:03:03.207319 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:03.207315 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13578h34m48.314084928s" May 28 11:03:03.213105 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:03.213076 2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 28 11:03:03.219414 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:03.219395 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-105.ec2.internal\" not found" May 28 11:03:03.229665 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:03.229645 2551 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 28 11:03:03.256428 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:03.256388 2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mdhzs" May 28 11:03:03.263891 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:03.263867 2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mdhzs" May 28 11:03:03.302698 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:03.302665 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb00054eda24f863510bc2e4dadf784ea.slice/crio-23e87621ce385b0e055d0a38364df4060a7075d0f973b62154886f594f77b372 WatchSource:0}: Error finding container 23e87621ce385b0e055d0a38364df4060a7075d0f973b62154886f594f77b372: Status 404 returned error can't find the container with id 23e87621ce385b0e055d0a38364df4060a7075d0f973b62154886f594f77b372 May 28 11:03:03.302905 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:03.302892 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfe7c384ac44926637b571b166b49362.slice/crio-c52221fe2de5e189af95f82fc0edb11e76b3ce58ad177996bb702fabfae4bcbd WatchSource:0}: Error finding container c52221fe2de5e189af95f82fc0edb11e76b3ce58ad177996bb702fabfae4bcbd: Status 404 returned error can't find the container with id c52221fe2de5e189af95f82fc0edb11e76b3ce58ad177996bb702fabfae4bcbd May 28 11:03:03.306265 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:03.306248 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 11:03:03.319835 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:03.319814 2551 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-130-105.ec2.internal\" not found" May 28 11:03:03.338285 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:03.338261 2551 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 28 11:03:03.358028 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:03.357984 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-105.ec2.internal" event={"ID":"b00054eda24f863510bc2e4dadf784ea","Type":"ContainerStarted","Data":"23e87621ce385b0e055d0a38364df4060a7075d0f973b62154886f594f77b372"} May 28 11:03:03.358913 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:03.358895 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-105.ec2.internal" event={"ID":"bfe7c384ac44926637b571b166b49362","Type":"ContainerStarted","Data":"c52221fe2de5e189af95f82fc0edb11e76b3ce58ad177996bb702fabfae4bcbd"} May 28 11:03:03.413249 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:03.413222 2551 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 28 11:03:03.414418 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:03.414401 2551 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-105.ec2.internal" May 28 11:03:03.424850 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:03.424829 2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 28 11:03:03.425703 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:03.425691 2551 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-105.ec2.internal" May 28 11:03:03.432119 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:03.432106 2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 28 11:03:04.001963 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.001912 2551 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 28 11:03:04.017440 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.017245 2551 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 28 11:03:04.192373 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.192334 2551 apiserver.go:52] "Watching apiserver" May 28 11:03:04.200001 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.199972 2551 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 28 11:03:04.202026 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.202001 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-105.ec2.internal","openshift-multus/multus-4g2xp","openshift-multus/network-metrics-daemon-k5dvc","kube-system/konnectivity-agent-t9hpt","kube-system/kube-apiserver-proxy-ip-10-0-130-105.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4m6","openshift-dns/node-resolver-sbnm7","openshift-multus/multus-additional-cni-plugins-r9dfm","openshift-network-diagnostics/network-check-target-tb8vv","openshift-network-operator/iptables-alerter-jwtkt","openshift-ovn-kubernetes/ovnkube-node-rv2r4","openshift-cluster-node-tuning-operator/tuned-kgg5s","openshift-image-registry/node-ca-xrf98"] May 28 11:03:04.203523 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.203502 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sbnm7" May 28 11:03:04.205960 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.205919 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:03:04.206075 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.205982 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 28 11:03:04.206075 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.205993 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 28 11:03:04.206075 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:04.206008 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5dvc" podUID="651502be-d3a5-4259-a6be-3282eda430db" May 28 11:03:04.206267 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.206227 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hcjq4\"" May 28 11:03:04.207299 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.207280 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4g2xp" May 28 11:03:04.207376 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.207358 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t9hpt" May 28 11:03:04.208742 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.208722 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4m6" May 28 11:03:04.213254 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.209832 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 28 11:03:04.213254 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.210043 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 28 11:03:04.213254 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.210154 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 28 11:03:04.213254 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.210274 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r9dfm" May 28 11:03:04.213254 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.210772 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gvhqk\"" May 28 11:03:04.213254 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.211056 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 28 11:03:04.213254 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.211451 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-r6mwn\"" May 28 11:03:04.213254 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.211502 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 28 11:03:04.213254 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.211681 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 28 11:03:04.213254 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.212032 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 28 11:03:04.213254 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.212148 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 28 11:03:04.213254 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.212501 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ndtqs\"" May 28 11:03:04.213254 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.212675 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 28 11:03:04.213254 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.212992 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 28 11:03:04.213254 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.213040 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 28 11:03:04.213254 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.213104 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7bbcs\"" May 28 11:03:04.214242 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.213821 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:03:04.214242 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:04.213908 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb8vv" podUID="9bc40b8d-8878-48e4-bf31-adae0ae6ef7b" May 28 11:03:04.216537 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.216520 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jwtkt" May 28 11:03:04.216707 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.216686 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.218008 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.217991 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.218923 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.218897 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 28 11:03:04.219116 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.219099 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 28 11:03:04.219189 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.219120 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h9g54\"" May 28 11:03:04.219244 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.219202 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 28 11:03:04.219244 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.219211 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 28 11:03:04.219931 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.219270 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xrf98" May 28 11:03:04.220170 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.220148 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 28 11:03:04.220365 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.220344 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 28 11:03:04.220449 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.220411 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 28 11:03:04.220793 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.220501 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-l6qpz\"" May 28 11:03:04.220793 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.220529 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 28 11:03:04.220793 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.220764 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ftkht\"" May 28 11:03:04.221346 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.221123 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 28 11:03:04.221346 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.221235 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 28 11:03:04.221346 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.221248 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 28 11:03:04.221533 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.221505 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 28 11:03:04.221795 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.221765 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 28 11:03:04.221883 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.221870 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-h44lp\"" May 28 11:03:04.221950 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.221934 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 28 11:03:04.227205 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.227187 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-var-lib-kubelet\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.227289 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.227211 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-os-release\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.227289 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.227227 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-hostroot\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.227289 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.227277 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-etc-kubernetes\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.227436 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.227311 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbxgm\" (UniqueName: \"kubernetes.io/projected/31f22620-e687-49e2-a50b-60b1d5239a01-kube-api-access-sbxgm\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.227436 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.227340 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-etc-kubernetes\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.227436 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.227364 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-cnibin\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.227436 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.227387 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae806252-dc90-4483-83b3-d4226fea2310-cni-binary-copy\") pod \"multus-additional-cni-plugins-r9dfm\" (UID: \"ae806252-dc90-4483-83b3-d4226fea2310\") " pod="openshift-multus/multus-additional-cni-plugins-r9dfm" May 28 11:03:04.227436 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.227412 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-run-openvswitch\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.227674 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.227451 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-etc-sysctl-d\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.227674 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.227491 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-multus-socket-dir-parent\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.227674 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.227514 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-etc-modprobe-d\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.227674 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.227529 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-host-run-multus-certs\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.227674 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.227548 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/97c5bb3c-8bc1-40c4-908d-46f349f6513f-multus-daemon-config\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.227674 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.227572 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8102dd33-f306-4bc2-a3a2-b0681b2b0eda-sys-fs\") pod \"aws-ebs-csi-driver-node-ng4m6\" (UID: \"8102dd33-f306-4bc2-a3a2-b0681b2b0eda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4m6" May 28 11:03:04.227674 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.227591 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae806252-dc90-4483-83b3-d4226fea2310-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r9dfm\" (UID: \"ae806252-dc90-4483-83b3-d4226fea2310\") " pod="openshift-multus/multus-additional-cni-plugins-r9dfm" May 28 11:03:04.227674 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.227628 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ae806252-dc90-4483-83b3-d4226fea2310-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r9dfm\" (UID: \"ae806252-dc90-4483-83b3-d4226fea2310\") " pod="openshift-multus/multus-additional-cni-plugins-r9dfm" May 28 11:03:04.227674 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.227651 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-host-slash\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.227674 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.227670 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8102dd33-f306-4bc2-a3a2-b0681b2b0eda-etc-selinux\") pod \"aws-ebs-csi-driver-node-ng4m6\" (UID: \"8102dd33-f306-4bc2-a3a2-b0681b2b0eda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4m6" May 28 11:03:04.228149 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.227685 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-var-lib-openvswitch\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.228149 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.227729 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/31f22620-e687-49e2-a50b-60b1d5239a01-env-overrides\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.228149 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.227761 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/31f22620-e687-49e2-a50b-60b1d5239a01-ovn-node-metrics-cert\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.228149 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.227785 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8102dd33-f306-4bc2-a3a2-b0681b2b0eda-device-dir\") pod \"aws-ebs-csi-driver-node-ng4m6\" (UID: \"8102dd33-f306-4bc2-a3a2-b0681b2b0eda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4m6" May 28 11:03:04.228149 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.227813 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-lib-modules\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.228149 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.227839 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-host-var-lib-cni-multus\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.228149 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.227863 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-host-var-lib-kubelet\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.228149 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.227887 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmvh4\" (UniqueName: \"kubernetes.io/projected/651502be-d3a5-4259-a6be-3282eda430db-kube-api-access-cmvh4\") pod \"network-metrics-daemon-k5dvc\" (UID: \"651502be-d3a5-4259-a6be-3282eda430db\") " pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:03:04.228149 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.227914 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/beb4d19c-3f94-4eca-a161-0e9ca088ab97-iptables-alerter-script\") pod \"iptables-alerter-jwtkt\" (UID: \"beb4d19c-3f94-4eca-a161-0e9ca088ab97\") " pod="openshift-network-operator/iptables-alerter-jwtkt" May 28 11:03:04.228149 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.227949 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn2bj\" (UniqueName: \"kubernetes.io/projected/8102dd33-f306-4bc2-a3a2-b0681b2b0eda-kube-api-access-dn2bj\") pod \"aws-ebs-csi-driver-node-ng4m6\" (UID: \"8102dd33-f306-4bc2-a3a2-b0681b2b0eda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4m6" May 28 11:03:04.228149 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.227985 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-host-run-ovn-kubernetes\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.228149 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228026 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-sys\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.228149 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228056 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-host-run-netns\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.228149 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228096 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-host-var-lib-cni-bin\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.228149 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228112 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8102dd33-f306-4bc2-a3a2-b0681b2b0eda-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ng4m6\" (UID: \"8102dd33-f306-4bc2-a3a2-b0681b2b0eda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4m6" May 28 11:03:04.228149 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228128 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-node-log\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.228815 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228145 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/31f22620-e687-49e2-a50b-60b1d5239a01-ovnkube-script-lib\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.228815 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228170 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae806252-dc90-4483-83b3-d4226fea2310-system-cni-dir\") pod \"multus-additional-cni-plugins-r9dfm\" (UID: \"ae806252-dc90-4483-83b3-d4226fea2310\") " pod="openshift-multus/multus-additional-cni-plugins-r9dfm" May 28 11:03:04.228815 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228190 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5k5f\" (UniqueName: \"kubernetes.io/projected/714bfb15-bce6-4d8a-b81e-2af3366caf14-kube-api-access-m5k5f\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.228815 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228205 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa7c8f3e-9641-416a-bf97-1b3cd1f94cb8-agent-certs\") pod \"konnectivity-agent-t9hpt\" (UID: \"aa7c8f3e-9641-416a-bf97-1b3cd1f94cb8\") " pod="kube-system/konnectivity-agent-t9hpt" May 28 11:03:04.228815 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228237 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-run\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.228815 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228264 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/714bfb15-bce6-4d8a-b81e-2af3366caf14-etc-tuned\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.228815 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228283 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/714bfb15-bce6-4d8a-b81e-2af3366caf14-tmp\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.228815 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228315 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8c1c4ad4-f62f-4d7d-9a30-0fae41b4738b-hosts-file\") pod \"node-resolver-sbnm7\" (UID: \"8c1c4ad4-f62f-4d7d-9a30-0fae41b4738b\") " pod="openshift-dns/node-resolver-sbnm7" May 28 11:03:04.228815 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228345 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-host-run-k8s-cni-cncf-io\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.228815 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228359 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8102dd33-f306-4bc2-a3a2-b0681b2b0eda-registration-dir\") pod \"aws-ebs-csi-driver-node-ng4m6\" (UID: \"8102dd33-f306-4bc2-a3a2-b0681b2b0eda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4m6" May 28 11:03:04.228815 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228376 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-etc-openvswitch\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.228815 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228404 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/31f22620-e687-49e2-a50b-60b1d5239a01-ovnkube-config\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.228815 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228459 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/beb4d19c-3f94-4eca-a161-0e9ca088ab97-host-slash\") pod \"iptables-alerter-jwtkt\" (UID: \"beb4d19c-3f94-4eca-a161-0e9ca088ab97\") " pod="openshift-network-operator/iptables-alerter-jwtkt" May 28 11:03:04.228815 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228529 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld7tr\" (UniqueName: \"kubernetes.io/projected/beb4d19c-3f94-4eca-a161-0e9ca088ab97-kube-api-access-ld7tr\") pod \"iptables-alerter-jwtkt\" (UID: \"beb4d19c-3f94-4eca-a161-0e9ca088ab97\") " pod="openshift-network-operator/iptables-alerter-jwtkt" May 28 11:03:04.228815 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228587 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-run-ovn\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.228815 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228623 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-log-socket\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.229467 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228645 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.229467 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228659 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-host\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.229467 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228672 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/804fb564-4d88-4cc8-8c56-5b653c8f53cf-host\") pod \"node-ca-xrf98\" (UID: \"804fb564-4d88-4cc8-8c56-5b653c8f53cf\") " pod="openshift-image-registry/node-ca-xrf98" May 28 11:03:04.229467 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228687 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlfl7\" (UniqueName: \"kubernetes.io/projected/8c1c4ad4-f62f-4d7d-9a30-0fae41b4738b-kube-api-access-vlfl7\") pod \"node-resolver-sbnm7\" (UID: \"8c1c4ad4-f62f-4d7d-9a30-0fae41b4738b\") " pod="openshift-dns/node-resolver-sbnm7" May 28 11:03:04.229467 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228718 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8102dd33-f306-4bc2-a3a2-b0681b2b0eda-socket-dir\") pod \"aws-ebs-csi-driver-node-ng4m6\" (UID: \"8102dd33-f306-4bc2-a3a2-b0681b2b0eda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4m6" May 28 11:03:04.229467 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228788 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhpkd\" (UniqueName: \"kubernetes.io/projected/ae806252-dc90-4483-83b3-d4226fea2310-kube-api-access-qhpkd\") pod \"multus-additional-cni-plugins-r9dfm\" (UID: \"ae806252-dc90-4483-83b3-d4226fea2310\") " pod="openshift-multus/multus-additional-cni-plugins-r9dfm" May 28 11:03:04.229467 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228825 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-host-kubelet\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.229467 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228848 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-systemd-units\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.229467 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228864 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-host-cni-bin\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.229467 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228886 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh5k7\" (UniqueName: \"kubernetes.io/projected/804fb564-4d88-4cc8-8c56-5b653c8f53cf-kube-api-access-nh5k7\") pod \"node-ca-xrf98\" (UID: \"804fb564-4d88-4cc8-8c56-5b653c8f53cf\") " pod="openshift-image-registry/node-ca-xrf98" May 28 11:03:04.229467 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228908 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-multus-cni-dir\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.229467 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228932 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97c5bb3c-8bc1-40c4-908d-46f349f6513f-cni-binary-copy\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.229467 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228955 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzmml\" (UniqueName: \"kubernetes.io/projected/97c5bb3c-8bc1-40c4-908d-46f349f6513f-kube-api-access-nzmml\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.229467 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.228980 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa7c8f3e-9641-416a-bf97-1b3cd1f94cb8-konnectivity-ca\") pod \"konnectivity-agent-t9hpt\" (UID: \"aa7c8f3e-9641-416a-bf97-1b3cd1f94cb8\") " pod="kube-system/konnectivity-agent-t9hpt" May 28 11:03:04.229467 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.229013 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae806252-dc90-4483-83b3-d4226fea2310-cnibin\") pod \"multus-additional-cni-plugins-r9dfm\" (UID: \"ae806252-dc90-4483-83b3-d4226fea2310\") " pod="openshift-multus/multus-additional-cni-plugins-r9dfm" May 28 11:03:04.229467 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.229043 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ae806252-dc90-4483-83b3-d4226fea2310-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r9dfm\" (UID: \"ae806252-dc90-4483-83b3-d4226fea2310\") " pod="openshift-multus/multus-additional-cni-plugins-r9dfm" May 28 11:03:04.229957 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.229098 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/651502be-d3a5-4259-a6be-3282eda430db-metrics-certs\") pod \"network-metrics-daemon-k5dvc\" (UID: \"651502be-d3a5-4259-a6be-3282eda430db\") " pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:03:04.229957 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.229121 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae806252-dc90-4483-83b3-d4226fea2310-os-release\") pod \"multus-additional-cni-plugins-r9dfm\" (UID: \"ae806252-dc90-4483-83b3-d4226fea2310\") " pod="openshift-multus/multus-additional-cni-plugins-r9dfm" May 28 11:03:04.229957 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.229144 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-run-systemd\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.229957 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.229169 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-etc-sysconfig\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.229957 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.229202 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-etc-systemd\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.229957 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.229236 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-system-cni-dir\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.229957 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.229255 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-multus-conf-dir\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.229957 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.229275 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkm5x\" (UniqueName: \"kubernetes.io/projected/9bc40b8d-8878-48e4-bf31-adae0ae6ef7b-kube-api-access-rkm5x\") pod \"network-check-target-tb8vv\" (UID: \"9bc40b8d-8878-48e4-bf31-adae0ae6ef7b\") " pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:03:04.229957 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.229298 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-host-run-netns\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.229957 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.229319 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-etc-sysctl-conf\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.229957 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.229333 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/804fb564-4d88-4cc8-8c56-5b653c8f53cf-serviceca\") pod \"node-ca-xrf98\" (UID: \"804fb564-4d88-4cc8-8c56-5b653c8f53cf\") " pod="openshift-image-registry/node-ca-xrf98" May 28 11:03:04.229957 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.229346 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c1c4ad4-f62f-4d7d-9a30-0fae41b4738b-tmp-dir\") pod \"node-resolver-sbnm7\" (UID: \"8c1c4ad4-f62f-4d7d-9a30-0fae41b4738b\") " pod="openshift-dns/node-resolver-sbnm7" May 28 11:03:04.229957 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.229389 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-host-cni-netd\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.265245 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.265214 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 10:58:03 +0000 UTC" deadline="2028-01-26 16:10:34.052096908 +0000 UTC" May 28 11:03:04.265245 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.265243 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14597h7m29.786857937s" May 28 11:03:04.319013 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.318983 2551 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 28 11:03:04.330075 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330029 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-host\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.330233 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330143 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-host\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.330233 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330175 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/804fb564-4d88-4cc8-8c56-5b653c8f53cf-host\") pod \"node-ca-xrf98\" (UID: \"804fb564-4d88-4cc8-8c56-5b653c8f53cf\") " pod="openshift-image-registry/node-ca-xrf98" May 28 11:03:04.330233 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330203 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vlfl7\" (UniqueName: \"kubernetes.io/projected/8c1c4ad4-f62f-4d7d-9a30-0fae41b4738b-kube-api-access-vlfl7\") pod \"node-resolver-sbnm7\" (UID: \"8c1c4ad4-f62f-4d7d-9a30-0fae41b4738b\") " pod="openshift-dns/node-resolver-sbnm7" May 28 11:03:04.330233 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330225 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8102dd33-f306-4bc2-a3a2-b0681b2b0eda-socket-dir\") pod \"aws-ebs-csi-driver-node-ng4m6\" (UID: \"8102dd33-f306-4bc2-a3a2-b0681b2b0eda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4m6" May 28 11:03:04.330434 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330248 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qhpkd\" (UniqueName: \"kubernetes.io/projected/ae806252-dc90-4483-83b3-d4226fea2310-kube-api-access-qhpkd\") pod \"multus-additional-cni-plugins-r9dfm\" (UID: \"ae806252-dc90-4483-83b3-d4226fea2310\") " pod="openshift-multus/multus-additional-cni-plugins-r9dfm" May 28 11:03:04.330434 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330281 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/804fb564-4d88-4cc8-8c56-5b653c8f53cf-host\") pod \"node-ca-xrf98\" (UID: \"804fb564-4d88-4cc8-8c56-5b653c8f53cf\") " pod="openshift-image-registry/node-ca-xrf98" May 28 11:03:04.330434 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330347 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-host-kubelet\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.330434 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330392 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8102dd33-f306-4bc2-a3a2-b0681b2b0eda-socket-dir\") pod \"aws-ebs-csi-driver-node-ng4m6\" (UID: \"8102dd33-f306-4bc2-a3a2-b0681b2b0eda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4m6" May 28 11:03:04.330434 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330402 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-systemd-units\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.330434 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330427 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-host-cni-bin\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.330681 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330446 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-host-kubelet\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.330681 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330453 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nh5k7\" (UniqueName: \"kubernetes.io/projected/804fb564-4d88-4cc8-8c56-5b653c8f53cf-kube-api-access-nh5k7\") pod \"node-ca-xrf98\" (UID: \"804fb564-4d88-4cc8-8c56-5b653c8f53cf\") " pod="openshift-image-registry/node-ca-xrf98" May 28 11:03:04.330681 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330471 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-systemd-units\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.330681 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330480 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-multus-cni-dir\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.330681 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330495 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-host-cni-bin\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.330681 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330528 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97c5bb3c-8bc1-40c4-908d-46f349f6513f-cni-binary-copy\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.330681 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330529 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-multus-cni-dir\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.330681 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330555 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nzmml\" (UniqueName: \"kubernetes.io/projected/97c5bb3c-8bc1-40c4-908d-46f349f6513f-kube-api-access-nzmml\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.330681 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330589 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa7c8f3e-9641-416a-bf97-1b3cd1f94cb8-konnectivity-ca\") pod \"konnectivity-agent-t9hpt\" (UID: \"aa7c8f3e-9641-416a-bf97-1b3cd1f94cb8\") " pod="kube-system/konnectivity-agent-t9hpt" May 28 11:03:04.330681 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330661 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae806252-dc90-4483-83b3-d4226fea2310-cnibin\") pod \"multus-additional-cni-plugins-r9dfm\" (UID: \"ae806252-dc90-4483-83b3-d4226fea2310\") " pod="openshift-multus/multus-additional-cni-plugins-r9dfm" May 28 11:03:04.331152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330706 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ae806252-dc90-4483-83b3-d4226fea2310-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r9dfm\" (UID: \"ae806252-dc90-4483-83b3-d4226fea2310\") " pod="openshift-multus/multus-additional-cni-plugins-r9dfm" May 28 11:03:04.331152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330739 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/651502be-d3a5-4259-a6be-3282eda430db-metrics-certs\") pod \"network-metrics-daemon-k5dvc\" (UID: \"651502be-d3a5-4259-a6be-3282eda430db\") " pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:03:04.331152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330763 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae806252-dc90-4483-83b3-d4226fea2310-os-release\") pod \"multus-additional-cni-plugins-r9dfm\" (UID: \"ae806252-dc90-4483-83b3-d4226fea2310\") " pod="openshift-multus/multus-additional-cni-plugins-r9dfm" May 28 11:03:04.331152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330740 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae806252-dc90-4483-83b3-d4226fea2310-cnibin\") pod \"multus-additional-cni-plugins-r9dfm\" (UID: \"ae806252-dc90-4483-83b3-d4226fea2310\") " pod="openshift-multus/multus-additional-cni-plugins-r9dfm" May 28 11:03:04.331152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330787 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-run-systemd\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.331152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330810 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-etc-sysconfig\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.331152 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:04.330832 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 11:03:04.331152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330845 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae806252-dc90-4483-83b3-d4226fea2310-os-release\") pod \"multus-additional-cni-plugins-r9dfm\" (UID: \"ae806252-dc90-4483-83b3-d4226fea2310\") " pod="openshift-multus/multus-additional-cni-plugins-r9dfm" May 28 11:03:04.331152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330881 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-etc-systemd\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.331152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330886 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-run-systemd\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.331152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330834 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-etc-systemd\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.331152 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:04.330905 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/651502be-d3a5-4259-a6be-3282eda430db-metrics-certs podName:651502be-d3a5-4259-a6be-3282eda430db nodeName:}" failed. No retries permitted until 2026-05-28 11:03:04.830880651 +0000 UTC m=+3.072540540 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/651502be-d3a5-4259-a6be-3282eda430db-metrics-certs") pod "network-metrics-daemon-k5dvc" (UID: "651502be-d3a5-4259-a6be-3282eda430db") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 11:03:04.331152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330929 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-etc-sysconfig\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.331152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330941 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-system-cni-dir\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.331152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330970 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-multus-conf-dir\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.331152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330979 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-system-cni-dir\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.331152 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.330997 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rkm5x\" (UniqueName: \"kubernetes.io/projected/9bc40b8d-8878-48e4-bf31-adae0ae6ef7b-kube-api-access-rkm5x\") pod \"network-check-target-tb8vv\" (UID: \"9bc40b8d-8878-48e4-bf31-adae0ae6ef7b\") " pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:03:04.331921 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331019 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-multus-conf-dir\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.331921 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331023 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-host-run-netns\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.331921 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331052 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-etc-sysctl-conf\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.331921 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331079 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-host-run-netns\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.331921 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331088 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/804fb564-4d88-4cc8-8c56-5b653c8f53cf-serviceca\") pod \"node-ca-xrf98\" (UID: \"804fb564-4d88-4cc8-8c56-5b653c8f53cf\") " pod="openshift-image-registry/node-ca-xrf98" May 28 11:03:04.331921 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331150 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c1c4ad4-f62f-4d7d-9a30-0fae41b4738b-tmp-dir\") pod \"node-resolver-sbnm7\" (UID: \"8c1c4ad4-f62f-4d7d-9a30-0fae41b4738b\") " pod="openshift-dns/node-resolver-sbnm7" May 28 11:03:04.331921 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331174 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aa7c8f3e-9641-416a-bf97-1b3cd1f94cb8-konnectivity-ca\") pod \"konnectivity-agent-t9hpt\" (UID: \"aa7c8f3e-9641-416a-bf97-1b3cd1f94cb8\") " pod="kube-system/konnectivity-agent-t9hpt" May 28 11:03:04.331921 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331185 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97c5bb3c-8bc1-40c4-908d-46f349f6513f-cni-binary-copy\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.331921 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331204 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-etc-sysctl-conf\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.331921 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331191 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-host-cni-netd\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.331921 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331225 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-host-cni-netd\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.331921 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331243 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-var-lib-kubelet\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.331921 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331261 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ae806252-dc90-4483-83b3-d4226fea2310-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r9dfm\" (UID: \"ae806252-dc90-4483-83b3-d4226fea2310\") " pod="openshift-multus/multus-additional-cni-plugins-r9dfm" May 28 11:03:04.331921 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331271 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-os-release\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.331921 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331296 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-hostroot\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.331921 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331319 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-etc-kubernetes\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.331921 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331347 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sbxgm\" (UniqueName: \"kubernetes.io/projected/31f22620-e687-49e2-a50b-60b1d5239a01-kube-api-access-sbxgm\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.331921 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331353 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-os-release\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.332740 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331321 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-var-lib-kubelet\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.332740 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331372 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-etc-kubernetes\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.332740 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331358 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-hostroot\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.332740 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331390 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-etc-kubernetes\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.332740 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331399 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-cnibin\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.332740 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331427 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae806252-dc90-4483-83b3-d4226fea2310-cni-binary-copy\") pod \"multus-additional-cni-plugins-r9dfm\" (UID: \"ae806252-dc90-4483-83b3-d4226fea2310\") " pod="openshift-multus/multus-additional-cni-plugins-r9dfm" May 28 11:03:04.332740 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331452 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-run-openvswitch\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.332740 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331454 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c1c4ad4-f62f-4d7d-9a30-0fae41b4738b-tmp-dir\") pod \"node-resolver-sbnm7\" (UID: \"8c1c4ad4-f62f-4d7d-9a30-0fae41b4738b\") " pod="openshift-dns/node-resolver-sbnm7" May 28 11:03:04.332740 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331459 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-etc-kubernetes\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.332740 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331475 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-etc-sysctl-d\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.332740 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331482 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/804fb564-4d88-4cc8-8c56-5b653c8f53cf-serviceca\") pod \"node-ca-xrf98\" (UID: \"804fb564-4d88-4cc8-8c56-5b653c8f53cf\") " pod="openshift-image-registry/node-ca-xrf98" May 28 11:03:04.332740 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331500 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-multus-socket-dir-parent\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.332740 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331513 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-cnibin\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.332740 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331526 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-etc-modprobe-d\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.332740 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331552 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-host-run-multus-certs\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.332740 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331568 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-multus-socket-dir-parent\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.332740 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331578 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/97c5bb3c-8bc1-40c4-908d-46f349f6513f-multus-daemon-config\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.332740 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331604 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8102dd33-f306-4bc2-a3a2-b0681b2b0eda-sys-fs\") pod \"aws-ebs-csi-driver-node-ng4m6\" (UID: \"8102dd33-f306-4bc2-a3a2-b0681b2b0eda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4m6" May 28 11:03:04.333560 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331613 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-host-run-multus-certs\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.333560 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331622 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-etc-modprobe-d\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.333560 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331631 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae806252-dc90-4483-83b3-d4226fea2310-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r9dfm\" (UID: \"ae806252-dc90-4483-83b3-d4226fea2310\") " pod="openshift-multus/multus-additional-cni-plugins-r9dfm" May 28 11:03:04.333560 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331624 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-etc-sysctl-d\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.333560 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331667 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8102dd33-f306-4bc2-a3a2-b0681b2b0eda-sys-fs\") pod \"aws-ebs-csi-driver-node-ng4m6\" (UID: \"8102dd33-f306-4bc2-a3a2-b0681b2b0eda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4m6" May 28 11:03:04.333560 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331668 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ae806252-dc90-4483-83b3-d4226fea2310-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r9dfm\" (UID: \"ae806252-dc90-4483-83b3-d4226fea2310\") " pod="openshift-multus/multus-additional-cni-plugins-r9dfm" May 28 11:03:04.333560 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331526 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-run-openvswitch\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.333560 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331705 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-host-slash\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.333560 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331732 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8102dd33-f306-4bc2-a3a2-b0681b2b0eda-etc-selinux\") pod \"aws-ebs-csi-driver-node-ng4m6\" (UID: \"8102dd33-f306-4bc2-a3a2-b0681b2b0eda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4m6" May 28 11:03:04.333560 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331757 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-var-lib-openvswitch\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.333560 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331771 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae806252-dc90-4483-83b3-d4226fea2310-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r9dfm\" (UID: \"ae806252-dc90-4483-83b3-d4226fea2310\") " pod="openshift-multus/multus-additional-cni-plugins-r9dfm" May 28 11:03:04.333560 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331782 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/31f22620-e687-49e2-a50b-60b1d5239a01-env-overrides\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.333560 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331788 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-host-slash\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.333560 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331810 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/31f22620-e687-49e2-a50b-60b1d5239a01-ovn-node-metrics-cert\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.333560 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331830 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8102dd33-f306-4bc2-a3a2-b0681b2b0eda-etc-selinux\") pod \"aws-ebs-csi-driver-node-ng4m6\" (UID: \"8102dd33-f306-4bc2-a3a2-b0681b2b0eda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4m6" May 28 11:03:04.333560 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331835 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-var-lib-openvswitch\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.333560 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331839 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8102dd33-f306-4bc2-a3a2-b0681b2b0eda-device-dir\") pod \"aws-ebs-csi-driver-node-ng4m6\" (UID: \"8102dd33-f306-4bc2-a3a2-b0681b2b0eda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4m6" May 28 11:03:04.334165 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331864 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-lib-modules\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.334165 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331889 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-host-var-lib-cni-multus\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.334165 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331912 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-host-var-lib-kubelet\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.334165 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331939 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cmvh4\" (UniqueName: \"kubernetes.io/projected/651502be-d3a5-4259-a6be-3282eda430db-kube-api-access-cmvh4\") pod \"network-metrics-daemon-k5dvc\" (UID: \"651502be-d3a5-4259-a6be-3282eda430db\") " pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:03:04.334165 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331970 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/beb4d19c-3f94-4eca-a161-0e9ca088ab97-iptables-alerter-script\") pod \"iptables-alerter-jwtkt\" (UID: \"beb4d19c-3f94-4eca-a161-0e9ca088ab97\") " pod="openshift-network-operator/iptables-alerter-jwtkt" May 28 11:03:04.334165 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.331996 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dn2bj\" (UniqueName: \"kubernetes.io/projected/8102dd33-f306-4bc2-a3a2-b0681b2b0eda-kube-api-access-dn2bj\") pod \"aws-ebs-csi-driver-node-ng4m6\" (UID: \"8102dd33-f306-4bc2-a3a2-b0681b2b0eda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4m6" May 28 11:03:04.334165 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332021 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-host-run-ovn-kubernetes\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.334165 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332046 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-sys\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.334165 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332089 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-host-run-netns\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.334165 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332106 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8102dd33-f306-4bc2-a3a2-b0681b2b0eda-device-dir\") pod \"aws-ebs-csi-driver-node-ng4m6\" (UID: \"8102dd33-f306-4bc2-a3a2-b0681b2b0eda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4m6" May 28 11:03:04.334165 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332112 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/97c5bb3c-8bc1-40c4-908d-46f349f6513f-multus-daemon-config\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.334165 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332114 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-host-var-lib-cni-bin\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.334165 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332183 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-lib-modules\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.334165 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332187 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8102dd33-f306-4bc2-a3a2-b0681b2b0eda-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ng4m6\" (UID: \"8102dd33-f306-4bc2-a3a2-b0681b2b0eda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4m6" May 28 11:03:04.334165 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332203 2551 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 28 11:03:04.334165 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332221 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-node-log\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.334165 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332230 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8102dd33-f306-4bc2-a3a2-b0681b2b0eda-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ng4m6\" (UID: \"8102dd33-f306-4bc2-a3a2-b0681b2b0eda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4m6" May 28 11:03:04.334835 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332248 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/31f22620-e687-49e2-a50b-60b1d5239a01-ovnkube-script-lib\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.334835 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332267 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-host-var-lib-cni-multus\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.334835 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332274 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae806252-dc90-4483-83b3-d4226fea2310-system-cni-dir\") pod \"multus-additional-cni-plugins-r9dfm\" (UID: \"ae806252-dc90-4483-83b3-d4226fea2310\") " pod="openshift-multus/multus-additional-cni-plugins-r9dfm" May 28 11:03:04.334835 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332300 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m5k5f\" (UniqueName: \"kubernetes.io/projected/714bfb15-bce6-4d8a-b81e-2af3366caf14-kube-api-access-m5k5f\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.334835 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332309 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/31f22620-e687-49e2-a50b-60b1d5239a01-env-overrides\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.334835 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332325 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa7c8f3e-9641-416a-bf97-1b3cd1f94cb8-agent-certs\") pod \"konnectivity-agent-t9hpt\" (UID: \"aa7c8f3e-9641-416a-bf97-1b3cd1f94cb8\") " pod="kube-system/konnectivity-agent-t9hpt" May 28 11:03:04.334835 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332338 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-sys\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.334835 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332344 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-node-log\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.334835 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332352 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-run\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.334835 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332363 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-host-var-lib-kubelet\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.334835 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332376 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/714bfb15-bce6-4d8a-b81e-2af3366caf14-etc-tuned\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.334835 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332395 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-host-run-netns\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.334835 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332416 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-host-run-ovn-kubernetes\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.334835 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332410 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/714bfb15-bce6-4d8a-b81e-2af3366caf14-tmp\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.334835 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332458 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae806252-dc90-4483-83b3-d4226fea2310-system-cni-dir\") pod \"multus-additional-cni-plugins-r9dfm\" (UID: \"ae806252-dc90-4483-83b3-d4226fea2310\") " pod="openshift-multus/multus-additional-cni-plugins-r9dfm" May 28 11:03:04.334835 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332478 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8c1c4ad4-f62f-4d7d-9a30-0fae41b4738b-hosts-file\") pod \"node-resolver-sbnm7\" (UID: \"8c1c4ad4-f62f-4d7d-9a30-0fae41b4738b\") " pod="openshift-dns/node-resolver-sbnm7" May 28 11:03:04.334835 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332505 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-host-run-k8s-cni-cncf-io\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.334835 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332529 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8102dd33-f306-4bc2-a3a2-b0681b2b0eda-registration-dir\") pod \"aws-ebs-csi-driver-node-ng4m6\" (UID: \"8102dd33-f306-4bc2-a3a2-b0681b2b0eda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4m6" May 28 11:03:04.335552 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332554 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-etc-openvswitch\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.335552 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332587 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/31f22620-e687-49e2-a50b-60b1d5239a01-ovnkube-config\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.335552 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332601 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/beb4d19c-3f94-4eca-a161-0e9ca088ab97-iptables-alerter-script\") pod \"iptables-alerter-jwtkt\" (UID: \"beb4d19c-3f94-4eca-a161-0e9ca088ab97\") " pod="openshift-network-operator/iptables-alerter-jwtkt" May 28 11:03:04.335552 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332612 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/beb4d19c-3f94-4eca-a161-0e9ca088ab97-host-slash\") pod \"iptables-alerter-jwtkt\" (UID: \"beb4d19c-3f94-4eca-a161-0e9ca088ab97\") " pod="openshift-network-operator/iptables-alerter-jwtkt" May 28 11:03:04.335552 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332639 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ld7tr\" (UniqueName: \"kubernetes.io/projected/beb4d19c-3f94-4eca-a161-0e9ca088ab97-kube-api-access-ld7tr\") pod \"iptables-alerter-jwtkt\" (UID: \"beb4d19c-3f94-4eca-a161-0e9ca088ab97\") " pod="openshift-network-operator/iptables-alerter-jwtkt" May 28 11:03:04.335552 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332645 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-host-var-lib-cni-bin\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.335552 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332048 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ae806252-dc90-4483-83b3-d4226fea2310-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r9dfm\" (UID: \"ae806252-dc90-4483-83b3-d4226fea2310\") " pod="openshift-multus/multus-additional-cni-plugins-r9dfm" May 28 11:03:04.335552 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332675 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-run-ovn\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.335552 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332702 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-log-socket\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.335552 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332729 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.335552 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332804 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.335552 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332903 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae806252-dc90-4483-83b3-d4226fea2310-cni-binary-copy\") pod \"multus-additional-cni-plugins-r9dfm\" (UID: \"ae806252-dc90-4483-83b3-d4226fea2310\") " pod="openshift-multus/multus-additional-cni-plugins-r9dfm" May 28 11:03:04.335552 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332972 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-run-ovn\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.335552 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.332994 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/714bfb15-bce6-4d8a-b81e-2af3366caf14-run\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.335552 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.333007 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-log-socket\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.335552 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.333035 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/31f22620-e687-49e2-a50b-60b1d5239a01-ovnkube-script-lib\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.335552 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.333039 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8102dd33-f306-4bc2-a3a2-b0681b2b0eda-registration-dir\") pod \"aws-ebs-csi-driver-node-ng4m6\" (UID: \"8102dd33-f306-4bc2-a3a2-b0681b2b0eda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4m6" May 28 11:03:04.336257 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.333077 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/31f22620-e687-49e2-a50b-60b1d5239a01-etc-openvswitch\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.336257 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.333110 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8c1c4ad4-f62f-4d7d-9a30-0fae41b4738b-hosts-file\") pod \"node-resolver-sbnm7\" (UID: \"8c1c4ad4-f62f-4d7d-9a30-0fae41b4738b\") " pod="openshift-dns/node-resolver-sbnm7" May 28 11:03:04.336257 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.333119 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/beb4d19c-3f94-4eca-a161-0e9ca088ab97-host-slash\") pod \"iptables-alerter-jwtkt\" (UID: \"beb4d19c-3f94-4eca-a161-0e9ca088ab97\") " pod="openshift-network-operator/iptables-alerter-jwtkt" May 28 11:03:04.336257 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.333132 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/97c5bb3c-8bc1-40c4-908d-46f349f6513f-host-run-k8s-cni-cncf-io\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.336257 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.334117 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/31f22620-e687-49e2-a50b-60b1d5239a01-ovnkube-config\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.336257 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.336142 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/714bfb15-bce6-4d8a-b81e-2af3366caf14-tmp\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.336257 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.336173 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/714bfb15-bce6-4d8a-b81e-2af3366caf14-etc-tuned\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.337303 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.336670 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/31f22620-e687-49e2-a50b-60b1d5239a01-ovn-node-metrics-cert\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.337743 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.337725 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aa7c8f3e-9641-416a-bf97-1b3cd1f94cb8-agent-certs\") pod \"konnectivity-agent-t9hpt\" (UID: \"aa7c8f3e-9641-416a-bf97-1b3cd1f94cb8\") " pod="kube-system/konnectivity-agent-t9hpt" May 28 11:03:04.343367 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:04.343073 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 11:03:04.343367 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:04.343098 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 11:03:04.343367 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:04.343111 2551 projected.go:194] Error preparing data for projected volume kube-api-access-rkm5x for pod openshift-network-diagnostics/network-check-target-tb8vv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 11:03:04.343367 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:04.343188 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bc40b8d-8878-48e4-bf31-adae0ae6ef7b-kube-api-access-rkm5x podName:9bc40b8d-8878-48e4-bf31-adae0ae6ef7b nodeName:}" failed. No retries permitted until 2026-05-28 11:03:04.843169373 +0000 UTC m=+3.084829247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rkm5x" (UniqueName: "kubernetes.io/projected/9bc40b8d-8878-48e4-bf31-adae0ae6ef7b-kube-api-access-rkm5x") pod "network-check-target-tb8vv" (UID: "9bc40b8d-8878-48e4-bf31-adae0ae6ef7b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 11:03:04.345127 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.345033 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhpkd\" (UniqueName: \"kubernetes.io/projected/ae806252-dc90-4483-83b3-d4226fea2310-kube-api-access-qhpkd\") pod \"multus-additional-cni-plugins-r9dfm\" (UID: \"ae806252-dc90-4483-83b3-d4226fea2310\") " pod="openshift-multus/multus-additional-cni-plugins-r9dfm" May 28 11:03:04.345639 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.345595 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld7tr\" (UniqueName: \"kubernetes.io/projected/beb4d19c-3f94-4eca-a161-0e9ca088ab97-kube-api-access-ld7tr\") pod \"iptables-alerter-jwtkt\" (UID: \"beb4d19c-3f94-4eca-a161-0e9ca088ab97\") " pod="openshift-network-operator/iptables-alerter-jwtkt" May 28 11:03:04.345826 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.345803 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5k5f\" (UniqueName: \"kubernetes.io/projected/714bfb15-bce6-4d8a-b81e-2af3366caf14-kube-api-access-m5k5f\") pod \"tuned-kgg5s\" (UID: \"714bfb15-bce6-4d8a-b81e-2af3366caf14\") " pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.346293 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.346269 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn2bj\" (UniqueName: \"kubernetes.io/projected/8102dd33-f306-4bc2-a3a2-b0681b2b0eda-kube-api-access-dn2bj\") pod \"aws-ebs-csi-driver-node-ng4m6\" (UID: \"8102dd33-f306-4bc2-a3a2-b0681b2b0eda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4m6" May 28 11:03:04.346497 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.346452 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmvh4\" (UniqueName: \"kubernetes.io/projected/651502be-d3a5-4259-a6be-3282eda430db-kube-api-access-cmvh4\") pod \"network-metrics-daemon-k5dvc\" (UID: \"651502be-d3a5-4259-a6be-3282eda430db\") " pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:03:04.346604 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.346549 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlfl7\" (UniqueName: \"kubernetes.io/projected/8c1c4ad4-f62f-4d7d-9a30-0fae41b4738b-kube-api-access-vlfl7\") pod \"node-resolver-sbnm7\" (UID: \"8c1c4ad4-f62f-4d7d-9a30-0fae41b4738b\") " pod="openshift-dns/node-resolver-sbnm7" May 28 11:03:04.346932 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.346911 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzmml\" (UniqueName: \"kubernetes.io/projected/97c5bb3c-8bc1-40c4-908d-46f349f6513f-kube-api-access-nzmml\") pod \"multus-4g2xp\" (UID: \"97c5bb3c-8bc1-40c4-908d-46f349f6513f\") " pod="openshift-multus/multus-4g2xp" May 28 11:03:04.347283 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.347262 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbxgm\" (UniqueName: \"kubernetes.io/projected/31f22620-e687-49e2-a50b-60b1d5239a01-kube-api-access-sbxgm\") pod \"ovnkube-node-rv2r4\" (UID: \"31f22620-e687-49e2-a50b-60b1d5239a01\") " pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.347583 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.347565 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh5k7\" (UniqueName: \"kubernetes.io/projected/804fb564-4d88-4cc8-8c56-5b653c8f53cf-kube-api-access-nh5k7\") pod \"node-ca-xrf98\" (UID: \"804fb564-4d88-4cc8-8c56-5b653c8f53cf\") " pod="openshift-image-registry/node-ca-xrf98" May 28 11:03:04.516026 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.515939 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sbnm7" May 28 11:03:04.524889 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.524861 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4g2xp" May 28 11:03:04.531554 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.531527 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t9hpt" May 28 11:03:04.537317 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.537299 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4m6" May 28 11:03:04.545709 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.545687 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r9dfm" May 28 11:03:04.554280 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.554251 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jwtkt" May 28 11:03:04.559927 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.559908 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:04.568523 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.568502 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" May 28 11:03:04.574089 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.574056 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xrf98" May 28 11:03:04.702408 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.702374 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-pn6f9"] May 28 11:03:04.704284 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.704262 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:04.704381 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:04.704332 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6f9" podUID="c1bc63dc-1a2b-4366-9a88-7c97526f0367" May 28 11:03:04.736384 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.736357 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c1bc63dc-1a2b-4366-9a88-7c97526f0367-kubelet-config\") pod \"global-pull-secret-syncer-pn6f9\" (UID: \"c1bc63dc-1a2b-4366-9a88-7c97526f0367\") " pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:04.736507 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.736439 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c1bc63dc-1a2b-4366-9a88-7c97526f0367-dbus\") pod \"global-pull-secret-syncer-pn6f9\" (UID: \"c1bc63dc-1a2b-4366-9a88-7c97526f0367\") " pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:04.736507 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.736465 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1bc63dc-1a2b-4366-9a88-7c97526f0367-original-pull-secret\") pod \"global-pull-secret-syncer-pn6f9\" (UID: \"c1bc63dc-1a2b-4366-9a88-7c97526f0367\") " pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:04.826905 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:04.826873 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae806252_dc90_4483_83b3_d4226fea2310.slice/crio-723654fc68a1ac36de90da751d1c99e1dc72f7e1a467e691ff936064a7de5e13 WatchSource:0}: Error finding container 723654fc68a1ac36de90da751d1c99e1dc72f7e1a467e691ff936064a7de5e13: Status 404 returned error can't find the container with id 723654fc68a1ac36de90da751d1c99e1dc72f7e1a467e691ff936064a7de5e13 May 28 11:03:04.827865 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:04.827835 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa7c8f3e_9641_416a_bf97_1b3cd1f94cb8.slice/crio-722bad63c9eccfb0c17f07bcf54e4b5ad78fb34c5fe47e9226b8a78c1bd0a926 WatchSource:0}: Error finding container 722bad63c9eccfb0c17f07bcf54e4b5ad78fb34c5fe47e9226b8a78c1bd0a926: Status 404 returned error can't find the container with id 722bad63c9eccfb0c17f07bcf54e4b5ad78fb34c5fe47e9226b8a78c1bd0a926 May 28 11:03:04.832817 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:04.832794 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31f22620_e687_49e2_a50b_60b1d5239a01.slice/crio-fea19a092a6649e1a351840b50dc1a4058f636340258014ad4e46f7f69f931f9 WatchSource:0}: Error finding container fea19a092a6649e1a351840b50dc1a4058f636340258014ad4e46f7f69f931f9: Status 404 returned error can't find the container with id fea19a092a6649e1a351840b50dc1a4058f636340258014ad4e46f7f69f931f9 May 28 11:03:04.833174 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:04.833155 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8102dd33_f306_4bc2_a3a2_b0681b2b0eda.slice/crio-d01ab055004b7a6bf5484ac7aec17ae602d24a2de1c2367036586a00aa3fcb91 WatchSource:0}: Error finding container d01ab055004b7a6bf5484ac7aec17ae602d24a2de1c2367036586a00aa3fcb91: Status 404 returned error can't find the container with id d01ab055004b7a6bf5484ac7aec17ae602d24a2de1c2367036586a00aa3fcb91 May 28 11:03:04.833648 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:04.833602 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod804fb564_4d88_4cc8_8c56_5b653c8f53cf.slice/crio-5f42e5eb655bd5cc17707c27a03fb54d3ce3956b38a4bef86843fcdbc11c9709 WatchSource:0}: Error finding container 5f42e5eb655bd5cc17707c27a03fb54d3ce3956b38a4bef86843fcdbc11c9709: Status 404 returned error can't find the container with id 5f42e5eb655bd5cc17707c27a03fb54d3ce3956b38a4bef86843fcdbc11c9709 May 28 11:03:04.834604 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:04.834427 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod714bfb15_bce6_4d8a_b81e_2af3366caf14.slice/crio-54dc121f6a12d9bd288728327e266bf7f1e1374c5722686a097aaeaae2a449b2 WatchSource:0}: Error finding container 54dc121f6a12d9bd288728327e266bf7f1e1374c5722686a097aaeaae2a449b2: Status 404 returned error can't find the container with id 54dc121f6a12d9bd288728327e266bf7f1e1374c5722686a097aaeaae2a449b2 May 28 11:03:04.835050 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:04.834994 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c1c4ad4_f62f_4d7d_9a30_0fae41b4738b.slice/crio-b4ec6ddebb4f8a4298dc59e694edfdcce4a8b8434bfb8b33f1a603151da0bae6 WatchSource:0}: Error finding container b4ec6ddebb4f8a4298dc59e694edfdcce4a8b8434bfb8b33f1a603151da0bae6: Status 404 returned error can't find the container with id b4ec6ddebb4f8a4298dc59e694edfdcce4a8b8434bfb8b33f1a603151da0bae6 May 28 11:03:04.836166 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:04.836143 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97c5bb3c_8bc1_40c4_908d_46f349f6513f.slice/crio-f0126cb17df593e4310e768aed889e2d9e5ef4a1ba77ed7359528f45ed6400fe WatchSource:0}: Error finding container f0126cb17df593e4310e768aed889e2d9e5ef4a1ba77ed7359528f45ed6400fe: Status 404 returned error can't find the container with id f0126cb17df593e4310e768aed889e2d9e5ef4a1ba77ed7359528f45ed6400fe May 28 11:03:04.836890 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.836838 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c1bc63dc-1a2b-4366-9a88-7c97526f0367-kubelet-config\") pod \"global-pull-secret-syncer-pn6f9\" (UID: \"c1bc63dc-1a2b-4366-9a88-7c97526f0367\") " pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:04.836948 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.836895 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/651502be-d3a5-4259-a6be-3282eda430db-metrics-certs\") pod \"network-metrics-daemon-k5dvc\" (UID: \"651502be-d3a5-4259-a6be-3282eda430db\") " pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:03:04.836948 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.836939 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c1bc63dc-1a2b-4366-9a88-7c97526f0367-dbus\") pod \"global-pull-secret-syncer-pn6f9\" (UID: \"c1bc63dc-1a2b-4366-9a88-7c97526f0367\") " pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:04.837164 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.836971 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1bc63dc-1a2b-4366-9a88-7c97526f0367-original-pull-secret\") pod \"global-pull-secret-syncer-pn6f9\" (UID: \"c1bc63dc-1a2b-4366-9a88-7c97526f0367\") " pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:04.837164 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.837013 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c1bc63dc-1a2b-4366-9a88-7c97526f0367-kubelet-config\") pod \"global-pull-secret-syncer-pn6f9\" (UID: \"c1bc63dc-1a2b-4366-9a88-7c97526f0367\") " pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:04.837164 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:04.837101 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 11:03:04.837164 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:04.837140 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 11:03:04.837164 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:04.837151 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1bc63dc-1a2b-4366-9a88-7c97526f0367-original-pull-secret podName:c1bc63dc-1a2b-4366-9a88-7c97526f0367 nodeName:}" failed. No retries permitted until 2026-05-28 11:03:05.337131847 +0000 UTC m=+3.578791731 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1bc63dc-1a2b-4366-9a88-7c97526f0367-original-pull-secret") pod "global-pull-secret-syncer-pn6f9" (UID: "c1bc63dc-1a2b-4366-9a88-7c97526f0367") : object "kube-system"/"original-pull-secret" not registered May 28 11:03:04.837512 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:04.837190 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/651502be-d3a5-4259-a6be-3282eda430db-metrics-certs podName:651502be-d3a5-4259-a6be-3282eda430db nodeName:}" failed. No retries permitted until 2026-05-28 11:03:05.837172084 +0000 UTC m=+4.078831953 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/651502be-d3a5-4259-a6be-3282eda430db-metrics-certs") pod "network-metrics-daemon-k5dvc" (UID: "651502be-d3a5-4259-a6be-3282eda430db") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 11:03:04.837512 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.837215 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c1bc63dc-1a2b-4366-9a88-7c97526f0367-dbus\") pod \"global-pull-secret-syncer-pn6f9\" (UID: \"c1bc63dc-1a2b-4366-9a88-7c97526f0367\") " pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:04.837986 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:04.837923 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeb4d19c_3f94_4eca_a161_0e9ca088ab97.slice/crio-cc49ec5592ca6e69506bf48910b0667aabbe6557ffb9d885a8b9e0d817b07d2c WatchSource:0}: Error finding container cc49ec5592ca6e69506bf48910b0667aabbe6557ffb9d885a8b9e0d817b07d2c: Status 404 returned error can't find the container with id cc49ec5592ca6e69506bf48910b0667aabbe6557ffb9d885a8b9e0d817b07d2c May 28 11:03:04.937449 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:04.937420 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rkm5x\" (UniqueName: \"kubernetes.io/projected/9bc40b8d-8878-48e4-bf31-adae0ae6ef7b-kube-api-access-rkm5x\") pod \"network-check-target-tb8vv\" (UID: \"9bc40b8d-8878-48e4-bf31-adae0ae6ef7b\") " pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:03:04.937613 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:04.937594 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 11:03:04.937662 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:04.937624 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 11:03:04.937662 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:04.937638 2551 projected.go:194] Error preparing data for projected volume kube-api-access-rkm5x for pod openshift-network-diagnostics/network-check-target-tb8vv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 11:03:04.937757 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:04.937695 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bc40b8d-8878-48e4-bf31-adae0ae6ef7b-kube-api-access-rkm5x podName:9bc40b8d-8878-48e4-bf31-adae0ae6ef7b nodeName:}" failed. No retries permitted until 2026-05-28 11:03:05.937676647 +0000 UTC m=+4.179336534 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rkm5x" (UniqueName: "kubernetes.io/projected/9bc40b8d-8878-48e4-bf31-adae0ae6ef7b-kube-api-access-rkm5x") pod "network-check-target-tb8vv" (UID: "9bc40b8d-8878-48e4-bf31-adae0ae6ef7b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 11:03:05.266911 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:05.266837 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 10:58:03 +0000 UTC" deadline="2027-12-03 07:45:56.314258116 +0000 UTC" May 28 11:03:05.266911 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:05.266872 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13292h42m51.04738984s" May 28 11:03:05.341704 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:05.340977 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1bc63dc-1a2b-4366-9a88-7c97526f0367-original-pull-secret\") pod \"global-pull-secret-syncer-pn6f9\" (UID: \"c1bc63dc-1a2b-4366-9a88-7c97526f0367\") " pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:05.341704 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:05.341166 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 11:03:05.341704 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:05.341275 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1bc63dc-1a2b-4366-9a88-7c97526f0367-original-pull-secret podName:c1bc63dc-1a2b-4366-9a88-7c97526f0367 nodeName:}" failed. No retries permitted until 2026-05-28 11:03:06.341238856 +0000 UTC m=+4.582898740 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1bc63dc-1a2b-4366-9a88-7c97526f0367-original-pull-secret") pod "global-pull-secret-syncer-pn6f9" (UID: "c1bc63dc-1a2b-4366-9a88-7c97526f0367") : object "kube-system"/"original-pull-secret" not registered May 28 11:03:05.379192 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:05.379152 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" event={"ID":"31f22620-e687-49e2-a50b-60b1d5239a01","Type":"ContainerStarted","Data":"fea19a092a6649e1a351840b50dc1a4058f636340258014ad4e46f7f69f931f9"} May 28 11:03:05.385379 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:05.385343 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t9hpt" event={"ID":"aa7c8f3e-9641-416a-bf97-1b3cd1f94cb8","Type":"ContainerStarted","Data":"722bad63c9eccfb0c17f07bcf54e4b5ad78fb34c5fe47e9226b8a78c1bd0a926"} May 28 11:03:05.394496 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:05.394420 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9dfm" event={"ID":"ae806252-dc90-4483-83b3-d4226fea2310","Type":"ContainerStarted","Data":"723654fc68a1ac36de90da751d1c99e1dc72f7e1a467e691ff936064a7de5e13"} May 28 11:03:05.400929 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:05.400264 2551 generic.go:358] "Generic (PLEG): container finished" podID="b00054eda24f863510bc2e4dadf784ea" containerID="9b2317a49e1151d388d22575f4e41d497ac04192f5304f8034cc62e88d23fad9" exitCode=0 May 28 11:03:05.400929 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:05.400329 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-105.ec2.internal" event={"ID":"b00054eda24f863510bc2e4dadf784ea","Type":"ContainerDied","Data":"9b2317a49e1151d388d22575f4e41d497ac04192f5304f8034cc62e88d23fad9"} May 28 11:03:05.402445 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:05.402384 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sbnm7" event={"ID":"8c1c4ad4-f62f-4d7d-9a30-0fae41b4738b","Type":"ContainerStarted","Data":"b4ec6ddebb4f8a4298dc59e694edfdcce4a8b8434bfb8b33f1a603151da0bae6"} May 28 11:03:05.406825 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:05.406792 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" event={"ID":"714bfb15-bce6-4d8a-b81e-2af3366caf14","Type":"ContainerStarted","Data":"54dc121f6a12d9bd288728327e266bf7f1e1374c5722686a097aaeaae2a449b2"} May 28 11:03:05.411162 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:05.411137 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xrf98" event={"ID":"804fb564-4d88-4cc8-8c56-5b653c8f53cf","Type":"ContainerStarted","Data":"5f42e5eb655bd5cc17707c27a03fb54d3ce3956b38a4bef86843fcdbc11c9709"} May 28 11:03:05.414055 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:05.414032 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4m6" event={"ID":"8102dd33-f306-4bc2-a3a2-b0681b2b0eda","Type":"ContainerStarted","Data":"d01ab055004b7a6bf5484ac7aec17ae602d24a2de1c2367036586a00aa3fcb91"} May 28 11:03:05.427997 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:05.427868 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-105.ec2.internal" event={"ID":"bfe7c384ac44926637b571b166b49362","Type":"ContainerStarted","Data":"168767b7d3384f7cd8a703b0036e0d09084667550f36dfc94df9fde7ab61d1dc"} May 28 11:03:05.431353 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:05.431327 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jwtkt" event={"ID":"beb4d19c-3f94-4eca-a161-0e9ca088ab97","Type":"ContainerStarted","Data":"cc49ec5592ca6e69506bf48910b0667aabbe6557ffb9d885a8b9e0d817b07d2c"} May 28 11:03:05.440176 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:05.436281 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4g2xp" event={"ID":"97c5bb3c-8bc1-40c4-908d-46f349f6513f","Type":"ContainerStarted","Data":"f0126cb17df593e4310e768aed889e2d9e5ef4a1ba77ed7359528f45ed6400fe"} May 28 11:03:05.844941 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:05.844902 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/651502be-d3a5-4259-a6be-3282eda430db-metrics-certs\") pod \"network-metrics-daemon-k5dvc\" (UID: \"651502be-d3a5-4259-a6be-3282eda430db\") " pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:03:05.845150 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:05.845080 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 11:03:05.845150 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:05.845144 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/651502be-d3a5-4259-a6be-3282eda430db-metrics-certs podName:651502be-d3a5-4259-a6be-3282eda430db nodeName:}" failed. No retries permitted until 2026-05-28 11:03:07.845126198 +0000 UTC m=+6.086786068 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/651502be-d3a5-4259-a6be-3282eda430db-metrics-certs") pod "network-metrics-daemon-k5dvc" (UID: "651502be-d3a5-4259-a6be-3282eda430db") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 11:03:05.945520 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:05.945435 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rkm5x\" (UniqueName: \"kubernetes.io/projected/9bc40b8d-8878-48e4-bf31-adae0ae6ef7b-kube-api-access-rkm5x\") pod \"network-check-target-tb8vv\" (UID: \"9bc40b8d-8878-48e4-bf31-adae0ae6ef7b\") " pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:03:05.945672 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:05.945631 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 11:03:05.945672 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:05.945649 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 11:03:05.945672 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:05.945663 2551 projected.go:194] Error preparing data for projected volume kube-api-access-rkm5x for pod openshift-network-diagnostics/network-check-target-tb8vv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 11:03:05.945836 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:05.945718 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bc40b8d-8878-48e4-bf31-adae0ae6ef7b-kube-api-access-rkm5x podName:9bc40b8d-8878-48e4-bf31-adae0ae6ef7b nodeName:}" failed. No retries permitted until 2026-05-28 11:03:07.945701223 +0000 UTC m=+6.187361100 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rkm5x" (UniqueName: "kubernetes.io/projected/9bc40b8d-8878-48e4-bf31-adae0ae6ef7b-kube-api-access-rkm5x") pod "network-check-target-tb8vv" (UID: "9bc40b8d-8878-48e4-bf31-adae0ae6ef7b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 11:03:06.349165 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:06.349054 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1bc63dc-1a2b-4366-9a88-7c97526f0367-original-pull-secret\") pod \"global-pull-secret-syncer-pn6f9\" (UID: \"c1bc63dc-1a2b-4366-9a88-7c97526f0367\") " pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:06.349598 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:06.349169 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 11:03:06.349598 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:06.349228 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1bc63dc-1a2b-4366-9a88-7c97526f0367-original-pull-secret podName:c1bc63dc-1a2b-4366-9a88-7c97526f0367 nodeName:}" failed. No retries permitted until 2026-05-28 11:03:08.349209723 +0000 UTC m=+6.590869594 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1bc63dc-1a2b-4366-9a88-7c97526f0367-original-pull-secret") pod "global-pull-secret-syncer-pn6f9" (UID: "c1bc63dc-1a2b-4366-9a88-7c97526f0367") : object "kube-system"/"original-pull-secret" not registered May 28 11:03:06.355205 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:06.355177 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:06.355332 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:06.355284 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6f9" podUID="c1bc63dc-1a2b-4366-9a88-7c97526f0367" May 28 11:03:06.355733 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:06.355177 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:03:06.355733 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:06.355493 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb8vv" podUID="9bc40b8d-8878-48e4-bf31-adae0ae6ef7b" May 28 11:03:06.355733 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:06.355613 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:03:06.355733 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:06.355701 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5dvc" podUID="651502be-d3a5-4259-a6be-3282eda430db" May 28 11:03:06.452339 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:06.452300 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-105.ec2.internal" event={"ID":"b00054eda24f863510bc2e4dadf784ea","Type":"ContainerStarted","Data":"8d39d5eebb3606185773c025ee8931b9683fa192fb12b047c4776eaf73a50e56"} May 28 11:03:06.469997 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:06.469938 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-105.ec2.internal" podStartSLOduration=3.469923028 podStartE2EDuration="3.469923028s" podCreationTimestamp="2026-05-28 11:03:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 11:03:05.440502977 +0000 UTC m=+3.682162870" watchObservedRunningTime="2026-05-28 11:03:06.469923028 +0000 UTC m=+4.711582921" May 28 11:03:07.862703 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:07.862566 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/651502be-d3a5-4259-a6be-3282eda430db-metrics-certs\") pod \"network-metrics-daemon-k5dvc\" (UID: \"651502be-d3a5-4259-a6be-3282eda430db\") " pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:03:07.863214 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:07.862714 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 11:03:07.863214 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:07.862777 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/651502be-d3a5-4259-a6be-3282eda430db-metrics-certs podName:651502be-d3a5-4259-a6be-3282eda430db nodeName:}" failed. No retries permitted until 2026-05-28 11:03:11.862758046 +0000 UTC m=+10.104417919 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/651502be-d3a5-4259-a6be-3282eda430db-metrics-certs") pod "network-metrics-daemon-k5dvc" (UID: "651502be-d3a5-4259-a6be-3282eda430db") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 11:03:07.963947 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:07.963883 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rkm5x\" (UniqueName: \"kubernetes.io/projected/9bc40b8d-8878-48e4-bf31-adae0ae6ef7b-kube-api-access-rkm5x\") pod \"network-check-target-tb8vv\" (UID: \"9bc40b8d-8878-48e4-bf31-adae0ae6ef7b\") " pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:03:07.964147 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:07.964093 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 11:03:07.964147 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:07.964120 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 11:03:07.964147 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:07.964133 2551 projected.go:194] Error preparing data for projected volume kube-api-access-rkm5x for pod openshift-network-diagnostics/network-check-target-tb8vv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 11:03:07.964329 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:07.964204 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bc40b8d-8878-48e4-bf31-adae0ae6ef7b-kube-api-access-rkm5x podName:9bc40b8d-8878-48e4-bf31-adae0ae6ef7b nodeName:}" failed. No retries permitted until 2026-05-28 11:03:11.964184322 +0000 UTC m=+10.205844193 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rkm5x" (UniqueName: "kubernetes.io/projected/9bc40b8d-8878-48e4-bf31-adae0ae6ef7b-kube-api-access-rkm5x") pod "network-check-target-tb8vv" (UID: "9bc40b8d-8878-48e4-bf31-adae0ae6ef7b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 11:03:08.356393 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:08.355869 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:03:08.356393 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:08.356013 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5dvc" podUID="651502be-d3a5-4259-a6be-3282eda430db" May 28 11:03:08.356393 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:08.356092 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:08.356393 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:08.356148 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:03:08.356393 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:08.356235 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb8vv" podUID="9bc40b8d-8878-48e4-bf31-adae0ae6ef7b" May 28 11:03:08.356393 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:08.356329 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6f9" podUID="c1bc63dc-1a2b-4366-9a88-7c97526f0367" May 28 11:03:08.367327 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:08.367300 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1bc63dc-1a2b-4366-9a88-7c97526f0367-original-pull-secret\") pod \"global-pull-secret-syncer-pn6f9\" (UID: \"c1bc63dc-1a2b-4366-9a88-7c97526f0367\") " pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:08.367491 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:08.367476 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 11:03:08.367551 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:08.367533 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1bc63dc-1a2b-4366-9a88-7c97526f0367-original-pull-secret podName:c1bc63dc-1a2b-4366-9a88-7c97526f0367 nodeName:}" failed. No retries permitted until 2026-05-28 11:03:12.367517323 +0000 UTC m=+10.609177199 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1bc63dc-1a2b-4366-9a88-7c97526f0367-original-pull-secret") pod "global-pull-secret-syncer-pn6f9" (UID: "c1bc63dc-1a2b-4366-9a88-7c97526f0367") : object "kube-system"/"original-pull-secret" not registered May 28 11:03:10.356325 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:10.355767 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:03:10.356325 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:10.355902 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb8vv" podUID="9bc40b8d-8878-48e4-bf31-adae0ae6ef7b" May 28 11:03:10.356325 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:10.355974 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:03:10.356325 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:10.356088 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5dvc" podUID="651502be-d3a5-4259-a6be-3282eda430db" May 28 11:03:10.356325 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:10.356216 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:10.356325 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:10.356297 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6f9" podUID="c1bc63dc-1a2b-4366-9a88-7c97526f0367" May 28 11:03:11.899121 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:11.899085 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/651502be-d3a5-4259-a6be-3282eda430db-metrics-certs\") pod \"network-metrics-daemon-k5dvc\" (UID: \"651502be-d3a5-4259-a6be-3282eda430db\") " pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:03:11.899632 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:11.899243 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 11:03:11.899632 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:11.899312 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/651502be-d3a5-4259-a6be-3282eda430db-metrics-certs podName:651502be-d3a5-4259-a6be-3282eda430db nodeName:}" failed. No retries permitted until 2026-05-28 11:03:19.899291836 +0000 UTC m=+18.140951708 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/651502be-d3a5-4259-a6be-3282eda430db-metrics-certs") pod "network-metrics-daemon-k5dvc" (UID: "651502be-d3a5-4259-a6be-3282eda430db") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 11:03:12.000378 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:12.000337 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rkm5x\" (UniqueName: \"kubernetes.io/projected/9bc40b8d-8878-48e4-bf31-adae0ae6ef7b-kube-api-access-rkm5x\") pod \"network-check-target-tb8vv\" (UID: \"9bc40b8d-8878-48e4-bf31-adae0ae6ef7b\") " pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:03:12.000613 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:12.000529 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 11:03:12.000613 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:12.000548 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 11:03:12.000613 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:12.000561 2551 projected.go:194] Error preparing data for projected volume kube-api-access-rkm5x for pod openshift-network-diagnostics/network-check-target-tb8vv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 11:03:12.000772 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:12.000616 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bc40b8d-8878-48e4-bf31-adae0ae6ef7b-kube-api-access-rkm5x podName:9bc40b8d-8878-48e4-bf31-adae0ae6ef7b nodeName:}" failed. No retries permitted until 2026-05-28 11:03:20.000595714 +0000 UTC m=+18.242255601 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rkm5x" (UniqueName: "kubernetes.io/projected/9bc40b8d-8878-48e4-bf31-adae0ae6ef7b-kube-api-access-rkm5x") pod "network-check-target-tb8vv" (UID: "9bc40b8d-8878-48e4-bf31-adae0ae6ef7b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 11:03:12.356817 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:12.355893 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:12.356817 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:12.356151 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:03:12.356817 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:12.356231 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:03:12.356817 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:12.356332 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5dvc" podUID="651502be-d3a5-4259-a6be-3282eda430db" May 28 11:03:12.356817 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:12.356381 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6f9" podUID="c1bc63dc-1a2b-4366-9a88-7c97526f0367" May 28 11:03:12.356817 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:12.356463 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb8vv" podUID="9bc40b8d-8878-48e4-bf31-adae0ae6ef7b" May 28 11:03:12.403447 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:12.403410 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1bc63dc-1a2b-4366-9a88-7c97526f0367-original-pull-secret\") pod \"global-pull-secret-syncer-pn6f9\" (UID: \"c1bc63dc-1a2b-4366-9a88-7c97526f0367\") " pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:12.403635 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:12.403591 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 11:03:12.403693 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:12.403646 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1bc63dc-1a2b-4366-9a88-7c97526f0367-original-pull-secret podName:c1bc63dc-1a2b-4366-9a88-7c97526f0367 nodeName:}" failed. No retries permitted until 2026-05-28 11:03:20.403627576 +0000 UTC m=+18.645287454 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1bc63dc-1a2b-4366-9a88-7c97526f0367-original-pull-secret") pod "global-pull-secret-syncer-pn6f9" (UID: "c1bc63dc-1a2b-4366-9a88-7c97526f0367") : object "kube-system"/"original-pull-secret" not registered May 28 11:03:14.355040 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:14.355007 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:03:14.355504 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:14.355083 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:03:14.355504 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:14.355211 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb8vv" podUID="9bc40b8d-8878-48e4-bf31-adae0ae6ef7b" May 28 11:03:14.355614 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:14.355552 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:14.355733 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:14.355702 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6f9" podUID="c1bc63dc-1a2b-4366-9a88-7c97526f0367" May 28 11:03:14.355854 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:14.355791 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5dvc" podUID="651502be-d3a5-4259-a6be-3282eda430db" May 28 11:03:16.355701 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:16.355660 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:03:16.355701 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:16.355697 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:16.356230 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:16.355669 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:03:16.356230 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:16.355824 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb8vv" podUID="9bc40b8d-8878-48e4-bf31-adae0ae6ef7b" May 28 11:03:16.356230 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:16.355889 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5dvc" podUID="651502be-d3a5-4259-a6be-3282eda430db" May 28 11:03:16.356230 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:16.356010 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6f9" podUID="c1bc63dc-1a2b-4366-9a88-7c97526f0367" May 28 11:03:18.355690 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:18.355653 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:03:18.356146 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:18.355653 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:18.356146 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:18.355783 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5dvc" podUID="651502be-d3a5-4259-a6be-3282eda430db" May 28 11:03:18.356146 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:18.355653 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:03:18.356146 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:18.355864 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6f9" podUID="c1bc63dc-1a2b-4366-9a88-7c97526f0367" May 28 11:03:18.356146 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:18.355915 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb8vv" podUID="9bc40b8d-8878-48e4-bf31-adae0ae6ef7b" May 28 11:03:19.958972 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:19.958934 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/651502be-d3a5-4259-a6be-3282eda430db-metrics-certs\") pod \"network-metrics-daemon-k5dvc\" (UID: \"651502be-d3a5-4259-a6be-3282eda430db\") " pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:03:19.959430 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:19.959075 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 11:03:19.959430 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:19.959133 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/651502be-d3a5-4259-a6be-3282eda430db-metrics-certs podName:651502be-d3a5-4259-a6be-3282eda430db nodeName:}" failed. No retries permitted until 2026-05-28 11:03:35.959115632 +0000 UTC m=+34.200775502 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/651502be-d3a5-4259-a6be-3282eda430db-metrics-certs") pod "network-metrics-daemon-k5dvc" (UID: "651502be-d3a5-4259-a6be-3282eda430db") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 11:03:20.060209 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:20.060166 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rkm5x\" (UniqueName: \"kubernetes.io/projected/9bc40b8d-8878-48e4-bf31-adae0ae6ef7b-kube-api-access-rkm5x\") pod \"network-check-target-tb8vv\" (UID: \"9bc40b8d-8878-48e4-bf31-adae0ae6ef7b\") " pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:03:20.060409 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:20.060377 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 11:03:20.060409 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:20.060407 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 11:03:20.060518 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:20.060421 2551 projected.go:194] Error preparing data for projected volume kube-api-access-rkm5x for pod openshift-network-diagnostics/network-check-target-tb8vv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 11:03:20.060518 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:20.060486 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bc40b8d-8878-48e4-bf31-adae0ae6ef7b-kube-api-access-rkm5x podName:9bc40b8d-8878-48e4-bf31-adae0ae6ef7b nodeName:}" failed. No retries permitted until 2026-05-28 11:03:36.060466697 +0000 UTC m=+34.302126583 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rkm5x" (UniqueName: "kubernetes.io/projected/9bc40b8d-8878-48e4-bf31-adae0ae6ef7b-kube-api-access-rkm5x") pod "network-check-target-tb8vv" (UID: "9bc40b8d-8878-48e4-bf31-adae0ae6ef7b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 11:03:20.358878 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:20.358844 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:03:20.359078 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:20.358881 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:03:20.359078 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:20.358905 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:20.359078 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:20.359001 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb8vv" podUID="9bc40b8d-8878-48e4-bf31-adae0ae6ef7b" May 28 11:03:20.359226 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:20.359078 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5dvc" podUID="651502be-d3a5-4259-a6be-3282eda430db" May 28 11:03:20.359226 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:20.359138 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6f9" podUID="c1bc63dc-1a2b-4366-9a88-7c97526f0367" May 28 11:03:20.463896 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:20.463858 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1bc63dc-1a2b-4366-9a88-7c97526f0367-original-pull-secret\") pod \"global-pull-secret-syncer-pn6f9\" (UID: \"c1bc63dc-1a2b-4366-9a88-7c97526f0367\") " pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:20.464049 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:20.463996 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 28 11:03:20.464140 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:20.464074 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1bc63dc-1a2b-4366-9a88-7c97526f0367-original-pull-secret podName:c1bc63dc-1a2b-4366-9a88-7c97526f0367 nodeName:}" failed. No retries permitted until 2026-05-28 11:03:36.464042257 +0000 UTC m=+34.705702128 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1bc63dc-1a2b-4366-9a88-7c97526f0367-original-pull-secret") pod "global-pull-secret-syncer-pn6f9" (UID: "c1bc63dc-1a2b-4366-9a88-7c97526f0367") : object "kube-system"/"original-pull-secret" not registered May 28 11:03:22.355785 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:22.355752 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:03:22.356238 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:22.355832 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:03:22.356238 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:22.355867 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:22.356238 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:22.355890 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb8vv" podUID="9bc40b8d-8878-48e4-bf31-adae0ae6ef7b" May 28 11:03:22.356238 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:22.355939 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6f9" podUID="c1bc63dc-1a2b-4366-9a88-7c97526f0367" May 28 11:03:22.356238 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:22.356005 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5dvc" podUID="651502be-d3a5-4259-a6be-3282eda430db" May 28 11:03:23.481965 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:23.481775 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sbnm7" event={"ID":"8c1c4ad4-f62f-4d7d-9a30-0fae41b4738b","Type":"ContainerStarted","Data":"c251c7e422cc788bcb6f3adcef6631fc3071cbc93d093f0d5d580e7a8ea522d7"} May 28 11:03:23.483093 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:23.483049 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" event={"ID":"714bfb15-bce6-4d8a-b81e-2af3366caf14","Type":"ContainerStarted","Data":"fbf867f488de39ff74d11342feff33fffb0bd369fd3dc59913c03e305f979e02"} May 28 11:03:23.484242 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:23.484203 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xrf98" event={"ID":"804fb564-4d88-4cc8-8c56-5b653c8f53cf","Type":"ContainerStarted","Data":"df8c48b7dde3c13a20b339d6488c58912d40f4b1ed4da8a8f6508737d2cb7292"} May 28 11:03:23.486459 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:23.486430 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4m6" event={"ID":"8102dd33-f306-4bc2-a3a2-b0681b2b0eda","Type":"ContainerStarted","Data":"cc06f87bc38540b0d8b54eae18714dc5fd7e4d2878f33e7b6018de28ab3c897e"} May 28 11:03:23.487690 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:23.487667 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4g2xp" event={"ID":"97c5bb3c-8bc1-40c4-908d-46f349f6513f","Type":"ContainerStarted","Data":"fa776e3126e5b9ff9b2db856fc1d8eeb717bb81c3780bfb98acd42b9319dc037"} May 28 11:03:23.489571 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:23.489539 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" event={"ID":"31f22620-e687-49e2-a50b-60b1d5239a01","Type":"ContainerStarted","Data":"03604aa4d2470ead8e7a8c86a0671ecef3a5563a9034e26233e9eea96975b8a7"} May 28 11:03:23.489571 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:23.489563 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" event={"ID":"31f22620-e687-49e2-a50b-60b1d5239a01","Type":"ContainerStarted","Data":"586a7ac6654d27dd4d59859bc043ea753e7377eda876f6edb72ddfb23912bc35"} May 28 11:03:23.489720 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:23.489577 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" event={"ID":"31f22620-e687-49e2-a50b-60b1d5239a01","Type":"ContainerStarted","Data":"d218c1c0b696055097f0ab6b47f12ba7e08a0f8763e1db5fb2ec8c078b7d88a5"} May 28 11:03:23.489720 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:23.489588 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" event={"ID":"31f22620-e687-49e2-a50b-60b1d5239a01","Type":"ContainerStarted","Data":"7325b07ae271ead31397f7c50847a25c54a76d459811aa0805f67d1944fa66c6"} May 28 11:03:23.490625 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:23.490603 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t9hpt" event={"ID":"aa7c8f3e-9641-416a-bf97-1b3cd1f94cb8","Type":"ContainerStarted","Data":"5d86db096850bf73a88f06b492eed45b4a2906323face0fcf32b97c28cb00490"} May 28 11:03:23.491840 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:23.491818 2551 generic.go:358] "Generic (PLEG): container finished" podID="ae806252-dc90-4483-83b3-d4226fea2310" containerID="1bce459f46ecd4de3aa92fedb74b3dcd0225a6f52628ef6c3c6dd56d440174c1" exitCode=0 May 28 11:03:23.491905 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:23.491848 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9dfm" event={"ID":"ae806252-dc90-4483-83b3-d4226fea2310","Type":"ContainerDied","Data":"1bce459f46ecd4de3aa92fedb74b3dcd0225a6f52628ef6c3c6dd56d440174c1"} May 28 11:03:23.497417 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:23.497386 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-105.ec2.internal" podStartSLOduration=20.497376383 podStartE2EDuration="20.497376383s" podCreationTimestamp="2026-05-28 11:03:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 11:03:06.470516283 +0000 UTC m=+4.712176176" watchObservedRunningTime="2026-05-28 11:03:23.497376383 +0000 UTC m=+21.739036275" May 28 11:03:23.497669 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:23.497643 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-sbnm7" podStartSLOduration=3.378742343 podStartE2EDuration="21.497638843s" podCreationTimestamp="2026-05-28 11:03:02 +0000 UTC" firstStartedPulling="2026-05-28 11:03:04.837499987 +0000 UTC m=+3.079159871" lastFinishedPulling="2026-05-28 11:03:22.956396496 +0000 UTC m=+21.198056371" observedRunningTime="2026-05-28 11:03:23.497016563 +0000 UTC m=+21.738676454" watchObservedRunningTime="2026-05-28 11:03:23.497638843 +0000 UTC m=+21.739298734" May 28 11:03:23.513462 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:23.513426 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-4g2xp" podStartSLOduration=3.219230639 podStartE2EDuration="21.513415527s" podCreationTimestamp="2026-05-28 11:03:02 +0000 UTC" firstStartedPulling="2026-05-28 11:03:04.838964744 +0000 UTC m=+3.080624621" lastFinishedPulling="2026-05-28 11:03:23.133149633 +0000 UTC m=+21.374809509" observedRunningTime="2026-05-28 11:03:23.512838289 +0000 UTC m=+21.754498182" watchObservedRunningTime="2026-05-28 11:03:23.513415527 +0000 UTC m=+21.755075419" May 28 11:03:23.526367 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:23.526334 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-t9hpt" podStartSLOduration=3.399760376 podStartE2EDuration="21.526324193s" podCreationTimestamp="2026-05-28 11:03:02 +0000 UTC" firstStartedPulling="2026-05-28 11:03:04.829709148 +0000 UTC m=+3.071369017" lastFinishedPulling="2026-05-28 11:03:22.956272964 +0000 UTC m=+21.197932834" observedRunningTime="2026-05-28 11:03:23.526000029 +0000 UTC m=+21.767659922" watchObservedRunningTime="2026-05-28 11:03:23.526324193 +0000 UTC m=+21.767984083" May 28 11:03:23.544223 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:23.544185 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kgg5s" podStartSLOduration=3.422484559 podStartE2EDuration="21.544174237s" podCreationTimestamp="2026-05-28 11:03:02 +0000 UTC" firstStartedPulling="2026-05-28 11:03:04.836206956 +0000 UTC m=+3.077866833" lastFinishedPulling="2026-05-28 11:03:22.957896628 +0000 UTC m=+21.199556511" observedRunningTime="2026-05-28 11:03:23.543932516 +0000 UTC m=+21.785592409" watchObservedRunningTime="2026-05-28 11:03:23.544174237 +0000 UTC m=+21.785834128" May 28 11:03:23.559148 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:23.559108 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xrf98" podStartSLOduration=7.229295785 podStartE2EDuration="21.55909466s" podCreationTimestamp="2026-05-28 11:03:02 +0000 UTC" firstStartedPulling="2026-05-28 11:03:04.835655322 +0000 UTC m=+3.077315191" lastFinishedPulling="2026-05-28 11:03:19.165454192 +0000 UTC m=+17.407114066" observedRunningTime="2026-05-28 11:03:23.558667599 +0000 UTC m=+21.800327491" watchObservedRunningTime="2026-05-28 11:03:23.55909466 +0000 UTC m=+21.800754555" May 28 11:03:24.355295 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:24.355263 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:03:24.355430 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:24.355387 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb8vv" podUID="9bc40b8d-8878-48e4-bf31-adae0ae6ef7b" May 28 11:03:24.355843 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:24.355823 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:03:24.355953 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:24.355932 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5dvc" podUID="651502be-d3a5-4259-a6be-3282eda430db" May 28 11:03:24.356162 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:24.356140 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:24.356273 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:24.356252 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6f9" podUID="c1bc63dc-1a2b-4366-9a88-7c97526f0367" May 28 11:03:24.417002 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:24.416949 2551 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 28 11:03:24.495962 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:24.495882 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4m6" event={"ID":"8102dd33-f306-4bc2-a3a2-b0681b2b0eda","Type":"ContainerStarted","Data":"e3e53ce36bff6e7af5a7a4edbfcee3d4a3c89faba0bf25018ecd3248b7eda826"} May 28 11:03:24.497392 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:24.497361 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jwtkt" event={"ID":"beb4d19c-3f94-4eca-a161-0e9ca088ab97","Type":"ContainerStarted","Data":"22e518e2e498946d689a0026a98bf485f15c8bb22d606a7fbc02bdc274afcff7"} May 28 11:03:24.500198 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:24.500174 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" event={"ID":"31f22620-e687-49e2-a50b-60b1d5239a01","Type":"ContainerStarted","Data":"3763336a8964338bc719cceba792e088fe0c605cb45177b8b718335a7e7caa6c"} May 28 11:03:24.500306 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:24.500204 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" event={"ID":"31f22620-e687-49e2-a50b-60b1d5239a01","Type":"ContainerStarted","Data":"eeb2b85ecc37ca0da3ca712ae8929582e33756669d9423530bc7dd979cf9138d"} May 28 11:03:24.520600 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:24.520559 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jwtkt" podStartSLOduration=4.404046552 podStartE2EDuration="22.520547159s" podCreationTimestamp="2026-05-28 11:03:02 +0000 UTC" firstStartedPulling="2026-05-28 11:03:04.839629209 +0000 UTC m=+3.081289083" lastFinishedPulling="2026-05-28 11:03:22.956129812 +0000 UTC m=+21.197789690" observedRunningTime="2026-05-28 11:03:24.520419155 +0000 UTC m=+22.762079049" watchObservedRunningTime="2026-05-28 11:03:24.520547159 +0000 UTC m=+22.762207074" May 28 11:03:25.294751 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:25.294638 2551 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T11:03:24.416968723Z","UUID":"535aceaf-8ed4-472e-bd34-860bc9322f75","Handler":null,"Name":"","Endpoint":""} May 28 11:03:25.296874 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:25.296853 2551 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 28 11:03:25.296874 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:25.296879 2551 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 28 11:03:25.504211 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:25.504134 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4m6" event={"ID":"8102dd33-f306-4bc2-a3a2-b0681b2b0eda","Type":"ContainerStarted","Data":"b76d7c5c465d36cd6e9ec76bd6ff806cd1a4a1be66d4bdc1051f9d5d285c50f5"} May 28 11:03:25.522044 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:25.521992 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ng4m6" podStartSLOduration=3.030836115 podStartE2EDuration="23.521973932s" podCreationTimestamp="2026-05-28 11:03:02 +0000 UTC" firstStartedPulling="2026-05-28 11:03:04.83522081 +0000 UTC m=+3.076880692" lastFinishedPulling="2026-05-28 11:03:25.326358638 +0000 UTC m=+23.568018509" observedRunningTime="2026-05-28 11:03:25.521209579 +0000 UTC m=+23.762869471" watchObservedRunningTime="2026-05-28 11:03:25.521973932 +0000 UTC m=+23.763633825" May 28 11:03:26.355295 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:26.355258 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:03:26.355295 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:26.355284 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:26.355538 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:26.355391 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb8vv" podUID="9bc40b8d-8878-48e4-bf31-adae0ae6ef7b" May 28 11:03:26.355538 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:26.355415 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:03:26.355538 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:26.355499 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5dvc" podUID="651502be-d3a5-4259-a6be-3282eda430db" May 28 11:03:26.355655 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:26.355621 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6f9" podUID="c1bc63dc-1a2b-4366-9a88-7c97526f0367" May 28 11:03:26.509346 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:26.509305 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" event={"ID":"31f22620-e687-49e2-a50b-60b1d5239a01","Type":"ContainerStarted","Data":"c3bcdb997d6941afe96ef8294f41acfeb2b52cd75b152c47ad8946d88a016da3"} May 28 11:03:27.730747 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:27.730713 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-t9hpt" May 28 11:03:27.731744 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:27.731721 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-t9hpt" May 28 11:03:28.355371 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:28.355182 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:03:28.355530 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:28.355216 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:28.355530 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:28.355437 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb8vv" podUID="9bc40b8d-8878-48e4-bf31-adae0ae6ef7b" May 28 11:03:28.355530 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:28.355238 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:03:28.355664 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:28.355551 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6f9" podUID="c1bc63dc-1a2b-4366-9a88-7c97526f0367" May 28 11:03:28.355664 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:28.355647 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5dvc" podUID="651502be-d3a5-4259-a6be-3282eda430db" May 28 11:03:28.516434 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:28.516393 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" event={"ID":"31f22620-e687-49e2-a50b-60b1d5239a01","Type":"ContainerStarted","Data":"60210443688cb860a035191adc1fe3e5efdd75488a92204691374015864d82ed"} May 28 11:03:28.516750 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:28.516723 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:28.516876 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:28.516759 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:28.517902 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:28.517877 2551 generic.go:358] "Generic (PLEG): container finished" podID="ae806252-dc90-4483-83b3-d4226fea2310" containerID="24db21286600ba05be55e7bbf5ac6ac12d451fa1a5d0d550cd1fc50d883c3521" exitCode=0 May 28 11:03:28.517987 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:28.517950 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9dfm" event={"ID":"ae806252-dc90-4483-83b3-d4226fea2310","Type":"ContainerDied","Data":"24db21286600ba05be55e7bbf5ac6ac12d451fa1a5d0d550cd1fc50d883c3521"} May 28 11:03:28.532559 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:28.532535 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:28.532654 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:28.532605 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:28.542012 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:28.541977 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" podStartSLOduration=8.401831771 podStartE2EDuration="26.541966646s" podCreationTimestamp="2026-05-28 11:03:02 +0000 UTC" firstStartedPulling="2026-05-28 11:03:04.835231468 +0000 UTC m=+3.076891349" lastFinishedPulling="2026-05-28 11:03:22.975366334 +0000 UTC m=+21.217026224" observedRunningTime="2026-05-28 11:03:28.540365419 +0000 UTC m=+26.782025311" watchObservedRunningTime="2026-05-28 11:03:28.541966646 +0000 UTC m=+26.783626550" May 28 11:03:28.628258 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:28.628195 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:03:29.521498 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:29.521466 2551 generic.go:358] "Generic (PLEG): container finished" podID="ae806252-dc90-4483-83b3-d4226fea2310" containerID="488c46623876654b61b05a12a0fcdab2eac12f34075986abbd035a2021070683" exitCode=0 May 28 11:03:29.521873 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:29.521553 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9dfm" event={"ID":"ae806252-dc90-4483-83b3-d4226fea2310","Type":"ContainerDied","Data":"488c46623876654b61b05a12a0fcdab2eac12f34075986abbd035a2021070683"} May 28 11:03:29.962251 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:29.962075 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tb8vv"] May 28 11:03:29.962402 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:29.962369 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:03:29.962471 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:29.962453 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb8vv" podUID="9bc40b8d-8878-48e4-bf31-adae0ae6ef7b" May 28 11:03:29.964986 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:29.964961 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k5dvc"] May 28 11:03:29.965108 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:29.965095 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:03:29.965224 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:29.965204 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5dvc" podUID="651502be-d3a5-4259-a6be-3282eda430db" May 28 11:03:29.965703 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:29.965686 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pn6f9"] May 28 11:03:29.965804 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:29.965788 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:29.965905 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:29.965883 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6f9" podUID="c1bc63dc-1a2b-4366-9a88-7c97526f0367" May 28 11:03:30.525012 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:30.524978 2551 generic.go:358] "Generic (PLEG): container finished" podID="ae806252-dc90-4483-83b3-d4226fea2310" containerID="d7eca9b232c427faffb9caf5a805350ff98927e9600b9c93ce3a4673a1e6c4ae" exitCode=0 May 28 11:03:30.525520 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:30.525079 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9dfm" event={"ID":"ae806252-dc90-4483-83b3-d4226fea2310","Type":"ContainerDied","Data":"d7eca9b232c427faffb9caf5a805350ff98927e9600b9c93ce3a4673a1e6c4ae"} May 28 11:03:31.354946 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:31.354913 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:03:31.355147 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:31.354913 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:03:31.355147 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:31.355025 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb8vv" podUID="9bc40b8d-8878-48e4-bf31-adae0ae6ef7b" May 28 11:03:31.355147 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:31.355122 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5dvc" podUID="651502be-d3a5-4259-a6be-3282eda430db" May 28 11:03:32.356107 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:32.356019 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:32.356666 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:32.356164 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6f9" podUID="c1bc63dc-1a2b-4366-9a88-7c97526f0367" May 28 11:03:33.355270 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:33.355238 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:03:33.355270 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:33.355255 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:03:33.355465 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:33.355354 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb8vv" podUID="9bc40b8d-8878-48e4-bf31-adae0ae6ef7b" May 28 11:03:33.355514 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:33.355478 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5dvc" podUID="651502be-d3a5-4259-a6be-3282eda430db" May 28 11:03:34.355580 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:34.355546 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:34.356129 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:34.355673 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pn6f9" podUID="c1bc63dc-1a2b-4366-9a88-7c97526f0367" May 28 11:03:34.448234 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:34.448206 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-t9hpt" May 28 11:03:34.448394 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:34.448340 2551 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 28 11:03:34.449001 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:34.448981 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-t9hpt" May 28 11:03:35.355749 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.355715 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:03:35.356207 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.355715 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:03:35.356207 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:35.355841 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb8vv" podUID="9bc40b8d-8878-48e4-bf31-adae0ae6ef7b" May 28 11:03:35.356207 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:35.355947 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-k5dvc" podUID="651502be-d3a5-4259-a6be-3282eda430db" May 28 11:03:35.562292 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.562113 2551 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-130-105.ec2.internal" event="NodeReady" May 28 11:03:35.562469 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.562396 2551 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 28 11:03:35.609988 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.609867 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2p4rf"] May 28 11:03:35.661576 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.661539 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kcddp"] May 28 11:03:35.661797 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.661713 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2p4rf" May 28 11:03:35.664303 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.664172 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 28 11:03:35.664303 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.664258 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 28 11:03:35.664303 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.664297 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nq6bj\"" May 28 11:03:35.681448 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.681427 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2p4rf"] May 28 11:03:35.681567 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.681453 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kcddp"] May 28 11:03:35.681567 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.681543 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kcddp" May 28 11:03:35.684283 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.684136 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 28 11:03:35.684283 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.684148 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 28 11:03:35.684283 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.684151 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8gjbt\"" May 28 11:03:35.684283 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.684175 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 28 11:03:35.784630 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.784588 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/58fc8bd1-415a-4618-971d-03a6d76be5ea-config-volume\") pod \"dns-default-2p4rf\" (UID: \"58fc8bd1-415a-4618-971d-03a6d76be5ea\") " pod="openshift-dns/dns-default-2p4rf" May 28 11:03:35.784786 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.784636 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c8wm\" (UniqueName: \"kubernetes.io/projected/58fc8bd1-415a-4618-971d-03a6d76be5ea-kube-api-access-2c8wm\") pod \"dns-default-2p4rf\" (UID: \"58fc8bd1-415a-4618-971d-03a6d76be5ea\") " pod="openshift-dns/dns-default-2p4rf" May 28 11:03:35.784786 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.784665 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58fc8bd1-415a-4618-971d-03a6d76be5ea-metrics-tls\") pod \"dns-default-2p4rf\" (UID: \"58fc8bd1-415a-4618-971d-03a6d76be5ea\") " pod="openshift-dns/dns-default-2p4rf" May 28 11:03:35.784786 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.784732 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89006b03-182a-475a-849d-a93d928d555b-cert\") pod \"ingress-canary-kcddp\" (UID: \"89006b03-182a-475a-849d-a93d928d555b\") " pod="openshift-ingress-canary/ingress-canary-kcddp" May 28 11:03:35.784929 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.784817 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrnqp\" (UniqueName: \"kubernetes.io/projected/89006b03-182a-475a-849d-a93d928d555b-kube-api-access-mrnqp\") pod \"ingress-canary-kcddp\" (UID: \"89006b03-182a-475a-849d-a93d928d555b\") " pod="openshift-ingress-canary/ingress-canary-kcddp" May 28 11:03:35.784929 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.784865 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58fc8bd1-415a-4618-971d-03a6d76be5ea-tmp-dir\") pod \"dns-default-2p4rf\" (UID: \"58fc8bd1-415a-4618-971d-03a6d76be5ea\") " pod="openshift-dns/dns-default-2p4rf" May 28 11:03:35.885487 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.885390 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mrnqp\" (UniqueName: \"kubernetes.io/projected/89006b03-182a-475a-849d-a93d928d555b-kube-api-access-mrnqp\") pod \"ingress-canary-kcddp\" (UID: \"89006b03-182a-475a-849d-a93d928d555b\") " pod="openshift-ingress-canary/ingress-canary-kcddp" May 28 11:03:35.885487 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.885472 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58fc8bd1-415a-4618-971d-03a6d76be5ea-tmp-dir\") pod \"dns-default-2p4rf\" (UID: \"58fc8bd1-415a-4618-971d-03a6d76be5ea\") " pod="openshift-dns/dns-default-2p4rf" May 28 11:03:35.885730 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.885505 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/58fc8bd1-415a-4618-971d-03a6d76be5ea-config-volume\") pod \"dns-default-2p4rf\" (UID: \"58fc8bd1-415a-4618-971d-03a6d76be5ea\") " pod="openshift-dns/dns-default-2p4rf" May 28 11:03:35.885730 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.885531 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2c8wm\" (UniqueName: \"kubernetes.io/projected/58fc8bd1-415a-4618-971d-03a6d76be5ea-kube-api-access-2c8wm\") pod \"dns-default-2p4rf\" (UID: \"58fc8bd1-415a-4618-971d-03a6d76be5ea\") " pod="openshift-dns/dns-default-2p4rf" May 28 11:03:35.885730 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.885553 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58fc8bd1-415a-4618-971d-03a6d76be5ea-metrics-tls\") pod \"dns-default-2p4rf\" (UID: \"58fc8bd1-415a-4618-971d-03a6d76be5ea\") " pod="openshift-dns/dns-default-2p4rf" May 28 11:03:35.885730 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.885586 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89006b03-182a-475a-849d-a93d928d555b-cert\") pod \"ingress-canary-kcddp\" (UID: \"89006b03-182a-475a-849d-a93d928d555b\") " pod="openshift-ingress-canary/ingress-canary-kcddp" May 28 11:03:35.885730 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:35.885688 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 11:03:35.885907 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:35.885753 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89006b03-182a-475a-849d-a93d928d555b-cert podName:89006b03-182a-475a-849d-a93d928d555b nodeName:}" failed. No retries permitted until 2026-05-28 11:03:36.385734208 +0000 UTC m=+34.627394080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/89006b03-182a-475a-849d-a93d928d555b-cert") pod "ingress-canary-kcddp" (UID: "89006b03-182a-475a-849d-a93d928d555b") : secret "canary-serving-cert" not found May 28 11:03:35.885907 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:35.885769 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 11:03:35.885907 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:35.885831 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58fc8bd1-415a-4618-971d-03a6d76be5ea-metrics-tls podName:58fc8bd1-415a-4618-971d-03a6d76be5ea nodeName:}" failed. No retries permitted until 2026-05-28 11:03:36.385812728 +0000 UTC m=+34.627472599 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58fc8bd1-415a-4618-971d-03a6d76be5ea-metrics-tls") pod "dns-default-2p4rf" (UID: "58fc8bd1-415a-4618-971d-03a6d76be5ea") : secret "dns-default-metrics-tls" not found May 28 11:03:35.886020 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.886001 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58fc8bd1-415a-4618-971d-03a6d76be5ea-tmp-dir\") pod \"dns-default-2p4rf\" (UID: \"58fc8bd1-415a-4618-971d-03a6d76be5ea\") " pod="openshift-dns/dns-default-2p4rf" May 28 11:03:35.886220 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.886190 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/58fc8bd1-415a-4618-971d-03a6d76be5ea-config-volume\") pod \"dns-default-2p4rf\" (UID: \"58fc8bd1-415a-4618-971d-03a6d76be5ea\") " pod="openshift-dns/dns-default-2p4rf" May 28 11:03:35.896703 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.896681 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c8wm\" (UniqueName: \"kubernetes.io/projected/58fc8bd1-415a-4618-971d-03a6d76be5ea-kube-api-access-2c8wm\") pod \"dns-default-2p4rf\" (UID: \"58fc8bd1-415a-4618-971d-03a6d76be5ea\") " pod="openshift-dns/dns-default-2p4rf" May 28 11:03:35.896823 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.896751 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrnqp\" (UniqueName: \"kubernetes.io/projected/89006b03-182a-475a-849d-a93d928d555b-kube-api-access-mrnqp\") pod \"ingress-canary-kcddp\" (UID: \"89006b03-182a-475a-849d-a93d928d555b\") " pod="openshift-ingress-canary/ingress-canary-kcddp" May 28 11:03:35.986613 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:35.986574 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/651502be-d3a5-4259-a6be-3282eda430db-metrics-certs\") pod \"network-metrics-daemon-k5dvc\" (UID: \"651502be-d3a5-4259-a6be-3282eda430db\") " pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:03:35.986762 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:35.986720 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 28 11:03:35.986804 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:35.986796 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/651502be-d3a5-4259-a6be-3282eda430db-metrics-certs podName:651502be-d3a5-4259-a6be-3282eda430db nodeName:}" failed. No retries permitted until 2026-05-28 11:04:07.986782666 +0000 UTC m=+66.228442540 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/651502be-d3a5-4259-a6be-3282eda430db-metrics-certs") pod "network-metrics-daemon-k5dvc" (UID: "651502be-d3a5-4259-a6be-3282eda430db") : object "openshift-multus"/"metrics-daemon-secret" not registered May 28 11:03:36.087754 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:36.087716 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rkm5x\" (UniqueName: \"kubernetes.io/projected/9bc40b8d-8878-48e4-bf31-adae0ae6ef7b-kube-api-access-rkm5x\") pod \"network-check-target-tb8vv\" (UID: \"9bc40b8d-8878-48e4-bf31-adae0ae6ef7b\") " pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:03:36.087882 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:36.087868 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 28 11:03:36.087920 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:36.087884 2551 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 28 11:03:36.087920 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:36.087894 2551 projected.go:194] Error preparing data for projected volume kube-api-access-rkm5x for pod openshift-network-diagnostics/network-check-target-tb8vv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 11:03:36.087984 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:36.087946 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9bc40b8d-8878-48e4-bf31-adae0ae6ef7b-kube-api-access-rkm5x podName:9bc40b8d-8878-48e4-bf31-adae0ae6ef7b nodeName:}" failed. No retries permitted until 2026-05-28 11:04:08.087930879 +0000 UTC m=+66.329590750 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rkm5x" (UniqueName: "kubernetes.io/projected/9bc40b8d-8878-48e4-bf31-adae0ae6ef7b-kube-api-access-rkm5x") pod "network-check-target-tb8vv" (UID: "9bc40b8d-8878-48e4-bf31-adae0ae6ef7b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 28 11:03:36.354880 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:36.354841 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:36.357811 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:36.357785 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 28 11:03:36.390220 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:36.390193 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58fc8bd1-415a-4618-971d-03a6d76be5ea-metrics-tls\") pod \"dns-default-2p4rf\" (UID: \"58fc8bd1-415a-4618-971d-03a6d76be5ea\") " pod="openshift-dns/dns-default-2p4rf" May 28 11:03:36.390337 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:36.390231 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89006b03-182a-475a-849d-a93d928d555b-cert\") pod \"ingress-canary-kcddp\" (UID: \"89006b03-182a-475a-849d-a93d928d555b\") " pod="openshift-ingress-canary/ingress-canary-kcddp" May 28 11:03:36.390375 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:36.390342 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 11:03:36.390375 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:36.390353 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 11:03:36.390439 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:36.390401 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89006b03-182a-475a-849d-a93d928d555b-cert podName:89006b03-182a-475a-849d-a93d928d555b nodeName:}" failed. No retries permitted until 2026-05-28 11:03:37.39038682 +0000 UTC m=+35.632046690 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/89006b03-182a-475a-849d-a93d928d555b-cert") pod "ingress-canary-kcddp" (UID: "89006b03-182a-475a-849d-a93d928d555b") : secret "canary-serving-cert" not found May 28 11:03:36.390439 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:36.390417 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58fc8bd1-415a-4618-971d-03a6d76be5ea-metrics-tls podName:58fc8bd1-415a-4618-971d-03a6d76be5ea nodeName:}" failed. No retries permitted until 2026-05-28 11:03:37.390408502 +0000 UTC m=+35.632068372 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58fc8bd1-415a-4618-971d-03a6d76be5ea-metrics-tls") pod "dns-default-2p4rf" (UID: "58fc8bd1-415a-4618-971d-03a6d76be5ea") : secret "dns-default-metrics-tls" not found May 28 11:03:36.491556 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:36.491530 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1bc63dc-1a2b-4366-9a88-7c97526f0367-original-pull-secret\") pod \"global-pull-secret-syncer-pn6f9\" (UID: \"c1bc63dc-1a2b-4366-9a88-7c97526f0367\") " pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:36.493609 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:36.493588 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1bc63dc-1a2b-4366-9a88-7c97526f0367-original-pull-secret\") pod \"global-pull-secret-syncer-pn6f9\" (UID: \"c1bc63dc-1a2b-4366-9a88-7c97526f0367\") " pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:36.539021 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:36.538993 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9dfm" event={"ID":"ae806252-dc90-4483-83b3-d4226fea2310","Type":"ContainerStarted","Data":"6bdd299ef59175bd3f43885e982b63ab183b06a5097c764335e95f82407ec33e"} May 28 11:03:36.663662 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:36.663631 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pn6f9" May 28 11:03:36.789118 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:36.789091 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pn6f9"] May 28 11:03:36.792221 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:36.792192 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1bc63dc_1a2b_4366_9a88_7c97526f0367.slice/crio-c6494ff948abf24e730727733a901ef98c6201163cec4b67a3f9d154af9e11f1 WatchSource:0}: Error finding container c6494ff948abf24e730727733a901ef98c6201163cec4b67a3f9d154af9e11f1: Status 404 returned error can't find the container with id c6494ff948abf24e730727733a901ef98c6201163cec4b67a3f9d154af9e11f1 May 28 11:03:37.355677 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:37.355643 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:03:37.355949 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:37.355642 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:03:37.358815 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:37.358797 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 28 11:03:37.359111 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:37.358817 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 28 11:03:37.359994 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:37.359973 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7rhrk\"" May 28 11:03:37.360109 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:37.360033 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 28 11:03:37.360109 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:37.360048 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nncjx\"" May 28 11:03:37.397672 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:37.397647 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58fc8bd1-415a-4618-971d-03a6d76be5ea-metrics-tls\") pod \"dns-default-2p4rf\" (UID: \"58fc8bd1-415a-4618-971d-03a6d76be5ea\") " pod="openshift-dns/dns-default-2p4rf" May 28 11:03:37.397772 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:37.397681 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89006b03-182a-475a-849d-a93d928d555b-cert\") pod \"ingress-canary-kcddp\" (UID: \"89006b03-182a-475a-849d-a93d928d555b\") " pod="openshift-ingress-canary/ingress-canary-kcddp" May 28 11:03:37.397772 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:37.397768 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 11:03:37.397772 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:37.397776 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 11:03:37.397959 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:37.397825 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89006b03-182a-475a-849d-a93d928d555b-cert podName:89006b03-182a-475a-849d-a93d928d555b nodeName:}" failed. No retries permitted until 2026-05-28 11:03:39.397806429 +0000 UTC m=+37.639466302 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/89006b03-182a-475a-849d-a93d928d555b-cert") pod "ingress-canary-kcddp" (UID: "89006b03-182a-475a-849d-a93d928d555b") : secret "canary-serving-cert" not found May 28 11:03:37.397959 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:37.397843 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58fc8bd1-415a-4618-971d-03a6d76be5ea-metrics-tls podName:58fc8bd1-415a-4618-971d-03a6d76be5ea nodeName:}" failed. No retries permitted until 2026-05-28 11:03:39.397833639 +0000 UTC m=+37.639493509 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58fc8bd1-415a-4618-971d-03a6d76be5ea-metrics-tls") pod "dns-default-2p4rf" (UID: "58fc8bd1-415a-4618-971d-03a6d76be5ea") : secret "dns-default-metrics-tls" not found May 28 11:03:37.543428 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:37.543392 2551 generic.go:358] "Generic (PLEG): container finished" podID="ae806252-dc90-4483-83b3-d4226fea2310" containerID="6bdd299ef59175bd3f43885e982b63ab183b06a5097c764335e95f82407ec33e" exitCode=0 May 28 11:03:37.543601 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:37.543461 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9dfm" event={"ID":"ae806252-dc90-4483-83b3-d4226fea2310","Type":"ContainerDied","Data":"6bdd299ef59175bd3f43885e982b63ab183b06a5097c764335e95f82407ec33e"} May 28 11:03:37.545256 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:37.545229 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pn6f9" event={"ID":"c1bc63dc-1a2b-4366-9a88-7c97526f0367","Type":"ContainerStarted","Data":"c6494ff948abf24e730727733a901ef98c6201163cec4b67a3f9d154af9e11f1"} May 28 11:03:38.550210 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:38.550017 2551 generic.go:358] "Generic (PLEG): container finished" podID="ae806252-dc90-4483-83b3-d4226fea2310" containerID="f106aef02d9760753eba2df85f0bf78ae31696a2562d8750b7ca8c9c458728cf" exitCode=0 May 28 11:03:38.550210 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:38.550092 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9dfm" event={"ID":"ae806252-dc90-4483-83b3-d4226fea2310","Type":"ContainerDied","Data":"f106aef02d9760753eba2df85f0bf78ae31696a2562d8750b7ca8c9c458728cf"} May 28 11:03:39.413555 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:39.413522 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58fc8bd1-415a-4618-971d-03a6d76be5ea-metrics-tls\") pod \"dns-default-2p4rf\" (UID: \"58fc8bd1-415a-4618-971d-03a6d76be5ea\") " pod="openshift-dns/dns-default-2p4rf" May 28 11:03:39.413555 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:39.413559 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89006b03-182a-475a-849d-a93d928d555b-cert\") pod \"ingress-canary-kcddp\" (UID: \"89006b03-182a-475a-849d-a93d928d555b\") " pod="openshift-ingress-canary/ingress-canary-kcddp" May 28 11:03:39.413767 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:39.413662 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 11:03:39.413767 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:39.413667 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 11:03:39.413767 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:39.413728 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89006b03-182a-475a-849d-a93d928d555b-cert podName:89006b03-182a-475a-849d-a93d928d555b nodeName:}" failed. No retries permitted until 2026-05-28 11:03:43.413700299 +0000 UTC m=+41.655360169 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/89006b03-182a-475a-849d-a93d928d555b-cert") pod "ingress-canary-kcddp" (UID: "89006b03-182a-475a-849d-a93d928d555b") : secret "canary-serving-cert" not found May 28 11:03:39.413767 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:39.413742 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58fc8bd1-415a-4618-971d-03a6d76be5ea-metrics-tls podName:58fc8bd1-415a-4618-971d-03a6d76be5ea nodeName:}" failed. No retries permitted until 2026-05-28 11:03:43.413735851 +0000 UTC m=+41.655395720 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58fc8bd1-415a-4618-971d-03a6d76be5ea-metrics-tls") pod "dns-default-2p4rf" (UID: "58fc8bd1-415a-4618-971d-03a6d76be5ea") : secret "dns-default-metrics-tls" not found May 28 11:03:39.555717 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:39.555682 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r9dfm" event={"ID":"ae806252-dc90-4483-83b3-d4226fea2310","Type":"ContainerStarted","Data":"c3f0734536ed8aca00bd46ee4fdc27ed4591e605c3df7e35b4bbcd80dcb4b1e0"} May 28 11:03:39.583944 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:39.583903 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r9dfm" podStartSLOduration=6.004676655 podStartE2EDuration="37.583889967s" podCreationTimestamp="2026-05-28 11:03:02 +0000 UTC" firstStartedPulling="2026-05-28 11:03:04.829015505 +0000 UTC m=+3.070675376" lastFinishedPulling="2026-05-28 11:03:36.408228815 +0000 UTC m=+34.649888688" observedRunningTime="2026-05-28 11:03:39.582883238 +0000 UTC m=+37.824543178" watchObservedRunningTime="2026-05-28 11:03:39.583889967 +0000 UTC m=+37.825549858" May 28 11:03:41.560852 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:41.560815 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pn6f9" event={"ID":"c1bc63dc-1a2b-4366-9a88-7c97526f0367","Type":"ContainerStarted","Data":"cae93e383a2e0f906ed8a6a6ba7425b27bc271dc7608b8d82b57fc880adfe860"} May 28 11:03:41.575204 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:41.575160 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pn6f9" podStartSLOduration=33.332737691 podStartE2EDuration="37.575146579s" podCreationTimestamp="2026-05-28 11:03:04 +0000 UTC" firstStartedPulling="2026-05-28 11:03:36.793982003 +0000 UTC m=+35.035641873" lastFinishedPulling="2026-05-28 11:03:41.036390881 +0000 UTC m=+39.278050761" observedRunningTime="2026-05-28 11:03:41.575118355 +0000 UTC m=+39.816778246" watchObservedRunningTime="2026-05-28 11:03:41.575146579 +0000 UTC m=+39.816806470" May 28 11:03:43.442476 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:43.442436 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58fc8bd1-415a-4618-971d-03a6d76be5ea-metrics-tls\") pod \"dns-default-2p4rf\" (UID: \"58fc8bd1-415a-4618-971d-03a6d76be5ea\") " pod="openshift-dns/dns-default-2p4rf" May 28 11:03:43.442476 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:43.442482 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89006b03-182a-475a-849d-a93d928d555b-cert\") pod \"ingress-canary-kcddp\" (UID: \"89006b03-182a-475a-849d-a93d928d555b\") " pod="openshift-ingress-canary/ingress-canary-kcddp" May 28 11:03:43.442923 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:43.442585 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 11:03:43.442923 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:43.442649 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58fc8bd1-415a-4618-971d-03a6d76be5ea-metrics-tls podName:58fc8bd1-415a-4618-971d-03a6d76be5ea nodeName:}" failed. No retries permitted until 2026-05-28 11:03:51.442631599 +0000 UTC m=+49.684291472 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58fc8bd1-415a-4618-971d-03a6d76be5ea-metrics-tls") pod "dns-default-2p4rf" (UID: "58fc8bd1-415a-4618-971d-03a6d76be5ea") : secret "dns-default-metrics-tls" not found May 28 11:03:43.442923 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:43.442589 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 11:03:43.442923 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:43.442767 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89006b03-182a-475a-849d-a93d928d555b-cert podName:89006b03-182a-475a-849d-a93d928d555b nodeName:}" failed. No retries permitted until 2026-05-28 11:03:51.442748298 +0000 UTC m=+49.684408181 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/89006b03-182a-475a-849d-a93d928d555b-cert") pod "ingress-canary-kcddp" (UID: "89006b03-182a-475a-849d-a93d928d555b") : secret "canary-serving-cert" not found May 28 11:03:51.497293 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:51.497255 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58fc8bd1-415a-4618-971d-03a6d76be5ea-metrics-tls\") pod \"dns-default-2p4rf\" (UID: \"58fc8bd1-415a-4618-971d-03a6d76be5ea\") " pod="openshift-dns/dns-default-2p4rf" May 28 11:03:51.497293 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:51.497294 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89006b03-182a-475a-849d-a93d928d555b-cert\") pod \"ingress-canary-kcddp\" (UID: \"89006b03-182a-475a-849d-a93d928d555b\") " pod="openshift-ingress-canary/ingress-canary-kcddp" May 28 11:03:51.497682 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:51.497386 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 11:03:51.497682 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:51.497406 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 11:03:51.497682 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:51.497442 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89006b03-182a-475a-849d-a93d928d555b-cert podName:89006b03-182a-475a-849d-a93d928d555b nodeName:}" failed. No retries permitted until 2026-05-28 11:04:07.497430128 +0000 UTC m=+65.739089999 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/89006b03-182a-475a-849d-a93d928d555b-cert") pod "ingress-canary-kcddp" (UID: "89006b03-182a-475a-849d-a93d928d555b") : secret "canary-serving-cert" not found May 28 11:03:51.497682 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:03:51.497466 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58fc8bd1-415a-4618-971d-03a6d76be5ea-metrics-tls podName:58fc8bd1-415a-4618-971d-03a6d76be5ea nodeName:}" failed. No retries permitted until 2026-05-28 11:04:07.497452747 +0000 UTC m=+65.739112617 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58fc8bd1-415a-4618-971d-03a6d76be5ea-metrics-tls") pod "dns-default-2p4rf" (UID: "58fc8bd1-415a-4618-971d-03a6d76be5ea") : secret "dns-default-metrics-tls" not found May 28 11:03:53.251293 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:53.251247 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f"] May 28 11:03:53.269867 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:53.269836 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f"] May 28 11:03:53.269993 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:53.269932 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" May 28 11:03:53.272492 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:53.272469 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" May 28 11:03:53.272615 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:53.272492 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" May 28 11:03:53.272615 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:53.272574 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 28 11:03:53.272615 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:53.272600 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 28 11:03:53.272746 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:53.272625 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" May 28 11:03:53.273483 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:53.273467 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 28 11:03:53.273569 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:53.273536 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" May 28 11:03:53.412584 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:53.412551 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/73034887-1ade-4f40-9b98-f7b47c2771c4-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-77fc546895-57d8f\" (UID: \"73034887-1ade-4f40-9b98-f7b47c2771c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" May 28 11:03:53.412584 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:53.412585 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/73034887-1ade-4f40-9b98-f7b47c2771c4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77fc546895-57d8f\" (UID: \"73034887-1ade-4f40-9b98-f7b47c2771c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" May 28 11:03:53.412762 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:53.412625 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thv68\" (UniqueName: \"kubernetes.io/projected/73034887-1ade-4f40-9b98-f7b47c2771c4-kube-api-access-thv68\") pod \"cluster-proxy-proxy-agent-77fc546895-57d8f\" (UID: \"73034887-1ade-4f40-9b98-f7b47c2771c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" May 28 11:03:53.412762 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:53.412683 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/73034887-1ade-4f40-9b98-f7b47c2771c4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77fc546895-57d8f\" (UID: \"73034887-1ade-4f40-9b98-f7b47c2771c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" May 28 11:03:53.412762 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:53.412724 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/73034887-1ade-4f40-9b98-f7b47c2771c4-ca\") pod \"cluster-proxy-proxy-agent-77fc546895-57d8f\" (UID: \"73034887-1ade-4f40-9b98-f7b47c2771c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" May 28 11:03:53.412762 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:53.412759 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/73034887-1ade-4f40-9b98-f7b47c2771c4-hub\") pod \"cluster-proxy-proxy-agent-77fc546895-57d8f\" (UID: \"73034887-1ade-4f40-9b98-f7b47c2771c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" May 28 11:03:53.513920 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:53.513860 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/73034887-1ade-4f40-9b98-f7b47c2771c4-ca\") pod \"cluster-proxy-proxy-agent-77fc546895-57d8f\" (UID: \"73034887-1ade-4f40-9b98-f7b47c2771c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" May 28 11:03:53.513920 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:53.513901 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/73034887-1ade-4f40-9b98-f7b47c2771c4-hub\") pod \"cluster-proxy-proxy-agent-77fc546895-57d8f\" (UID: \"73034887-1ade-4f40-9b98-f7b47c2771c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" May 28 11:03:53.514089 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:53.513934 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/73034887-1ade-4f40-9b98-f7b47c2771c4-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-77fc546895-57d8f\" (UID: \"73034887-1ade-4f40-9b98-f7b47c2771c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" May 28 11:03:53.514089 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:53.513952 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/73034887-1ade-4f40-9b98-f7b47c2771c4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77fc546895-57d8f\" (UID: \"73034887-1ade-4f40-9b98-f7b47c2771c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" May 28 11:03:53.514089 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:53.513990 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-thv68\" (UniqueName: \"kubernetes.io/projected/73034887-1ade-4f40-9b98-f7b47c2771c4-kube-api-access-thv68\") pod \"cluster-proxy-proxy-agent-77fc546895-57d8f\" (UID: \"73034887-1ade-4f40-9b98-f7b47c2771c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" May 28 11:03:53.514089 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:53.514015 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/73034887-1ade-4f40-9b98-f7b47c2771c4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77fc546895-57d8f\" (UID: \"73034887-1ade-4f40-9b98-f7b47c2771c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" May 28 11:03:53.514723 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:53.514699 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/73034887-1ade-4f40-9b98-f7b47c2771c4-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-77fc546895-57d8f\" (UID: \"73034887-1ade-4f40-9b98-f7b47c2771c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" May 28 11:03:53.517472 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:53.517447 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/73034887-1ade-4f40-9b98-f7b47c2771c4-ca\") pod \"cluster-proxy-proxy-agent-77fc546895-57d8f\" (UID: \"73034887-1ade-4f40-9b98-f7b47c2771c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" May 28 11:03:53.517554 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:53.517530 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/73034887-1ade-4f40-9b98-f7b47c2771c4-hub\") pod \"cluster-proxy-proxy-agent-77fc546895-57d8f\" (UID: \"73034887-1ade-4f40-9b98-f7b47c2771c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" May 28 11:03:53.517597 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:53.517537 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/73034887-1ade-4f40-9b98-f7b47c2771c4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77fc546895-57d8f\" (UID: \"73034887-1ade-4f40-9b98-f7b47c2771c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" May 28 11:03:53.517635 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:53.517615 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/73034887-1ade-4f40-9b98-f7b47c2771c4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77fc546895-57d8f\" (UID: \"73034887-1ade-4f40-9b98-f7b47c2771c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" May 28 11:03:53.522773 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:53.522750 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thv68\" (UniqueName: \"kubernetes.io/projected/73034887-1ade-4f40-9b98-f7b47c2771c4-kube-api-access-thv68\") pod \"cluster-proxy-proxy-agent-77fc546895-57d8f\" (UID: \"73034887-1ade-4f40-9b98-f7b47c2771c4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" May 28 11:03:53.589635 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:53.589611 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" May 28 11:03:53.708778 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:53.708746 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f"] May 28 11:03:53.711461 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:03:53.711436 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73034887_1ade_4f40_9b98_f7b47c2771c4.slice/crio-d010596828d4f6aef4932b2b817a1b7d89833cc7e529a0b49f3095b3748ff692 WatchSource:0}: Error finding container d010596828d4f6aef4932b2b817a1b7d89833cc7e529a0b49f3095b3748ff692: Status 404 returned error can't find the container with id d010596828d4f6aef4932b2b817a1b7d89833cc7e529a0b49f3095b3748ff692 May 28 11:03:54.584242 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:54.584207 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" event={"ID":"73034887-1ade-4f40-9b98-f7b47c2771c4","Type":"ContainerStarted","Data":"d010596828d4f6aef4932b2b817a1b7d89833cc7e529a0b49f3095b3748ff692"} May 28 11:03:57.592316 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:03:57.592232 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" event={"ID":"73034887-1ade-4f40-9b98-f7b47c2771c4","Type":"ContainerStarted","Data":"8141f5da12e002b4ee48b162f067464076c5eefc336c50a0358ffa11080f1bad"} May 28 11:04:00.543253 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:00.543226 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rv2r4" May 28 11:04:00.599196 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:00.599168 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" event={"ID":"73034887-1ade-4f40-9b98-f7b47c2771c4","Type":"ContainerStarted","Data":"1bbe22ab769ecee2b19a77ec08562d654d649093e5090d045adfe1cf054d696f"} May 28 11:04:01.603210 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:01.603174 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" event={"ID":"73034887-1ade-4f40-9b98-f7b47c2771c4","Type":"ContainerStarted","Data":"6519f7c1d95da2dd539537aa7595fa2092a1a463b55435ba811cbb627b001f6d"} May 28 11:04:01.627701 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:01.627657 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" podStartSLOduration=1.927205471 podStartE2EDuration="8.627646158s" podCreationTimestamp="2026-05-28 11:03:53 +0000 UTC" firstStartedPulling="2026-05-28 11:03:53.713344694 +0000 UTC m=+51.955004564" lastFinishedPulling="2026-05-28 11:04:00.413785381 +0000 UTC m=+58.655445251" observedRunningTime="2026-05-28 11:04:01.622970388 +0000 UTC m=+59.864630282" watchObservedRunningTime="2026-05-28 11:04:01.627646158 +0000 UTC m=+59.869306063" May 28 11:04:07.515351 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:07.515308 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58fc8bd1-415a-4618-971d-03a6d76be5ea-metrics-tls\") pod \"dns-default-2p4rf\" (UID: \"58fc8bd1-415a-4618-971d-03a6d76be5ea\") " pod="openshift-dns/dns-default-2p4rf" May 28 11:04:07.515351 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:07.515354 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89006b03-182a-475a-849d-a93d928d555b-cert\") pod \"ingress-canary-kcddp\" (UID: \"89006b03-182a-475a-849d-a93d928d555b\") " pod="openshift-ingress-canary/ingress-canary-kcddp" May 28 11:04:07.515958 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:04:07.515458 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 11:04:07.515958 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:04:07.515488 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 11:04:07.515958 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:04:07.515526 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58fc8bd1-415a-4618-971d-03a6d76be5ea-metrics-tls podName:58fc8bd1-415a-4618-971d-03a6d76be5ea nodeName:}" failed. No retries permitted until 2026-05-28 11:04:39.515508937 +0000 UTC m=+97.757168807 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58fc8bd1-415a-4618-971d-03a6d76be5ea-metrics-tls") pod "dns-default-2p4rf" (UID: "58fc8bd1-415a-4618-971d-03a6d76be5ea") : secret "dns-default-metrics-tls" not found May 28 11:04:07.515958 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:04:07.515542 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89006b03-182a-475a-849d-a93d928d555b-cert podName:89006b03-182a-475a-849d-a93d928d555b nodeName:}" failed. No retries permitted until 2026-05-28 11:04:39.515534896 +0000 UTC m=+97.757194766 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/89006b03-182a-475a-849d-a93d928d555b-cert") pod "ingress-canary-kcddp" (UID: "89006b03-182a-475a-849d-a93d928d555b") : secret "canary-serving-cert" not found May 28 11:04:08.019488 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:08.019455 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/651502be-d3a5-4259-a6be-3282eda430db-metrics-certs\") pod \"network-metrics-daemon-k5dvc\" (UID: \"651502be-d3a5-4259-a6be-3282eda430db\") " pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:04:08.022230 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:08.022214 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 28 11:04:08.030255 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:04:08.030241 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 28 11:04:08.030315 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:04:08.030300 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/651502be-d3a5-4259-a6be-3282eda430db-metrics-certs podName:651502be-d3a5-4259-a6be-3282eda430db nodeName:}" failed. No retries permitted until 2026-05-28 11:05:12.030284989 +0000 UTC m=+130.271944859 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/651502be-d3a5-4259-a6be-3282eda430db-metrics-certs") pod "network-metrics-daemon-k5dvc" (UID: "651502be-d3a5-4259-a6be-3282eda430db") : secret "metrics-daemon-secret" not found May 28 11:04:08.120753 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:08.120715 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rkm5x\" (UniqueName: \"kubernetes.io/projected/9bc40b8d-8878-48e4-bf31-adae0ae6ef7b-kube-api-access-rkm5x\") pod \"network-check-target-tb8vv\" (UID: \"9bc40b8d-8878-48e4-bf31-adae0ae6ef7b\") " pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:04:08.123621 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:08.123601 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 28 11:04:08.134220 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:08.134198 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 28 11:04:08.144601 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:08.144576 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkm5x\" (UniqueName: \"kubernetes.io/projected/9bc40b8d-8878-48e4-bf31-adae0ae6ef7b-kube-api-access-rkm5x\") pod \"network-check-target-tb8vv\" (UID: \"9bc40b8d-8878-48e4-bf31-adae0ae6ef7b\") " pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:04:08.273175 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:08.273096 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7rhrk\"" May 28 11:04:08.280482 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:08.280461 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:04:08.397626 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:08.397598 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tb8vv"] May 28 11:04:08.621113 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:08.620999 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tb8vv" event={"ID":"9bc40b8d-8878-48e4-bf31-adae0ae6ef7b","Type":"ContainerStarted","Data":"eaad77bf64e86cecae1f6b6e308023c6445afbc9c15fec4d38098c7cb0c8f19b"} May 28 11:04:12.629902 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:12.629865 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tb8vv" event={"ID":"9bc40b8d-8878-48e4-bf31-adae0ae6ef7b","Type":"ContainerStarted","Data":"9debbcdc501c9111f49bb32772e63965b96932349f29b29288020e2784367e9a"} May 28 11:04:12.630380 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:12.630009 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:04:12.646451 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:12.646407 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tb8vv" podStartSLOduration=67.504292916 podStartE2EDuration="1m10.646393978s" podCreationTimestamp="2026-05-28 11:03:02 +0000 UTC" firstStartedPulling="2026-05-28 11:04:08.402501335 +0000 UTC m=+66.644161207" lastFinishedPulling="2026-05-28 11:04:11.544602396 +0000 UTC m=+69.786262269" observedRunningTime="2026-05-28 11:04:12.646387311 +0000 UTC m=+70.888047203" watchObservedRunningTime="2026-05-28 11:04:12.646393978 +0000 UTC m=+70.888053873" May 28 11:04:33.655207 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:33.655099 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-2t6dz"] May 28 11:04:33.662850 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:33.662827 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2t6dz" May 28 11:04:33.665689 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:33.665667 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 28 11:04:33.666902 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:33.666883 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 28 11:04:33.667093 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:33.666895 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-lllhn\"" May 28 11:04:33.667174 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:33.666895 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 28 11:04:33.667229 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:33.666940 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 28 11:04:33.668119 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:33.668094 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-2t6dz"] May 28 11:04:33.787847 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:33.787816 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/af9fa108-1f8e-44cf-8d6c-6d6c1a98133e-config\") pod \"service-ca-operator-57b5b68b8-2t6dz\" (UID: \"af9fa108-1f8e-44cf-8d6c-6d6c1a98133e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2t6dz" May 28 11:04:33.787847 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:33.787847 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nqj8\" (UniqueName: \"kubernetes.io/projected/af9fa108-1f8e-44cf-8d6c-6d6c1a98133e-kube-api-access-2nqj8\") pod \"service-ca-operator-57b5b68b8-2t6dz\" (UID: \"af9fa108-1f8e-44cf-8d6c-6d6c1a98133e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2t6dz" May 28 11:04:33.788052 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:33.787869 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/af9fa108-1f8e-44cf-8d6c-6d6c1a98133e-serving-cert\") pod \"service-ca-operator-57b5b68b8-2t6dz\" (UID: \"af9fa108-1f8e-44cf-8d6c-6d6c1a98133e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2t6dz" May 28 11:04:33.888277 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:33.888245 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/af9fa108-1f8e-44cf-8d6c-6d6c1a98133e-config\") pod \"service-ca-operator-57b5b68b8-2t6dz\" (UID: \"af9fa108-1f8e-44cf-8d6c-6d6c1a98133e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2t6dz" May 28 11:04:33.888277 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:33.888278 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2nqj8\" (UniqueName: \"kubernetes.io/projected/af9fa108-1f8e-44cf-8d6c-6d6c1a98133e-kube-api-access-2nqj8\") pod \"service-ca-operator-57b5b68b8-2t6dz\" (UID: \"af9fa108-1f8e-44cf-8d6c-6d6c1a98133e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2t6dz" May 28 11:04:33.888488 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:33.888295 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/af9fa108-1f8e-44cf-8d6c-6d6c1a98133e-serving-cert\") pod \"service-ca-operator-57b5b68b8-2t6dz\" (UID: \"af9fa108-1f8e-44cf-8d6c-6d6c1a98133e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2t6dz" May 28 11:04:33.888825 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:33.888801 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/af9fa108-1f8e-44cf-8d6c-6d6c1a98133e-config\") pod \"service-ca-operator-57b5b68b8-2t6dz\" (UID: \"af9fa108-1f8e-44cf-8d6c-6d6c1a98133e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2t6dz" May 28 11:04:33.890512 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:33.890491 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/af9fa108-1f8e-44cf-8d6c-6d6c1a98133e-serving-cert\") pod \"service-ca-operator-57b5b68b8-2t6dz\" (UID: \"af9fa108-1f8e-44cf-8d6c-6d6c1a98133e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2t6dz" May 28 11:04:33.896242 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:33.896223 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nqj8\" (UniqueName: \"kubernetes.io/projected/af9fa108-1f8e-44cf-8d6c-6d6c1a98133e-kube-api-access-2nqj8\") pod \"service-ca-operator-57b5b68b8-2t6dz\" (UID: \"af9fa108-1f8e-44cf-8d6c-6d6c1a98133e\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2t6dz" May 28 11:04:33.972336 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:33.972267 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2t6dz" May 28 11:04:34.089056 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:34.089028 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-2t6dz"] May 28 11:04:34.092422 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:04:34.092394 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf9fa108_1f8e_44cf_8d6c_6d6c1a98133e.slice/crio-4985f9eb60a34c51cfb0cb6dafb762e4c677d1f17b95ba9d0f059f4289f07863 WatchSource:0}: Error finding container 4985f9eb60a34c51cfb0cb6dafb762e4c677d1f17b95ba9d0f059f4289f07863: Status 404 returned error can't find the container with id 4985f9eb60a34c51cfb0cb6dafb762e4c677d1f17b95ba9d0f059f4289f07863 May 28 11:04:34.672937 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:34.672893 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2t6dz" event={"ID":"af9fa108-1f8e-44cf-8d6c-6d6c1a98133e","Type":"ContainerStarted","Data":"4985f9eb60a34c51cfb0cb6dafb762e4c677d1f17b95ba9d0f059f4289f07863"} May 28 11:04:36.678696 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:36.678658 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2t6dz" event={"ID":"af9fa108-1f8e-44cf-8d6c-6d6c1a98133e","Type":"ContainerStarted","Data":"46f7c25e1cb88206d94dd67712e1753d8c4c6c69660e50c52111f79b4a22f080"} May 28 11:04:36.694007 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:36.693962 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2t6dz" podStartSLOduration=1.6810715520000001 podStartE2EDuration="3.693948472s" podCreationTimestamp="2026-05-28 11:04:33 +0000 UTC" firstStartedPulling="2026-05-28 11:04:34.094166487 +0000 UTC m=+92.335826357" lastFinishedPulling="2026-05-28 11:04:36.107043394 +0000 UTC m=+94.348703277" observedRunningTime="2026-05-28 11:04:36.693253827 +0000 UTC m=+94.934913731" watchObservedRunningTime="2026-05-28 11:04:36.693948472 +0000 UTC m=+94.935608363" May 28 11:04:39.401353 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:39.401324 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sbnm7_8c1c4ad4-f62f-4d7d-9a30-0fae41b4738b/dns-node-resolver/0.log" May 28 11:04:39.533074 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:39.533037 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58fc8bd1-415a-4618-971d-03a6d76be5ea-metrics-tls\") pod \"dns-default-2p4rf\" (UID: \"58fc8bd1-415a-4618-971d-03a6d76be5ea\") " pod="openshift-dns/dns-default-2p4rf" May 28 11:04:39.533191 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:39.533097 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89006b03-182a-475a-849d-a93d928d555b-cert\") pod \"ingress-canary-kcddp\" (UID: \"89006b03-182a-475a-849d-a93d928d555b\") " pod="openshift-ingress-canary/ingress-canary-kcddp" May 28 11:04:39.533191 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:04:39.533182 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 28 11:04:39.533263 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:04:39.533193 2551 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 28 11:04:39.533263 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:04:39.533243 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58fc8bd1-415a-4618-971d-03a6d76be5ea-metrics-tls podName:58fc8bd1-415a-4618-971d-03a6d76be5ea nodeName:}" failed. No retries permitted until 2026-05-28 11:05:43.533228483 +0000 UTC m=+161.774888353 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/58fc8bd1-415a-4618-971d-03a6d76be5ea-metrics-tls") pod "dns-default-2p4rf" (UID: "58fc8bd1-415a-4618-971d-03a6d76be5ea") : secret "dns-default-metrics-tls" not found May 28 11:04:39.533263 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:04:39.533258 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89006b03-182a-475a-849d-a93d928d555b-cert podName:89006b03-182a-475a-849d-a93d928d555b nodeName:}" failed. No retries permitted until 2026-05-28 11:05:43.533251878 +0000 UTC m=+161.774911747 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/89006b03-182a-475a-849d-a93d928d555b-cert") pod "ingress-canary-kcddp" (UID: "89006b03-182a-475a-849d-a93d928d555b") : secret "canary-serving-cert" not found May 28 11:04:40.401604 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:40.401576 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xrf98_804fb564-4d88-4cc8-8c56-5b653c8f53cf/node-ca/0.log" May 28 11:04:43.634481 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:04:43.634449 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tb8vv" May 28 11:05:00.926290 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:00.926255 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bx9w7"] May 28 11:05:00.928401 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:00.928381 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bx9w7" May 28 11:05:00.931980 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:00.931955 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 28 11:05:00.932115 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:00.931955 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 28 11:05:00.932115 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:00.931959 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 28 11:05:00.932115 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:00.931959 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fs2pg\"" May 28 11:05:00.932325 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:00.932252 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 28 11:05:00.939198 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:00.939175 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-865858fc96-5rkkp"] May 28 11:05:00.941193 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:00.941175 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-865858fc96-5rkkp" May 28 11:05:00.942899 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:00.942879 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bx9w7"] May 28 11:05:00.944021 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:00.944003 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 28 11:05:00.944143 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:00.944009 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tstrs\"" May 28 11:05:00.944443 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:00.944429 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 28 11:05:00.944729 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:00.944714 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 28 11:05:00.949419 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:00.949399 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 28 11:05:00.959889 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:00.959870 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-865858fc96-5rkkp"] May 28 11:05:01.082538 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.082507 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87747eaa-7924-4337-b061-3808eae4b037-bound-sa-token\") pod \"image-registry-865858fc96-5rkkp\" (UID: \"87747eaa-7924-4337-b061-3808eae4b037\") " pod="openshift-image-registry/image-registry-865858fc96-5rkkp" May 28 11:05:01.082697 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.082555 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/98f48786-bb87-492f-b3a9-fe114df9677c-data-volume\") pod \"insights-runtime-extractor-bx9w7\" (UID: \"98f48786-bb87-492f-b3a9-fe114df9677c\") " pod="openshift-insights/insights-runtime-extractor-bx9w7" May 28 11:05:01.082697 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.082630 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnhwl\" (UniqueName: \"kubernetes.io/projected/87747eaa-7924-4337-b061-3808eae4b037-kube-api-access-cnhwl\") pod \"image-registry-865858fc96-5rkkp\" (UID: \"87747eaa-7924-4337-b061-3808eae4b037\") " pod="openshift-image-registry/image-registry-865858fc96-5rkkp" May 28 11:05:01.082697 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.082675 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87747eaa-7924-4337-b061-3808eae4b037-ca-trust-extracted\") pod \"image-registry-865858fc96-5rkkp\" (UID: \"87747eaa-7924-4337-b061-3808eae4b037\") " pod="openshift-image-registry/image-registry-865858fc96-5rkkp" May 28 11:05:01.082799 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.082701 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98f48786-bb87-492f-b3a9-fe114df9677c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bx9w7\" (UID: \"98f48786-bb87-492f-b3a9-fe114df9677c\") " pod="openshift-insights/insights-runtime-extractor-bx9w7" May 28 11:05:01.082799 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.082719 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87747eaa-7924-4337-b061-3808eae4b037-registry-certificates\") pod \"image-registry-865858fc96-5rkkp\" (UID: \"87747eaa-7924-4337-b061-3808eae4b037\") " pod="openshift-image-registry/image-registry-865858fc96-5rkkp" May 28 11:05:01.082799 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.082754 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87747eaa-7924-4337-b061-3808eae4b037-trusted-ca\") pod \"image-registry-865858fc96-5rkkp\" (UID: \"87747eaa-7924-4337-b061-3808eae4b037\") " pod="openshift-image-registry/image-registry-865858fc96-5rkkp" May 28 11:05:01.082799 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.082785 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98f48786-bb87-492f-b3a9-fe114df9677c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bx9w7\" (UID: \"98f48786-bb87-492f-b3a9-fe114df9677c\") " pod="openshift-insights/insights-runtime-extractor-bx9w7" May 28 11:05:01.082916 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.082804 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87747eaa-7924-4337-b061-3808eae4b037-installation-pull-secrets\") pod \"image-registry-865858fc96-5rkkp\" (UID: \"87747eaa-7924-4337-b061-3808eae4b037\") " pod="openshift-image-registry/image-registry-865858fc96-5rkkp" May 28 11:05:01.082916 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.082819 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/98f48786-bb87-492f-b3a9-fe114df9677c-crio-socket\") pod \"insights-runtime-extractor-bx9w7\" (UID: \"98f48786-bb87-492f-b3a9-fe114df9677c\") " pod="openshift-insights/insights-runtime-extractor-bx9w7" May 28 11:05:01.082916 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.082834 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87747eaa-7924-4337-b061-3808eae4b037-image-registry-private-configuration\") pod \"image-registry-865858fc96-5rkkp\" (UID: \"87747eaa-7924-4337-b061-3808eae4b037\") " pod="openshift-image-registry/image-registry-865858fc96-5rkkp" May 28 11:05:01.082916 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.082899 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xms8z\" (UniqueName: \"kubernetes.io/projected/98f48786-bb87-492f-b3a9-fe114df9677c-kube-api-access-xms8z\") pod \"insights-runtime-extractor-bx9w7\" (UID: \"98f48786-bb87-492f-b3a9-fe114df9677c\") " pod="openshift-insights/insights-runtime-extractor-bx9w7" May 28 11:05:01.083032 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.082920 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87747eaa-7924-4337-b061-3808eae4b037-registry-tls\") pod \"image-registry-865858fc96-5rkkp\" (UID: \"87747eaa-7924-4337-b061-3808eae4b037\") " pod="openshift-image-registry/image-registry-865858fc96-5rkkp" May 28 11:05:01.183658 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.183574 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87747eaa-7924-4337-b061-3808eae4b037-trusted-ca\") pod \"image-registry-865858fc96-5rkkp\" (UID: \"87747eaa-7924-4337-b061-3808eae4b037\") " pod="openshift-image-registry/image-registry-865858fc96-5rkkp" May 28 11:05:01.183658 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.183621 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98f48786-bb87-492f-b3a9-fe114df9677c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bx9w7\" (UID: \"98f48786-bb87-492f-b3a9-fe114df9677c\") " pod="openshift-insights/insights-runtime-extractor-bx9w7" May 28 11:05:01.183905 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.183880 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87747eaa-7924-4337-b061-3808eae4b037-installation-pull-secrets\") pod \"image-registry-865858fc96-5rkkp\" (UID: \"87747eaa-7924-4337-b061-3808eae4b037\") " pod="openshift-image-registry/image-registry-865858fc96-5rkkp" May 28 11:05:01.183968 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.183927 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/98f48786-bb87-492f-b3a9-fe114df9677c-crio-socket\") pod \"insights-runtime-extractor-bx9w7\" (UID: \"98f48786-bb87-492f-b3a9-fe114df9677c\") " pod="openshift-insights/insights-runtime-extractor-bx9w7" May 28 11:05:01.183968 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.183958 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87747eaa-7924-4337-b061-3808eae4b037-image-registry-private-configuration\") pod \"image-registry-865858fc96-5rkkp\" (UID: \"87747eaa-7924-4337-b061-3808eae4b037\") " pod="openshift-image-registry/image-registry-865858fc96-5rkkp" May 28 11:05:01.184092 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.184019 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xms8z\" (UniqueName: \"kubernetes.io/projected/98f48786-bb87-492f-b3a9-fe114df9677c-kube-api-access-xms8z\") pod \"insights-runtime-extractor-bx9w7\" (UID: \"98f48786-bb87-492f-b3a9-fe114df9677c\") " pod="openshift-insights/insights-runtime-extractor-bx9w7" May 28 11:05:01.184092 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.184043 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/98f48786-bb87-492f-b3a9-fe114df9677c-crio-socket\") pod \"insights-runtime-extractor-bx9w7\" (UID: \"98f48786-bb87-492f-b3a9-fe114df9677c\") " pod="openshift-insights/insights-runtime-extractor-bx9w7" May 28 11:05:01.184092 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.184047 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87747eaa-7924-4337-b061-3808eae4b037-registry-tls\") pod \"image-registry-865858fc96-5rkkp\" (UID: \"87747eaa-7924-4337-b061-3808eae4b037\") " pod="openshift-image-registry/image-registry-865858fc96-5rkkp" May 28 11:05:01.184248 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.184113 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87747eaa-7924-4337-b061-3808eae4b037-bound-sa-token\") pod \"image-registry-865858fc96-5rkkp\" (UID: \"87747eaa-7924-4337-b061-3808eae4b037\") " pod="openshift-image-registry/image-registry-865858fc96-5rkkp" May 28 11:05:01.184248 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.184171 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/98f48786-bb87-492f-b3a9-fe114df9677c-data-volume\") pod \"insights-runtime-extractor-bx9w7\" (UID: \"98f48786-bb87-492f-b3a9-fe114df9677c\") " pod="openshift-insights/insights-runtime-extractor-bx9w7" May 28 11:05:01.184248 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.184214 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cnhwl\" (UniqueName: \"kubernetes.io/projected/87747eaa-7924-4337-b061-3808eae4b037-kube-api-access-cnhwl\") pod \"image-registry-865858fc96-5rkkp\" (UID: \"87747eaa-7924-4337-b061-3808eae4b037\") " pod="openshift-image-registry/image-registry-865858fc96-5rkkp" May 28 11:05:01.184248 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.184245 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87747eaa-7924-4337-b061-3808eae4b037-ca-trust-extracted\") pod \"image-registry-865858fc96-5rkkp\" (UID: \"87747eaa-7924-4337-b061-3808eae4b037\") " pod="openshift-image-registry/image-registry-865858fc96-5rkkp" May 28 11:05:01.184437 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.184273 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98f48786-bb87-492f-b3a9-fe114df9677c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bx9w7\" (UID: \"98f48786-bb87-492f-b3a9-fe114df9677c\") " pod="openshift-insights/insights-runtime-extractor-bx9w7" May 28 11:05:01.184437 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.184288 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98f48786-bb87-492f-b3a9-fe114df9677c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bx9w7\" (UID: \"98f48786-bb87-492f-b3a9-fe114df9677c\") " pod="openshift-insights/insights-runtime-extractor-bx9w7" May 28 11:05:01.184437 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.184299 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87747eaa-7924-4337-b061-3808eae4b037-registry-certificates\") pod \"image-registry-865858fc96-5rkkp\" (UID: \"87747eaa-7924-4337-b061-3808eae4b037\") " pod="openshift-image-registry/image-registry-865858fc96-5rkkp" May 28 11:05:01.184812 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.184722 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/87747eaa-7924-4337-b061-3808eae4b037-ca-trust-extracted\") pod \"image-registry-865858fc96-5rkkp\" (UID: \"87747eaa-7924-4337-b061-3808eae4b037\") " pod="openshift-image-registry/image-registry-865858fc96-5rkkp" May 28 11:05:01.184812 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.184774 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/87747eaa-7924-4337-b061-3808eae4b037-trusted-ca\") pod \"image-registry-865858fc96-5rkkp\" (UID: \"87747eaa-7924-4337-b061-3808eae4b037\") " pod="openshift-image-registry/image-registry-865858fc96-5rkkp" May 28 11:05:01.185097 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.185055 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/98f48786-bb87-492f-b3a9-fe114df9677c-data-volume\") pod \"insights-runtime-extractor-bx9w7\" (UID: \"98f48786-bb87-492f-b3a9-fe114df9677c\") " pod="openshift-insights/insights-runtime-extractor-bx9w7" May 28 11:05:01.185163 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.185114 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/87747eaa-7924-4337-b061-3808eae4b037-registry-certificates\") pod \"image-registry-865858fc96-5rkkp\" (UID: \"87747eaa-7924-4337-b061-3808eae4b037\") " pod="openshift-image-registry/image-registry-865858fc96-5rkkp" May 28 11:05:01.186442 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.186421 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/87747eaa-7924-4337-b061-3808eae4b037-installation-pull-secrets\") pod \"image-registry-865858fc96-5rkkp\" (UID: \"87747eaa-7924-4337-b061-3808eae4b037\") " pod="openshift-image-registry/image-registry-865858fc96-5rkkp" May 28 11:05:01.186509 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.186455 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/87747eaa-7924-4337-b061-3808eae4b037-image-registry-private-configuration\") pod \"image-registry-865858fc96-5rkkp\" (UID: \"87747eaa-7924-4337-b061-3808eae4b037\") " pod="openshift-image-registry/image-registry-865858fc96-5rkkp" May 28 11:05:01.186940 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.186915 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/87747eaa-7924-4337-b061-3808eae4b037-registry-tls\") pod \"image-registry-865858fc96-5rkkp\" (UID: \"87747eaa-7924-4337-b061-3808eae4b037\") " pod="openshift-image-registry/image-registry-865858fc96-5rkkp" May 28 11:05:01.187013 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.186985 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98f48786-bb87-492f-b3a9-fe114df9677c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bx9w7\" (UID: \"98f48786-bb87-492f-b3a9-fe114df9677c\") " pod="openshift-insights/insights-runtime-extractor-bx9w7" May 28 11:05:01.193906 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.193876 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87747eaa-7924-4337-b061-3808eae4b037-bound-sa-token\") pod \"image-registry-865858fc96-5rkkp\" (UID: \"87747eaa-7924-4337-b061-3808eae4b037\") " pod="openshift-image-registry/image-registry-865858fc96-5rkkp" May 28 11:05:01.193992 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.193954 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xms8z\" (UniqueName: \"kubernetes.io/projected/98f48786-bb87-492f-b3a9-fe114df9677c-kube-api-access-xms8z\") pod \"insights-runtime-extractor-bx9w7\" (UID: \"98f48786-bb87-492f-b3a9-fe114df9677c\") " pod="openshift-insights/insights-runtime-extractor-bx9w7" May 28 11:05:01.194168 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.194153 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnhwl\" (UniqueName: \"kubernetes.io/projected/87747eaa-7924-4337-b061-3808eae4b037-kube-api-access-cnhwl\") pod \"image-registry-865858fc96-5rkkp\" (UID: \"87747eaa-7924-4337-b061-3808eae4b037\") " pod="openshift-image-registry/image-registry-865858fc96-5rkkp" May 28 11:05:01.238083 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.238048 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bx9w7" May 28 11:05:01.251816 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.251798 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-865858fc96-5rkkp" May 28 11:05:01.363707 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.363675 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bx9w7"] May 28 11:05:01.366631 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:05:01.366603 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98f48786_bb87_492f_b3a9_fe114df9677c.slice/crio-cecb7d273403833b640b9dc7948fcb3b43214d124c98805bcd816356de7ba33d WatchSource:0}: Error finding container cecb7d273403833b640b9dc7948fcb3b43214d124c98805bcd816356de7ba33d: Status 404 returned error can't find the container with id cecb7d273403833b640b9dc7948fcb3b43214d124c98805bcd816356de7ba33d May 28 11:05:01.381791 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.381765 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-865858fc96-5rkkp"] May 28 11:05:01.391991 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:05:01.391962 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87747eaa_7924_4337_b061_3808eae4b037.slice/crio-f5965bd9861c2a6232225bb3012123c03525cda75cf656ba074778f889c6f7f5 WatchSource:0}: Error finding container f5965bd9861c2a6232225bb3012123c03525cda75cf656ba074778f889c6f7f5: Status 404 returned error can't find the container with id f5965bd9861c2a6232225bb3012123c03525cda75cf656ba074778f889c6f7f5 May 28 11:05:01.740214 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.740122 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-865858fc96-5rkkp" event={"ID":"87747eaa-7924-4337-b061-3808eae4b037","Type":"ContainerStarted","Data":"b813201a7f5b262064642cb396752d5e618a69c512af35a28ef1905724729ae2"} May 28 11:05:01.740214 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.740166 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-865858fc96-5rkkp" event={"ID":"87747eaa-7924-4337-b061-3808eae4b037","Type":"ContainerStarted","Data":"f5965bd9861c2a6232225bb3012123c03525cda75cf656ba074778f889c6f7f5"} May 28 11:05:01.740420 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.740227 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-865858fc96-5rkkp" May 28 11:05:01.741430 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.741406 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bx9w7" event={"ID":"98f48786-bb87-492f-b3a9-fe114df9677c","Type":"ContainerStarted","Data":"ac73261c728c7c2894f7223a29c22af6a845b81b4e453e68f69f607562013b59"} May 28 11:05:01.741525 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.741435 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bx9w7" event={"ID":"98f48786-bb87-492f-b3a9-fe114df9677c","Type":"ContainerStarted","Data":"cecb7d273403833b640b9dc7948fcb3b43214d124c98805bcd816356de7ba33d"} May 28 11:05:01.760138 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:01.760090 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-865858fc96-5rkkp" podStartSLOduration=1.7600514120000001 podStartE2EDuration="1.760051412s" podCreationTimestamp="2026-05-28 11:05:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 11:05:01.758928427 +0000 UTC m=+120.000588331" watchObservedRunningTime="2026-05-28 11:05:01.760051412 +0000 UTC m=+120.001711305" May 28 11:05:02.745735 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:02.745696 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bx9w7" event={"ID":"98f48786-bb87-492f-b3a9-fe114df9677c","Type":"ContainerStarted","Data":"af80cde558523a08636c35649404c0882a11001048bc7eaf4c00f6f4fca94381"} May 28 11:05:04.753677 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:04.753636 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bx9w7" event={"ID":"98f48786-bb87-492f-b3a9-fe114df9677c","Type":"ContainerStarted","Data":"9b094d722ada414537269217dcfbcbe658ec7b7fb4f3871950a97fcbfd41bf46"} May 28 11:05:04.770635 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:04.770588 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bx9w7" podStartSLOduration=2.499299529 podStartE2EDuration="4.770575184s" podCreationTimestamp="2026-05-28 11:05:00 +0000 UTC" firstStartedPulling="2026-05-28 11:05:01.430683797 +0000 UTC m=+119.672343669" lastFinishedPulling="2026-05-28 11:05:03.701959454 +0000 UTC m=+121.943619324" observedRunningTime="2026-05-28 11:05:04.770468006 +0000 UTC m=+123.012127900" watchObservedRunningTime="2026-05-28 11:05:04.770575184 +0000 UTC m=+123.012235075" May 28 11:05:12.064552 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:12.064501 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/651502be-d3a5-4259-a6be-3282eda430db-metrics-certs\") pod \"network-metrics-daemon-k5dvc\" (UID: \"651502be-d3a5-4259-a6be-3282eda430db\") " pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:05:12.066716 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:12.066684 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/651502be-d3a5-4259-a6be-3282eda430db-metrics-certs\") pod \"network-metrics-daemon-k5dvc\" (UID: \"651502be-d3a5-4259-a6be-3282eda430db\") " pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:05:12.168419 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:12.168392 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nncjx\"" May 28 11:05:12.175617 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:12.175597 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-k5dvc" May 28 11:05:12.299383 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:12.299361 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-k5dvc"] May 28 11:05:12.301712 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:05:12.301681 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod651502be_d3a5_4259_a6be_3282eda430db.slice/crio-305a5f17e178815dbb1b45a499f0d17f4d7bd02c7e32ceed9be0c09d9a41665a WatchSource:0}: Error finding container 305a5f17e178815dbb1b45a499f0d17f4d7bd02c7e32ceed9be0c09d9a41665a: Status 404 returned error can't find the container with id 305a5f17e178815dbb1b45a499f0d17f4d7bd02c7e32ceed9be0c09d9a41665a May 28 11:05:12.774224 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:12.774187 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k5dvc" event={"ID":"651502be-d3a5-4259-a6be-3282eda430db","Type":"ContainerStarted","Data":"305a5f17e178815dbb1b45a499f0d17f4d7bd02c7e32ceed9be0c09d9a41665a"} May 28 11:05:13.591293 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:13.591204 2551 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" podUID="73034887-1ade-4f40-9b98-f7b47c2771c4" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 28 11:05:13.778343 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:13.778312 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k5dvc" event={"ID":"651502be-d3a5-4259-a6be-3282eda430db","Type":"ContainerStarted","Data":"ec86b519ea0cad872ee49d1fb61d20576fca239608a9eba094e7844025eaec39"} May 28 11:05:13.778343 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:13.778348 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-k5dvc" event={"ID":"651502be-d3a5-4259-a6be-3282eda430db","Type":"ContainerStarted","Data":"10d7296ec7710b6aed179c59d711654fe758365395a21147e82569fb100cd747"} May 28 11:05:13.794936 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:13.794890 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-k5dvc" podStartSLOduration=130.820880311 podStartE2EDuration="2m11.794878136s" podCreationTimestamp="2026-05-28 11:03:02 +0000 UTC" firstStartedPulling="2026-05-28 11:05:12.303593848 +0000 UTC m=+130.545253718" lastFinishedPulling="2026-05-28 11:05:13.277591674 +0000 UTC m=+131.519251543" observedRunningTime="2026-05-28 11:05:13.793907582 +0000 UTC m=+132.035567475" watchObservedRunningTime="2026-05-28 11:05:13.794878136 +0000 UTC m=+132.036538023" May 28 11:05:15.841819 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.841781 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-ckpdn"] May 28 11:05:15.846526 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.846493 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4q9t4"] May 28 11:05:15.847048 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.847023 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ckpdn" May 28 11:05:15.849231 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.849211 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4q9t4" May 28 11:05:15.851113 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.851094 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" May 28 11:05:15.851660 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.851634 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 28 11:05:15.851758 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.851688 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" May 28 11:05:15.851758 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.851696 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 28 11:05:15.851758 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.851698 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4w7jl\"" May 28 11:05:15.851758 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.851745 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 28 11:05:15.851936 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.851783 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 28 11:05:15.851982 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.851951 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-xm5s8\"" May 28 11:05:15.852093 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.852078 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 28 11:05:15.852780 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.852758 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" May 28 11:05:15.852863 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.852788 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 28 11:05:15.856888 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.856862 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-ckpdn"] May 28 11:05:15.995189 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.995160 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c813f946-77a5-495a-b9fc-d2561ae25f56-root\") pod \"node-exporter-4q9t4\" (UID: \"c813f946-77a5-495a-b9fc-d2561ae25f56\") " pod="openshift-monitoring/node-exporter-4q9t4" May 28 11:05:15.995189 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.995189 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c813f946-77a5-495a-b9fc-d2561ae25f56-node-exporter-wtmp\") pod \"node-exporter-4q9t4\" (UID: \"c813f946-77a5-495a-b9fc-d2561ae25f56\") " pod="openshift-monitoring/node-exporter-4q9t4" May 28 11:05:15.995371 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.995208 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c813f946-77a5-495a-b9fc-d2561ae25f56-node-exporter-accelerators-collector-config\") pod \"node-exporter-4q9t4\" (UID: \"c813f946-77a5-495a-b9fc-d2561ae25f56\") " pod="openshift-monitoring/node-exporter-4q9t4" May 28 11:05:15.995371 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.995282 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c813f946-77a5-495a-b9fc-d2561ae25f56-metrics-client-ca\") pod \"node-exporter-4q9t4\" (UID: \"c813f946-77a5-495a-b9fc-d2561ae25f56\") " pod="openshift-monitoring/node-exporter-4q9t4" May 28 11:05:15.995371 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.995304 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c813f946-77a5-495a-b9fc-d2561ae25f56-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4q9t4\" (UID: \"c813f946-77a5-495a-b9fc-d2561ae25f56\") " pod="openshift-monitoring/node-exporter-4q9t4" May 28 11:05:15.995371 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.995323 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8d9f255-d921-4f5f-8206-a936c35d7701-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-ckpdn\" (UID: \"f8d9f255-d921-4f5f-8206-a936c35d7701\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ckpdn" May 28 11:05:15.995491 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.995368 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8d9f255-d921-4f5f-8206-a936c35d7701-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-ckpdn\" (UID: \"f8d9f255-d921-4f5f-8206-a936c35d7701\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ckpdn" May 28 11:05:15.995491 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.995396 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c813f946-77a5-495a-b9fc-d2561ae25f56-node-exporter-tls\") pod \"node-exporter-4q9t4\" (UID: \"c813f946-77a5-495a-b9fc-d2561ae25f56\") " pod="openshift-monitoring/node-exporter-4q9t4" May 28 11:05:15.995491 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.995422 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f8d9f255-d921-4f5f-8206-a936c35d7701-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-ckpdn\" (UID: \"f8d9f255-d921-4f5f-8206-a936c35d7701\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ckpdn" May 28 11:05:15.995491 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.995455 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c813f946-77a5-495a-b9fc-d2561ae25f56-node-exporter-textfile\") pod \"node-exporter-4q9t4\" (UID: \"c813f946-77a5-495a-b9fc-d2561ae25f56\") " pod="openshift-monitoring/node-exporter-4q9t4" May 28 11:05:15.995491 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.995478 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jmr8\" (UniqueName: \"kubernetes.io/projected/c813f946-77a5-495a-b9fc-d2561ae25f56-kube-api-access-2jmr8\") pod \"node-exporter-4q9t4\" (UID: \"c813f946-77a5-495a-b9fc-d2561ae25f56\") " pod="openshift-monitoring/node-exporter-4q9t4" May 28 11:05:15.995636 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.995510 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c813f946-77a5-495a-b9fc-d2561ae25f56-sys\") pod \"node-exporter-4q9t4\" (UID: \"c813f946-77a5-495a-b9fc-d2561ae25f56\") " pod="openshift-monitoring/node-exporter-4q9t4" May 28 11:05:15.995636 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.995560 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f8d9f255-d921-4f5f-8206-a936c35d7701-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-ckpdn\" (UID: \"f8d9f255-d921-4f5f-8206-a936c35d7701\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ckpdn" May 28 11:05:15.995636 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.995587 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8d9f255-d921-4f5f-8206-a936c35d7701-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-ckpdn\" (UID: \"f8d9f255-d921-4f5f-8206-a936c35d7701\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ckpdn" May 28 11:05:15.995636 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:15.995604 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmw4l\" (UniqueName: \"kubernetes.io/projected/f8d9f255-d921-4f5f-8206-a936c35d7701-kube-api-access-fmw4l\") pod \"kube-state-metrics-54fd6bc5c4-ckpdn\" (UID: \"f8d9f255-d921-4f5f-8206-a936c35d7701\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ckpdn" May 28 11:05:16.096506 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.096414 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2jmr8\" (UniqueName: \"kubernetes.io/projected/c813f946-77a5-495a-b9fc-d2561ae25f56-kube-api-access-2jmr8\") pod \"node-exporter-4q9t4\" (UID: \"c813f946-77a5-495a-b9fc-d2561ae25f56\") " pod="openshift-monitoring/node-exporter-4q9t4" May 28 11:05:16.096506 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.096458 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c813f946-77a5-495a-b9fc-d2561ae25f56-sys\") pod \"node-exporter-4q9t4\" (UID: \"c813f946-77a5-495a-b9fc-d2561ae25f56\") " pod="openshift-monitoring/node-exporter-4q9t4" May 28 11:05:16.096506 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.096492 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f8d9f255-d921-4f5f-8206-a936c35d7701-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-ckpdn\" (UID: \"f8d9f255-d921-4f5f-8206-a936c35d7701\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ckpdn" May 28 11:05:16.096759 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.096520 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8d9f255-d921-4f5f-8206-a936c35d7701-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-ckpdn\" (UID: \"f8d9f255-d921-4f5f-8206-a936c35d7701\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ckpdn" May 28 11:05:16.096759 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.096537 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fmw4l\" (UniqueName: \"kubernetes.io/projected/f8d9f255-d921-4f5f-8206-a936c35d7701-kube-api-access-fmw4l\") pod \"kube-state-metrics-54fd6bc5c4-ckpdn\" (UID: \"f8d9f255-d921-4f5f-8206-a936c35d7701\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ckpdn" May 28 11:05:16.096759 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.096559 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c813f946-77a5-495a-b9fc-d2561ae25f56-root\") pod \"node-exporter-4q9t4\" (UID: \"c813f946-77a5-495a-b9fc-d2561ae25f56\") " pod="openshift-monitoring/node-exporter-4q9t4" May 28 11:05:16.096759 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.096616 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c813f946-77a5-495a-b9fc-d2561ae25f56-node-exporter-wtmp\") pod \"node-exporter-4q9t4\" (UID: \"c813f946-77a5-495a-b9fc-d2561ae25f56\") " pod="openshift-monitoring/node-exporter-4q9t4" May 28 11:05:16.096759 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.096632 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c813f946-77a5-495a-b9fc-d2561ae25f56-sys\") pod \"node-exporter-4q9t4\" (UID: \"c813f946-77a5-495a-b9fc-d2561ae25f56\") " pod="openshift-monitoring/node-exporter-4q9t4" May 28 11:05:16.096759 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:05:16.096647 2551 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found May 28 11:05:16.096759 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.096651 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c813f946-77a5-495a-b9fc-d2561ae25f56-node-exporter-accelerators-collector-config\") pod \"node-exporter-4q9t4\" (UID: \"c813f946-77a5-495a-b9fc-d2561ae25f56\") " pod="openshift-monitoring/node-exporter-4q9t4" May 28 11:05:16.096759 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:05:16.096701 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8d9f255-d921-4f5f-8206-a936c35d7701-kube-state-metrics-tls podName:f8d9f255-d921-4f5f-8206-a936c35d7701 nodeName:}" failed. No retries permitted until 2026-05-28 11:05:16.596684849 +0000 UTC m=+134.838344720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f8d9f255-d921-4f5f-8206-a936c35d7701-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-ckpdn" (UID: "f8d9f255-d921-4f5f-8206-a936c35d7701") : secret "kube-state-metrics-tls" not found May 28 11:05:16.096759 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.096720 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c813f946-77a5-495a-b9fc-d2561ae25f56-root\") pod \"node-exporter-4q9t4\" (UID: \"c813f946-77a5-495a-b9fc-d2561ae25f56\") " pod="openshift-monitoring/node-exporter-4q9t4" May 28 11:05:16.096759 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.096722 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c813f946-77a5-495a-b9fc-d2561ae25f56-metrics-client-ca\") pod \"node-exporter-4q9t4\" (UID: \"c813f946-77a5-495a-b9fc-d2561ae25f56\") " pod="openshift-monitoring/node-exporter-4q9t4" May 28 11:05:16.097282 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.096767 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c813f946-77a5-495a-b9fc-d2561ae25f56-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4q9t4\" (UID: \"c813f946-77a5-495a-b9fc-d2561ae25f56\") " pod="openshift-monitoring/node-exporter-4q9t4" May 28 11:05:16.097282 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.096780 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c813f946-77a5-495a-b9fc-d2561ae25f56-node-exporter-wtmp\") pod \"node-exporter-4q9t4\" (UID: \"c813f946-77a5-495a-b9fc-d2561ae25f56\") " pod="openshift-monitoring/node-exporter-4q9t4" May 28 11:05:16.097282 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.096799 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8d9f255-d921-4f5f-8206-a936c35d7701-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-ckpdn\" (UID: \"f8d9f255-d921-4f5f-8206-a936c35d7701\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ckpdn" May 28 11:05:16.097282 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.096834 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8d9f255-d921-4f5f-8206-a936c35d7701-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-ckpdn\" (UID: \"f8d9f255-d921-4f5f-8206-a936c35d7701\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ckpdn" May 28 11:05:16.097282 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.096860 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c813f946-77a5-495a-b9fc-d2561ae25f56-node-exporter-tls\") pod \"node-exporter-4q9t4\" (UID: \"c813f946-77a5-495a-b9fc-d2561ae25f56\") " pod="openshift-monitoring/node-exporter-4q9t4" May 28 11:05:16.097282 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.096890 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f8d9f255-d921-4f5f-8206-a936c35d7701-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-ckpdn\" (UID: \"f8d9f255-d921-4f5f-8206-a936c35d7701\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ckpdn" May 28 11:05:16.097282 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.096924 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c813f946-77a5-495a-b9fc-d2561ae25f56-node-exporter-textfile\") pod \"node-exporter-4q9t4\" (UID: \"c813f946-77a5-495a-b9fc-d2561ae25f56\") " pod="openshift-monitoring/node-exporter-4q9t4" May 28 11:05:16.097282 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.096942 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f8d9f255-d921-4f5f-8206-a936c35d7701-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-ckpdn\" (UID: \"f8d9f255-d921-4f5f-8206-a936c35d7701\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ckpdn" May 28 11:05:16.097674 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.097351 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c813f946-77a5-495a-b9fc-d2561ae25f56-metrics-client-ca\") pod \"node-exporter-4q9t4\" (UID: \"c813f946-77a5-495a-b9fc-d2561ae25f56\") " pod="openshift-monitoring/node-exporter-4q9t4" May 28 11:05:16.097674 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.097365 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c813f946-77a5-495a-b9fc-d2561ae25f56-node-exporter-accelerators-collector-config\") pod \"node-exporter-4q9t4\" (UID: \"c813f946-77a5-495a-b9fc-d2561ae25f56\") " pod="openshift-monitoring/node-exporter-4q9t4" May 28 11:05:16.097674 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.097540 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8d9f255-d921-4f5f-8206-a936c35d7701-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-ckpdn\" (UID: \"f8d9f255-d921-4f5f-8206-a936c35d7701\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ckpdn" May 28 11:05:16.097674 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.097571 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f8d9f255-d921-4f5f-8206-a936c35d7701-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-ckpdn\" (UID: \"f8d9f255-d921-4f5f-8206-a936c35d7701\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ckpdn" May 28 11:05:16.097674 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.097643 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c813f946-77a5-495a-b9fc-d2561ae25f56-node-exporter-textfile\") pod \"node-exporter-4q9t4\" (UID: \"c813f946-77a5-495a-b9fc-d2561ae25f56\") " pod="openshift-monitoring/node-exporter-4q9t4" May 28 11:05:16.099138 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.099117 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c813f946-77a5-495a-b9fc-d2561ae25f56-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4q9t4\" (UID: \"c813f946-77a5-495a-b9fc-d2561ae25f56\") " pod="openshift-monitoring/node-exporter-4q9t4" May 28 11:05:16.099256 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.099206 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c813f946-77a5-495a-b9fc-d2561ae25f56-node-exporter-tls\") pod \"node-exporter-4q9t4\" (UID: \"c813f946-77a5-495a-b9fc-d2561ae25f56\") " pod="openshift-monitoring/node-exporter-4q9t4" May 28 11:05:16.099412 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.099393 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f8d9f255-d921-4f5f-8206-a936c35d7701-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-ckpdn\" (UID: \"f8d9f255-d921-4f5f-8206-a936c35d7701\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ckpdn" May 28 11:05:16.108350 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.108333 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jmr8\" (UniqueName: \"kubernetes.io/projected/c813f946-77a5-495a-b9fc-d2561ae25f56-kube-api-access-2jmr8\") pod \"node-exporter-4q9t4\" (UID: \"c813f946-77a5-495a-b9fc-d2561ae25f56\") " pod="openshift-monitoring/node-exporter-4q9t4" May 28 11:05:16.108889 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.108874 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmw4l\" (UniqueName: \"kubernetes.io/projected/f8d9f255-d921-4f5f-8206-a936c35d7701-kube-api-access-fmw4l\") pod \"kube-state-metrics-54fd6bc5c4-ckpdn\" (UID: \"f8d9f255-d921-4f5f-8206-a936c35d7701\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ckpdn" May 28 11:05:16.164102 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.164077 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4q9t4" May 28 11:05:16.171201 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:05:16.171175 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc813f946_77a5_495a_b9fc_d2561ae25f56.slice/crio-a0b2804cef3bea23da4b783729e2ceca5a98a85e3d9d65cab023e1090dc504a1 WatchSource:0}: Error finding container a0b2804cef3bea23da4b783729e2ceca5a98a85e3d9d65cab023e1090dc504a1: Status 404 returned error can't find the container with id a0b2804cef3bea23da4b783729e2ceca5a98a85e3d9d65cab023e1090dc504a1 May 28 11:05:16.599997 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.599962 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8d9f255-d921-4f5f-8206-a936c35d7701-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-ckpdn\" (UID: \"f8d9f255-d921-4f5f-8206-a936c35d7701\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ckpdn" May 28 11:05:16.600176 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:05:16.600086 2551 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found May 28 11:05:16.600176 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:05:16.600140 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8d9f255-d921-4f5f-8206-a936c35d7701-kube-state-metrics-tls podName:f8d9f255-d921-4f5f-8206-a936c35d7701 nodeName:}" failed. No retries permitted until 2026-05-28 11:05:17.600125815 +0000 UTC m=+135.841785685 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f8d9f255-d921-4f5f-8206-a936c35d7701-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-ckpdn" (UID: "f8d9f255-d921-4f5f-8206-a936c35d7701") : secret "kube-state-metrics-tls" not found May 28 11:05:16.787025 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:16.786983 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4q9t4" event={"ID":"c813f946-77a5-495a-b9fc-d2561ae25f56","Type":"ContainerStarted","Data":"a0b2804cef3bea23da4b783729e2ceca5a98a85e3d9d65cab023e1090dc504a1"} May 28 11:05:17.607571 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:17.607536 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8d9f255-d921-4f5f-8206-a936c35d7701-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-ckpdn\" (UID: \"f8d9f255-d921-4f5f-8206-a936c35d7701\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ckpdn" May 28 11:05:17.609782 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:17.609763 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f8d9f255-d921-4f5f-8206-a936c35d7701-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-ckpdn\" (UID: \"f8d9f255-d921-4f5f-8206-a936c35d7701\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ckpdn" May 28 11:05:17.658330 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:17.658305 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ckpdn" May 28 11:05:17.778819 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:17.778788 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-ckpdn"] May 28 11:05:17.780938 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:05:17.780914 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8d9f255_d921_4f5f_8206_a936c35d7701.slice/crio-67f1d8d4ea016a4f3b4fa6daf4140432620fd78df823b20f707aef1855e1e403 WatchSource:0}: Error finding container 67f1d8d4ea016a4f3b4fa6daf4140432620fd78df823b20f707aef1855e1e403: Status 404 returned error can't find the container with id 67f1d8d4ea016a4f3b4fa6daf4140432620fd78df823b20f707aef1855e1e403 May 28 11:05:17.790697 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:17.790672 2551 generic.go:358] "Generic (PLEG): container finished" podID="c813f946-77a5-495a-b9fc-d2561ae25f56" containerID="fb8be5418f476f0f6ee21d5b8ffeb71a50ced7c6d4c495be7f9361f9f59c5213" exitCode=0 May 28 11:05:17.790796 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:17.790754 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4q9t4" event={"ID":"c813f946-77a5-495a-b9fc-d2561ae25f56","Type":"ContainerDied","Data":"fb8be5418f476f0f6ee21d5b8ffeb71a50ced7c6d4c495be7f9361f9f59c5213"} May 28 11:05:17.791643 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:17.791625 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ckpdn" event={"ID":"f8d9f255-d921-4f5f-8206-a936c35d7701","Type":"ContainerStarted","Data":"67f1d8d4ea016a4f3b4fa6daf4140432620fd78df823b20f707aef1855e1e403"} May 28 11:05:17.917209 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:17.917179 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw"] May 28 11:05:17.919608 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:17.919589 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" May 28 11:05:17.923492 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:17.923474 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" May 28 11:05:17.923603 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:17.923490 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2hca284tf0k1l\"" May 28 11:05:17.923603 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:17.923490 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" May 28 11:05:17.923708 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:17.923656 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" May 28 11:05:17.923708 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:17.923687 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" May 28 11:05:17.923961 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:17.923936 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" May 28 11:05:17.924095 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:17.923961 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-zm9sc\"" May 28 11:05:17.930407 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:17.930386 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw"] May 28 11:05:18.011415 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:18.011383 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0a64a45c-25e3-42c1-b1e0-36a55fee8e70-secret-thanos-querier-tls\") pod \"thanos-querier-679cb7bfbc-hd7zw\" (UID: \"0a64a45c-25e3-42c1-b1e0-36a55fee8e70\") " pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" May 28 11:05:18.011415 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:18.011416 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtlt9\" (UniqueName: \"kubernetes.io/projected/0a64a45c-25e3-42c1-b1e0-36a55fee8e70-kube-api-access-rtlt9\") pod \"thanos-querier-679cb7bfbc-hd7zw\" (UID: \"0a64a45c-25e3-42c1-b1e0-36a55fee8e70\") " pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" May 28 11:05:18.011593 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:18.011445 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0a64a45c-25e3-42c1-b1e0-36a55fee8e70-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-679cb7bfbc-hd7zw\" (UID: \"0a64a45c-25e3-42c1-b1e0-36a55fee8e70\") " pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" May 28 11:05:18.011593 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:18.011467 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0a64a45c-25e3-42c1-b1e0-36a55fee8e70-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-679cb7bfbc-hd7zw\" (UID: \"0a64a45c-25e3-42c1-b1e0-36a55fee8e70\") " pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" May 28 11:05:18.011593 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:18.011516 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a64a45c-25e3-42c1-b1e0-36a55fee8e70-metrics-client-ca\") pod \"thanos-querier-679cb7bfbc-hd7zw\" (UID: \"0a64a45c-25e3-42c1-b1e0-36a55fee8e70\") " pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" May 28 11:05:18.011593 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:18.011546 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a64a45c-25e3-42c1-b1e0-36a55fee8e70-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-679cb7bfbc-hd7zw\" (UID: \"0a64a45c-25e3-42c1-b1e0-36a55fee8e70\") " pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" May 28 11:05:18.011593 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:18.011579 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a64a45c-25e3-42c1-b1e0-36a55fee8e70-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-679cb7bfbc-hd7zw\" (UID: \"0a64a45c-25e3-42c1-b1e0-36a55fee8e70\") " pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" May 28 11:05:18.011745 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:18.011596 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0a64a45c-25e3-42c1-b1e0-36a55fee8e70-secret-grpc-tls\") pod \"thanos-querier-679cb7bfbc-hd7zw\" (UID: \"0a64a45c-25e3-42c1-b1e0-36a55fee8e70\") " pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" May 28 11:05:18.112371 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:18.112345 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0a64a45c-25e3-42c1-b1e0-36a55fee8e70-secret-thanos-querier-tls\") pod \"thanos-querier-679cb7bfbc-hd7zw\" (UID: \"0a64a45c-25e3-42c1-b1e0-36a55fee8e70\") " pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" May 28 11:05:18.112371 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:18.112373 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rtlt9\" (UniqueName: \"kubernetes.io/projected/0a64a45c-25e3-42c1-b1e0-36a55fee8e70-kube-api-access-rtlt9\") pod \"thanos-querier-679cb7bfbc-hd7zw\" (UID: \"0a64a45c-25e3-42c1-b1e0-36a55fee8e70\") " pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" May 28 11:05:18.112610 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:18.112399 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0a64a45c-25e3-42c1-b1e0-36a55fee8e70-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-679cb7bfbc-hd7zw\" (UID: \"0a64a45c-25e3-42c1-b1e0-36a55fee8e70\") " pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" May 28 11:05:18.112610 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:18.112452 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0a64a45c-25e3-42c1-b1e0-36a55fee8e70-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-679cb7bfbc-hd7zw\" (UID: \"0a64a45c-25e3-42c1-b1e0-36a55fee8e70\") " pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" May 28 11:05:18.112610 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:18.112487 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a64a45c-25e3-42c1-b1e0-36a55fee8e70-metrics-client-ca\") pod \"thanos-querier-679cb7bfbc-hd7zw\" (UID: \"0a64a45c-25e3-42c1-b1e0-36a55fee8e70\") " pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" May 28 11:05:18.112610 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:18.112557 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a64a45c-25e3-42c1-b1e0-36a55fee8e70-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-679cb7bfbc-hd7zw\" (UID: \"0a64a45c-25e3-42c1-b1e0-36a55fee8e70\") " pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" May 28 11:05:18.112610 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:18.112608 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a64a45c-25e3-42c1-b1e0-36a55fee8e70-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-679cb7bfbc-hd7zw\" (UID: \"0a64a45c-25e3-42c1-b1e0-36a55fee8e70\") " pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" May 28 11:05:18.112866 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:18.112720 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0a64a45c-25e3-42c1-b1e0-36a55fee8e70-secret-grpc-tls\") pod \"thanos-querier-679cb7bfbc-hd7zw\" (UID: \"0a64a45c-25e3-42c1-b1e0-36a55fee8e70\") " pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" May 28 11:05:18.113353 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:18.113306 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0a64a45c-25e3-42c1-b1e0-36a55fee8e70-metrics-client-ca\") pod \"thanos-querier-679cb7bfbc-hd7zw\" (UID: \"0a64a45c-25e3-42c1-b1e0-36a55fee8e70\") " pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" May 28 11:05:18.114900 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:18.114872 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0a64a45c-25e3-42c1-b1e0-36a55fee8e70-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-679cb7bfbc-hd7zw\" (UID: \"0a64a45c-25e3-42c1-b1e0-36a55fee8e70\") " pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" May 28 11:05:18.115442 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:18.114987 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0a64a45c-25e3-42c1-b1e0-36a55fee8e70-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-679cb7bfbc-hd7zw\" (UID: \"0a64a45c-25e3-42c1-b1e0-36a55fee8e70\") " pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" May 28 11:05:18.115617 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:18.115591 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0a64a45c-25e3-42c1-b1e0-36a55fee8e70-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-679cb7bfbc-hd7zw\" (UID: \"0a64a45c-25e3-42c1-b1e0-36a55fee8e70\") " pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" May 28 11:05:18.115683 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:18.115613 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0a64a45c-25e3-42c1-b1e0-36a55fee8e70-secret-thanos-querier-tls\") pod \"thanos-querier-679cb7bfbc-hd7zw\" (UID: \"0a64a45c-25e3-42c1-b1e0-36a55fee8e70\") " pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" May 28 11:05:18.115740 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:18.115688 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0a64a45c-25e3-42c1-b1e0-36a55fee8e70-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-679cb7bfbc-hd7zw\" (UID: \"0a64a45c-25e3-42c1-b1e0-36a55fee8e70\") " pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" May 28 11:05:18.120471 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:18.120447 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0a64a45c-25e3-42c1-b1e0-36a55fee8e70-secret-grpc-tls\") pod \"thanos-querier-679cb7bfbc-hd7zw\" (UID: \"0a64a45c-25e3-42c1-b1e0-36a55fee8e70\") " pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" May 28 11:05:18.120917 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:18.120896 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtlt9\" (UniqueName: \"kubernetes.io/projected/0a64a45c-25e3-42c1-b1e0-36a55fee8e70-kube-api-access-rtlt9\") pod \"thanos-querier-679cb7bfbc-hd7zw\" (UID: \"0a64a45c-25e3-42c1-b1e0-36a55fee8e70\") " pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" May 28 11:05:18.230763 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:18.230687 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" May 28 11:05:18.350700 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:18.350647 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw"] May 28 11:05:18.352709 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:05:18.352683 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a64a45c_25e3_42c1_b1e0_36a55fee8e70.slice/crio-5674186aeeb34f22bbb76a139c41e37347c4a225ef64e08010cf476e7982bd90 WatchSource:0}: Error finding container 5674186aeeb34f22bbb76a139c41e37347c4a225ef64e08010cf476e7982bd90: Status 404 returned error can't find the container with id 5674186aeeb34f22bbb76a139c41e37347c4a225ef64e08010cf476e7982bd90 May 28 11:05:18.795602 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:18.795560 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4q9t4" event={"ID":"c813f946-77a5-495a-b9fc-d2561ae25f56","Type":"ContainerStarted","Data":"3acbb167705a5d05f1a3d3d553cbf9af88a4cb37abeda9ef207e806903709b5f"} May 28 11:05:18.795602 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:18.795604 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4q9t4" event={"ID":"c813f946-77a5-495a-b9fc-d2561ae25f56","Type":"ContainerStarted","Data":"629a6aef048bbcb546390ed88bebf23471475cafff0e7d26e7ce879be962d4d0"} May 28 11:05:18.796570 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:18.796548 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" event={"ID":"0a64a45c-25e3-42c1-b1e0-36a55fee8e70","Type":"ContainerStarted","Data":"5674186aeeb34f22bbb76a139c41e37347c4a225ef64e08010cf476e7982bd90"} May 28 11:05:18.816768 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:18.816715 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4q9t4" podStartSLOduration=2.9258865050000002 podStartE2EDuration="3.816701664s" podCreationTimestamp="2026-05-28 11:05:15 +0000 UTC" firstStartedPulling="2026-05-28 11:05:16.172898432 +0000 UTC m=+134.414558305" lastFinishedPulling="2026-05-28 11:05:17.063713594 +0000 UTC m=+135.305373464" observedRunningTime="2026-05-28 11:05:18.815527256 +0000 UTC m=+137.057187149" watchObservedRunningTime="2026-05-28 11:05:18.816701664 +0000 UTC m=+137.058361557" May 28 11:05:19.801482 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:19.801449 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ckpdn" event={"ID":"f8d9f255-d921-4f5f-8206-a936c35d7701","Type":"ContainerStarted","Data":"8df649d6f99ffcfb888ccfbd06bc463cefa1f63c2c2dc61bc8494842a7e22b50"} May 28 11:05:19.801482 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:19.801484 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ckpdn" event={"ID":"f8d9f255-d921-4f5f-8206-a936c35d7701","Type":"ContainerStarted","Data":"2556d245e1a2e8670276aa6e180e0909522427bc573b9416977d604f3e9bd0bc"} May 28 11:05:19.801909 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:19.801493 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ckpdn" event={"ID":"f8d9f255-d921-4f5f-8206-a936c35d7701","Type":"ContainerStarted","Data":"25ddbf366b9ac2355dfefe01d23337b339592bfd2e789f933cafdde728bca234"} May 28 11:05:19.821527 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:19.821476 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-ckpdn" podStartSLOduration=3.410456219 podStartE2EDuration="4.821462359s" podCreationTimestamp="2026-05-28 11:05:15 +0000 UTC" firstStartedPulling="2026-05-28 11:05:17.782709014 +0000 UTC m=+136.024368884" lastFinishedPulling="2026-05-28 11:05:19.193715153 +0000 UTC m=+137.435375024" observedRunningTime="2026-05-28 11:05:19.819319744 +0000 UTC m=+138.060979636" watchObservedRunningTime="2026-05-28 11:05:19.821462359 +0000 UTC m=+138.063122252" May 28 11:05:20.289256 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.289216 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6b89b46767-7d4vk"] May 28 11:05:20.291353 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.291333 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6b89b46767-7d4vk" May 28 11:05:20.294104 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.294078 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" May 28 11:05:20.295244 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.295177 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-940frvgknv6nk\"" May 28 11:05:20.295615 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.295468 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" May 28 11:05:20.295615 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.295476 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" May 28 11:05:20.295615 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.295568 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" May 28 11:05:20.295615 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.295579 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-dsd6l\"" May 28 11:05:20.301773 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.301747 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6b89b46767-7d4vk"] May 28 11:05:20.433284 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.433261 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/801e2a7b-f30f-42d2-bc50-e4b3a65f5525-secret-metrics-server-client-certs\") pod \"metrics-server-6b89b46767-7d4vk\" (UID: \"801e2a7b-f30f-42d2-bc50-e4b3a65f5525\") " pod="openshift-monitoring/metrics-server-6b89b46767-7d4vk" May 28 11:05:20.433383 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.433296 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/801e2a7b-f30f-42d2-bc50-e4b3a65f5525-secret-metrics-server-tls\") pod \"metrics-server-6b89b46767-7d4vk\" (UID: \"801e2a7b-f30f-42d2-bc50-e4b3a65f5525\") " pod="openshift-monitoring/metrics-server-6b89b46767-7d4vk" May 28 11:05:20.433383 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.433324 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zcwx\" (UniqueName: \"kubernetes.io/projected/801e2a7b-f30f-42d2-bc50-e4b3a65f5525-kube-api-access-4zcwx\") pod \"metrics-server-6b89b46767-7d4vk\" (UID: \"801e2a7b-f30f-42d2-bc50-e4b3a65f5525\") " pod="openshift-monitoring/metrics-server-6b89b46767-7d4vk" May 28 11:05:20.433461 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.433396 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/801e2a7b-f30f-42d2-bc50-e4b3a65f5525-metrics-server-audit-profiles\") pod \"metrics-server-6b89b46767-7d4vk\" (UID: \"801e2a7b-f30f-42d2-bc50-e4b3a65f5525\") " pod="openshift-monitoring/metrics-server-6b89b46767-7d4vk" May 28 11:05:20.433461 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.433443 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/801e2a7b-f30f-42d2-bc50-e4b3a65f5525-client-ca-bundle\") pod \"metrics-server-6b89b46767-7d4vk\" (UID: \"801e2a7b-f30f-42d2-bc50-e4b3a65f5525\") " pod="openshift-monitoring/metrics-server-6b89b46767-7d4vk" May 28 11:05:20.433534 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.433468 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/801e2a7b-f30f-42d2-bc50-e4b3a65f5525-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6b89b46767-7d4vk\" (UID: \"801e2a7b-f30f-42d2-bc50-e4b3a65f5525\") " pod="openshift-monitoring/metrics-server-6b89b46767-7d4vk" May 28 11:05:20.433534 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.433502 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/801e2a7b-f30f-42d2-bc50-e4b3a65f5525-audit-log\") pod \"metrics-server-6b89b46767-7d4vk\" (UID: \"801e2a7b-f30f-42d2-bc50-e4b3a65f5525\") " pod="openshift-monitoring/metrics-server-6b89b46767-7d4vk" May 28 11:05:20.534722 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.534697 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/801e2a7b-f30f-42d2-bc50-e4b3a65f5525-client-ca-bundle\") pod \"metrics-server-6b89b46767-7d4vk\" (UID: \"801e2a7b-f30f-42d2-bc50-e4b3a65f5525\") " pod="openshift-monitoring/metrics-server-6b89b46767-7d4vk" May 28 11:05:20.534856 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.534732 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/801e2a7b-f30f-42d2-bc50-e4b3a65f5525-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6b89b46767-7d4vk\" (UID: \"801e2a7b-f30f-42d2-bc50-e4b3a65f5525\") " pod="openshift-monitoring/metrics-server-6b89b46767-7d4vk" May 28 11:05:20.534856 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.534762 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/801e2a7b-f30f-42d2-bc50-e4b3a65f5525-audit-log\") pod \"metrics-server-6b89b46767-7d4vk\" (UID: \"801e2a7b-f30f-42d2-bc50-e4b3a65f5525\") " pod="openshift-monitoring/metrics-server-6b89b46767-7d4vk" May 28 11:05:20.534856 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.534792 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/801e2a7b-f30f-42d2-bc50-e4b3a65f5525-secret-metrics-server-client-certs\") pod \"metrics-server-6b89b46767-7d4vk\" (UID: \"801e2a7b-f30f-42d2-bc50-e4b3a65f5525\") " pod="openshift-monitoring/metrics-server-6b89b46767-7d4vk" May 28 11:05:20.534856 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.534812 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/801e2a7b-f30f-42d2-bc50-e4b3a65f5525-secret-metrics-server-tls\") pod \"metrics-server-6b89b46767-7d4vk\" (UID: \"801e2a7b-f30f-42d2-bc50-e4b3a65f5525\") " pod="openshift-monitoring/metrics-server-6b89b46767-7d4vk" May 28 11:05:20.534856 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.534835 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zcwx\" (UniqueName: \"kubernetes.io/projected/801e2a7b-f30f-42d2-bc50-e4b3a65f5525-kube-api-access-4zcwx\") pod \"metrics-server-6b89b46767-7d4vk\" (UID: \"801e2a7b-f30f-42d2-bc50-e4b3a65f5525\") " pod="openshift-monitoring/metrics-server-6b89b46767-7d4vk" May 28 11:05:20.535132 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.534879 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/801e2a7b-f30f-42d2-bc50-e4b3a65f5525-metrics-server-audit-profiles\") pod \"metrics-server-6b89b46767-7d4vk\" (UID: \"801e2a7b-f30f-42d2-bc50-e4b3a65f5525\") " pod="openshift-monitoring/metrics-server-6b89b46767-7d4vk" May 28 11:05:20.535306 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.535278 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/801e2a7b-f30f-42d2-bc50-e4b3a65f5525-audit-log\") pod \"metrics-server-6b89b46767-7d4vk\" (UID: \"801e2a7b-f30f-42d2-bc50-e4b3a65f5525\") " pod="openshift-monitoring/metrics-server-6b89b46767-7d4vk" May 28 11:05:20.535514 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.535491 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/801e2a7b-f30f-42d2-bc50-e4b3a65f5525-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6b89b46767-7d4vk\" (UID: \"801e2a7b-f30f-42d2-bc50-e4b3a65f5525\") " pod="openshift-monitoring/metrics-server-6b89b46767-7d4vk" May 28 11:05:20.535736 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.535716 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/801e2a7b-f30f-42d2-bc50-e4b3a65f5525-metrics-server-audit-profiles\") pod \"metrics-server-6b89b46767-7d4vk\" (UID: \"801e2a7b-f30f-42d2-bc50-e4b3a65f5525\") " pod="openshift-monitoring/metrics-server-6b89b46767-7d4vk" May 28 11:05:20.537090 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.537039 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/801e2a7b-f30f-42d2-bc50-e4b3a65f5525-client-ca-bundle\") pod \"metrics-server-6b89b46767-7d4vk\" (UID: \"801e2a7b-f30f-42d2-bc50-e4b3a65f5525\") " pod="openshift-monitoring/metrics-server-6b89b46767-7d4vk" May 28 11:05:20.537647 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.537622 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/801e2a7b-f30f-42d2-bc50-e4b3a65f5525-secret-metrics-server-tls\") pod \"metrics-server-6b89b46767-7d4vk\" (UID: \"801e2a7b-f30f-42d2-bc50-e4b3a65f5525\") " pod="openshift-monitoring/metrics-server-6b89b46767-7d4vk" May 28 11:05:20.537731 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.537685 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/801e2a7b-f30f-42d2-bc50-e4b3a65f5525-secret-metrics-server-client-certs\") pod \"metrics-server-6b89b46767-7d4vk\" (UID: \"801e2a7b-f30f-42d2-bc50-e4b3a65f5525\") " pod="openshift-monitoring/metrics-server-6b89b46767-7d4vk" May 28 11:05:20.542448 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.542428 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zcwx\" (UniqueName: \"kubernetes.io/projected/801e2a7b-f30f-42d2-bc50-e4b3a65f5525-kube-api-access-4zcwx\") pod \"metrics-server-6b89b46767-7d4vk\" (UID: \"801e2a7b-f30f-42d2-bc50-e4b3a65f5525\") " pod="openshift-monitoring/metrics-server-6b89b46767-7d4vk" May 28 11:05:20.602798 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.602777 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6b89b46767-7d4vk" May 28 11:05:20.727919 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.727891 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6b89b46767-7d4vk"] May 28 11:05:20.730692 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:05:20.730665 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod801e2a7b_f30f_42d2_bc50_e4b3a65f5525.slice/crio-4c90c270977bfe21f03f3f79f50cc18b1a534a8d7ea89f7f7ee627cbc8081967 WatchSource:0}: Error finding container 4c90c270977bfe21f03f3f79f50cc18b1a534a8d7ea89f7f7ee627cbc8081967: Status 404 returned error can't find the container with id 4c90c270977bfe21f03f3f79f50cc18b1a534a8d7ea89f7f7ee627cbc8081967 May 28 11:05:20.806080 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.805992 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" event={"ID":"0a64a45c-25e3-42c1-b1e0-36a55fee8e70","Type":"ContainerStarted","Data":"19e54fd46b7dda1dcef9f4408837a8e14574fd81704666dacf1165178274e8a4"} May 28 11:05:20.806080 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.806026 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" event={"ID":"0a64a45c-25e3-42c1-b1e0-36a55fee8e70","Type":"ContainerStarted","Data":"7dd31d49b3ab855f447ca82095973a2a9f748430433db4ef9f19e76d9b79943e"} May 28 11:05:20.806080 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.806035 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" event={"ID":"0a64a45c-25e3-42c1-b1e0-36a55fee8e70","Type":"ContainerStarted","Data":"920781de75fcbbc471d12568f8aae70eeb3270f01cecf9534b6203932e14c68e"} May 28 11:05:20.806918 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:20.806899 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6b89b46767-7d4vk" event={"ID":"801e2a7b-f30f-42d2-bc50-e4b3a65f5525","Type":"ContainerStarted","Data":"4c90c270977bfe21f03f3f79f50cc18b1a534a8d7ea89f7f7ee627cbc8081967"} May 28 11:05:21.258224 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:21.258138 2551 patch_prober.go:28] interesting pod/image-registry-865858fc96-5rkkp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 28 11:05:21.258224 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:21.258208 2551 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-865858fc96-5rkkp" podUID="87747eaa-7924-4337-b061-3808eae4b037" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 28 11:05:21.812919 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:21.812881 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" event={"ID":"0a64a45c-25e3-42c1-b1e0-36a55fee8e70","Type":"ContainerStarted","Data":"2c83d13b2e1a9e7ded4f206424988046980f04c9c32a8a6683e5db20514ebe73"} May 28 11:05:21.813342 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:21.812925 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" event={"ID":"0a64a45c-25e3-42c1-b1e0-36a55fee8e70","Type":"ContainerStarted","Data":"c21f23e0405cbbbc7cb4a221c8d8403331a0cf627daf78b3945a000a077288c5"} May 28 11:05:21.813342 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:21.812940 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" event={"ID":"0a64a45c-25e3-42c1-b1e0-36a55fee8e70","Type":"ContainerStarted","Data":"2f10bc16e35ea01b1901b1c8b4c172f0bb30edab2a78541c521dbe4c16961d43"} May 28 11:05:21.813342 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:21.813120 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" May 28 11:05:21.835946 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:21.835894 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" podStartSLOduration=1.8838862870000002 podStartE2EDuration="4.835879614s" podCreationTimestamp="2026-05-28 11:05:17 +0000 UTC" firstStartedPulling="2026-05-28 11:05:18.354512606 +0000 UTC m=+136.596172478" lastFinishedPulling="2026-05-28 11:05:21.306505932 +0000 UTC m=+139.548165805" observedRunningTime="2026-05-28 11:05:21.8348148 +0000 UTC m=+140.076474706" watchObservedRunningTime="2026-05-28 11:05:21.835879614 +0000 UTC m=+140.077539506" May 28 11:05:22.750674 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:22.750641 2551 patch_prober.go:28] interesting pod/image-registry-865858fc96-5rkkp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 28 11:05:22.750838 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:22.750689 2551 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-865858fc96-5rkkp" podUID="87747eaa-7924-4337-b061-3808eae4b037" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 28 11:05:22.816191 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:22.816145 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6b89b46767-7d4vk" event={"ID":"801e2a7b-f30f-42d2-bc50-e4b3a65f5525","Type":"ContainerStarted","Data":"cf4d7ea435354cf913c12c1240c97027b403631b036a0b7021e240f4849255cd"} May 28 11:05:22.835075 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:22.835009 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6b89b46767-7d4vk" podStartSLOduration=1.549763278 podStartE2EDuration="2.834995726s" podCreationTimestamp="2026-05-28 11:05:20 +0000 UTC" firstStartedPulling="2026-05-28 11:05:20.73249544 +0000 UTC m=+138.974155309" lastFinishedPulling="2026-05-28 11:05:22.017727875 +0000 UTC m=+140.259387757" observedRunningTime="2026-05-28 11:05:22.834115598 +0000 UTC m=+141.075775491" watchObservedRunningTime="2026-05-28 11:05:22.834995726 +0000 UTC m=+141.076655679" May 28 11:05:23.591586 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:23.591550 2551 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" podUID="73034887-1ade-4f40-9b98-f7b47c2771c4" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 28 11:05:27.822605 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:27.822579 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-679cb7bfbc-hd7zw" May 28 11:05:31.256640 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:31.256604 2551 patch_prober.go:28] interesting pod/image-registry-865858fc96-5rkkp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 28 11:05:31.256998 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:31.256663 2551 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-865858fc96-5rkkp" podUID="87747eaa-7924-4337-b061-3808eae4b037" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 28 11:05:32.749598 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:32.749567 2551 patch_prober.go:28] interesting pod/image-registry-865858fc96-5rkkp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 28 11:05:32.749969 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:32.749619 2551 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-865858fc96-5rkkp" podUID="87747eaa-7924-4337-b061-3808eae4b037" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 28 11:05:33.591158 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:33.591122 2551 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" podUID="73034887-1ade-4f40-9b98-f7b47c2771c4" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 28 11:05:33.591297 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:33.591186 2551 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" May 28 11:05:33.591666 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:33.591637 2551 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"6519f7c1d95da2dd539537aa7595fa2092a1a463b55435ba811cbb627b001f6d"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" containerMessage="Container service-proxy failed liveness probe, will be restarted" May 28 11:05:33.591712 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:33.591697 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" podUID="73034887-1ade-4f40-9b98-f7b47c2771c4" containerName="service-proxy" containerID="cri-o://6519f7c1d95da2dd539537aa7595fa2092a1a463b55435ba811cbb627b001f6d" gracePeriod=30 May 28 11:05:33.847669 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:33.847570 2551 generic.go:358] "Generic (PLEG): container finished" podID="73034887-1ade-4f40-9b98-f7b47c2771c4" containerID="6519f7c1d95da2dd539537aa7595fa2092a1a463b55435ba811cbb627b001f6d" exitCode=2 May 28 11:05:33.848045 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:33.847780 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" event={"ID":"73034887-1ade-4f40-9b98-f7b47c2771c4","Type":"ContainerDied","Data":"6519f7c1d95da2dd539537aa7595fa2092a1a463b55435ba811cbb627b001f6d"} May 28 11:05:33.848045 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:33.847831 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77fc546895-57d8f" event={"ID":"73034887-1ade-4f40-9b98-f7b47c2771c4","Type":"ContainerStarted","Data":"65cd30255f47f5b376cdfab79a2c82953f73db6abee459ca04cedcd5a04d8827"} May 28 11:05:36.239522 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.239493 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f7f7c9c49-jf942"] May 28 11:05:36.244889 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.244868 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f7f7c9c49-jf942" May 28 11:05:36.248853 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.248825 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dz6rq\"" May 28 11:05:36.248989 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.248869 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 28 11:05:36.248989 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.248879 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 28 11:05:36.248989 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.248945 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 28 11:05:36.248989 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.248831 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 28 11:05:36.248989 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.248837 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 28 11:05:36.249218 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.248834 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 28 11:05:36.249218 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.248825 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 28 11:05:36.253819 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.253799 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f7f7c9c49-jf942"] May 28 11:05:36.362965 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.362924 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78d3b212-5a59-448a-afb2-dc8bc1b6c200-console-serving-cert\") pod \"console-6f7f7c9c49-jf942\" (UID: \"78d3b212-5a59-448a-afb2-dc8bc1b6c200\") " pod="openshift-console/console-6f7f7c9c49-jf942" May 28 11:05:36.362965 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.362975 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75kbq\" (UniqueName: \"kubernetes.io/projected/78d3b212-5a59-448a-afb2-dc8bc1b6c200-kube-api-access-75kbq\") pod \"console-6f7f7c9c49-jf942\" (UID: \"78d3b212-5a59-448a-afb2-dc8bc1b6c200\") " pod="openshift-console/console-6f7f7c9c49-jf942" May 28 11:05:36.363198 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.363004 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78d3b212-5a59-448a-afb2-dc8bc1b6c200-console-config\") pod \"console-6f7f7c9c49-jf942\" (UID: \"78d3b212-5a59-448a-afb2-dc8bc1b6c200\") " pod="openshift-console/console-6f7f7c9c49-jf942" May 28 11:05:36.363198 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.363039 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78d3b212-5a59-448a-afb2-dc8bc1b6c200-console-oauth-config\") pod \"console-6f7f7c9c49-jf942\" (UID: \"78d3b212-5a59-448a-afb2-dc8bc1b6c200\") " pod="openshift-console/console-6f7f7c9c49-jf942" May 28 11:05:36.363198 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.363104 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78d3b212-5a59-448a-afb2-dc8bc1b6c200-oauth-serving-cert\") pod \"console-6f7f7c9c49-jf942\" (UID: \"78d3b212-5a59-448a-afb2-dc8bc1b6c200\") " pod="openshift-console/console-6f7f7c9c49-jf942" May 28 11:05:36.363198 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.363138 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78d3b212-5a59-448a-afb2-dc8bc1b6c200-service-ca\") pod \"console-6f7f7c9c49-jf942\" (UID: \"78d3b212-5a59-448a-afb2-dc8bc1b6c200\") " pod="openshift-console/console-6f7f7c9c49-jf942" May 28 11:05:36.463689 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.463651 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78d3b212-5a59-448a-afb2-dc8bc1b6c200-console-serving-cert\") pod \"console-6f7f7c9c49-jf942\" (UID: \"78d3b212-5a59-448a-afb2-dc8bc1b6c200\") " pod="openshift-console/console-6f7f7c9c49-jf942" May 28 11:05:36.463887 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.463696 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-75kbq\" (UniqueName: \"kubernetes.io/projected/78d3b212-5a59-448a-afb2-dc8bc1b6c200-kube-api-access-75kbq\") pod \"console-6f7f7c9c49-jf942\" (UID: \"78d3b212-5a59-448a-afb2-dc8bc1b6c200\") " pod="openshift-console/console-6f7f7c9c49-jf942" May 28 11:05:36.463887 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.463735 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78d3b212-5a59-448a-afb2-dc8bc1b6c200-console-config\") pod \"console-6f7f7c9c49-jf942\" (UID: \"78d3b212-5a59-448a-afb2-dc8bc1b6c200\") " pod="openshift-console/console-6f7f7c9c49-jf942" May 28 11:05:36.463887 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.463792 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78d3b212-5a59-448a-afb2-dc8bc1b6c200-console-oauth-config\") pod \"console-6f7f7c9c49-jf942\" (UID: \"78d3b212-5a59-448a-afb2-dc8bc1b6c200\") " pod="openshift-console/console-6f7f7c9c49-jf942" May 28 11:05:36.463887 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.463846 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78d3b212-5a59-448a-afb2-dc8bc1b6c200-oauth-serving-cert\") pod \"console-6f7f7c9c49-jf942\" (UID: \"78d3b212-5a59-448a-afb2-dc8bc1b6c200\") " pod="openshift-console/console-6f7f7c9c49-jf942" May 28 11:05:36.464097 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.463889 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78d3b212-5a59-448a-afb2-dc8bc1b6c200-service-ca\") pod \"console-6f7f7c9c49-jf942\" (UID: \"78d3b212-5a59-448a-afb2-dc8bc1b6c200\") " pod="openshift-console/console-6f7f7c9c49-jf942" May 28 11:05:36.464607 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.464586 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78d3b212-5a59-448a-afb2-dc8bc1b6c200-console-config\") pod \"console-6f7f7c9c49-jf942\" (UID: \"78d3b212-5a59-448a-afb2-dc8bc1b6c200\") " pod="openshift-console/console-6f7f7c9c49-jf942" May 28 11:05:36.464607 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.464594 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78d3b212-5a59-448a-afb2-dc8bc1b6c200-service-ca\") pod \"console-6f7f7c9c49-jf942\" (UID: \"78d3b212-5a59-448a-afb2-dc8bc1b6c200\") " pod="openshift-console/console-6f7f7c9c49-jf942" May 28 11:05:36.464728 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.464639 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78d3b212-5a59-448a-afb2-dc8bc1b6c200-oauth-serving-cert\") pod \"console-6f7f7c9c49-jf942\" (UID: \"78d3b212-5a59-448a-afb2-dc8bc1b6c200\") " pod="openshift-console/console-6f7f7c9c49-jf942" May 28 11:05:36.466219 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.466201 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78d3b212-5a59-448a-afb2-dc8bc1b6c200-console-oauth-config\") pod \"console-6f7f7c9c49-jf942\" (UID: \"78d3b212-5a59-448a-afb2-dc8bc1b6c200\") " pod="openshift-console/console-6f7f7c9c49-jf942" May 28 11:05:36.466275 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.466257 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78d3b212-5a59-448a-afb2-dc8bc1b6c200-console-serving-cert\") pod \"console-6f7f7c9c49-jf942\" (UID: \"78d3b212-5a59-448a-afb2-dc8bc1b6c200\") " pod="openshift-console/console-6f7f7c9c49-jf942" May 28 11:05:36.472208 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.472185 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75kbq\" (UniqueName: \"kubernetes.io/projected/78d3b212-5a59-448a-afb2-dc8bc1b6c200-kube-api-access-75kbq\") pod \"console-6f7f7c9c49-jf942\" (UID: \"78d3b212-5a59-448a-afb2-dc8bc1b6c200\") " pod="openshift-console/console-6f7f7c9c49-jf942" May 28 11:05:36.554952 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.554915 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f7f7c9c49-jf942" May 28 11:05:36.671577 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.671555 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f7f7c9c49-jf942"] May 28 11:05:36.673629 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:05:36.673608 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78d3b212_5a59_448a_afb2_dc8bc1b6c200.slice/crio-ae6bc29dd23f4539084d1bfaf73b5be16fbbcf0882d35cd443a5447fd8ce2560 WatchSource:0}: Error finding container ae6bc29dd23f4539084d1bfaf73b5be16fbbcf0882d35cd443a5447fd8ce2560: Status 404 returned error can't find the container with id ae6bc29dd23f4539084d1bfaf73b5be16fbbcf0882d35cd443a5447fd8ce2560 May 28 11:05:36.856244 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:36.856174 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f7f7c9c49-jf942" event={"ID":"78d3b212-5a59-448a-afb2-dc8bc1b6c200","Type":"ContainerStarted","Data":"ae6bc29dd23f4539084d1bfaf73b5be16fbbcf0882d35cd443a5447fd8ce2560"} May 28 11:05:38.672937 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:05:38.672880 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2p4rf" podUID="58fc8bd1-415a-4618-971d-03a6d76be5ea" May 28 11:05:38.690836 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:05:38.690788 2551 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-kcddp" podUID="89006b03-182a-475a-849d-a93d928d555b" May 28 11:05:38.861559 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:38.861521 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2p4rf" May 28 11:05:39.865289 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:39.865253 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f7f7c9c49-jf942" event={"ID":"78d3b212-5a59-448a-afb2-dc8bc1b6c200","Type":"ContainerStarted","Data":"f30ced8e0df5be6c76b6f2a01fd51431391f5674acc1d0e608410c5ea5563b6c"} May 28 11:05:39.884852 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:39.884802 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6f7f7c9c49-jf942" podStartSLOduration=1.139409977 podStartE2EDuration="3.88478943s" podCreationTimestamp="2026-05-28 11:05:36 +0000 UTC" firstStartedPulling="2026-05-28 11:05:36.675884819 +0000 UTC m=+154.917544690" lastFinishedPulling="2026-05-28 11:05:39.421264273 +0000 UTC m=+157.662924143" observedRunningTime="2026-05-28 11:05:39.882523137 +0000 UTC m=+158.124183029" watchObservedRunningTime="2026-05-28 11:05:39.88478943 +0000 UTC m=+158.126449322" May 28 11:05:40.603915 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:40.603875 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6b89b46767-7d4vk" May 28 11:05:40.603915 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:40.603919 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6b89b46767-7d4vk" May 28 11:05:41.256175 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:41.256141 2551 patch_prober.go:28] interesting pod/image-registry-865858fc96-5rkkp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 28 11:05:41.256634 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:41.256199 2551 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-865858fc96-5rkkp" podUID="87747eaa-7924-4337-b061-3808eae4b037" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 28 11:05:41.256634 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:41.256245 2551 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-865858fc96-5rkkp" May 28 11:05:41.256827 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:41.256805 2551 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"b813201a7f5b262064642cb396752d5e618a69c512af35a28ef1905724729ae2"} pod="openshift-image-registry/image-registry-865858fc96-5rkkp" containerMessage="Container registry failed liveness probe, will be restarted" May 28 11:05:41.260298 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:41.260273 2551 patch_prober.go:28] interesting pod/image-registry-865858fc96-5rkkp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 28 11:05:41.260428 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:41.260312 2551 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-865858fc96-5rkkp" podUID="87747eaa-7924-4337-b061-3808eae4b037" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 28 11:05:43.621367 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:43.621327 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89006b03-182a-475a-849d-a93d928d555b-cert\") pod \"ingress-canary-kcddp\" (UID: \"89006b03-182a-475a-849d-a93d928d555b\") " pod="openshift-ingress-canary/ingress-canary-kcddp" May 28 11:05:43.621726 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:43.621412 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58fc8bd1-415a-4618-971d-03a6d76be5ea-metrics-tls\") pod \"dns-default-2p4rf\" (UID: \"58fc8bd1-415a-4618-971d-03a6d76be5ea\") " pod="openshift-dns/dns-default-2p4rf" May 28 11:05:43.623763 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:43.623737 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89006b03-182a-475a-849d-a93d928d555b-cert\") pod \"ingress-canary-kcddp\" (UID: \"89006b03-182a-475a-849d-a93d928d555b\") " pod="openshift-ingress-canary/ingress-canary-kcddp" May 28 11:05:43.623874 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:43.623784 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/58fc8bd1-415a-4618-971d-03a6d76be5ea-metrics-tls\") pod \"dns-default-2p4rf\" (UID: \"58fc8bd1-415a-4618-971d-03a6d76be5ea\") " pod="openshift-dns/dns-default-2p4rf" May 28 11:05:43.665200 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:43.665172 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nq6bj\"" May 28 11:05:43.673246 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:43.673226 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2p4rf" May 28 11:05:43.820101 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:43.820074 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2p4rf"] May 28 11:05:43.821814 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:05:43.821789 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58fc8bd1_415a_4618_971d_03a6d76be5ea.slice/crio-89639d5097dab434b7e8f1e8407f18a7530078ce065294db861f9488974535e6 WatchSource:0}: Error finding container 89639d5097dab434b7e8f1e8407f18a7530078ce065294db861f9488974535e6: Status 404 returned error can't find the container with id 89639d5097dab434b7e8f1e8407f18a7530078ce065294db861f9488974535e6 May 28 11:05:43.876711 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:43.876636 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2p4rf" event={"ID":"58fc8bd1-415a-4618-971d-03a6d76be5ea","Type":"ContainerStarted","Data":"89639d5097dab434b7e8f1e8407f18a7530078ce065294db861f9488974535e6"} May 28 11:05:45.883527 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:45.883495 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2p4rf" event={"ID":"58fc8bd1-415a-4618-971d-03a6d76be5ea","Type":"ContainerStarted","Data":"d5b6aa24f1ad4460d97a5c0cdf6cf69da9c98a71906ed3e14070ad47d071ae86"} May 28 11:05:45.883527 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:45.883530 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2p4rf" event={"ID":"58fc8bd1-415a-4618-971d-03a6d76be5ea","Type":"ContainerStarted","Data":"34ff01749011eb954af4256ba74b28cd044028afb258ff2f7f2aa2a903e760b8"} May 28 11:05:45.883898 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:45.883591 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2p4rf" May 28 11:05:45.901843 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:45.901803 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-2p4rf" podStartSLOduration=129.699163812 podStartE2EDuration="2m10.901788824s" podCreationTimestamp="2026-05-28 11:03:35 +0000 UTC" firstStartedPulling="2026-05-28 11:05:43.823611049 +0000 UTC m=+162.065270923" lastFinishedPulling="2026-05-28 11:05:45.026236066 +0000 UTC m=+163.267895935" observedRunningTime="2026-05-28 11:05:45.900113052 +0000 UTC m=+164.141772944" watchObservedRunningTime="2026-05-28 11:05:45.901788824 +0000 UTC m=+164.143448716" May 28 11:05:46.555545 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:46.555503 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f7f7c9c49-jf942" May 28 11:05:46.555711 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:46.555559 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f7f7c9c49-jf942" May 28 11:05:46.556974 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:46.556949 2551 patch_prober.go:28] interesting pod/console-6f7f7c9c49-jf942 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.15:8443/health\": dial tcp 10.133.0.15:8443: connect: connection refused" start-of-body= May 28 11:05:46.557087 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:46.556991 2551 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6f7f7c9c49-jf942" podUID="78d3b212-5a59-448a-afb2-dc8bc1b6c200" containerName="console" probeResult="failure" output="Get \"https://10.133.0.15:8443/health\": dial tcp 10.133.0.15:8443: connect: connection refused" May 28 11:05:46.887714 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:46.887636 2551 generic.go:358] "Generic (PLEG): container finished" podID="af9fa108-1f8e-44cf-8d6c-6d6c1a98133e" containerID="46f7c25e1cb88206d94dd67712e1753d8c4c6c69660e50c52111f79b4a22f080" exitCode=0 May 28 11:05:46.888269 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:46.887709 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2t6dz" event={"ID":"af9fa108-1f8e-44cf-8d6c-6d6c1a98133e","Type":"ContainerDied","Data":"46f7c25e1cb88206d94dd67712e1753d8c4c6c69660e50c52111f79b4a22f080"} May 28 11:05:46.888269 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:46.888003 2551 scope.go:117] "RemoveContainer" containerID="46f7c25e1cb88206d94dd67712e1753d8c4c6c69660e50c52111f79b4a22f080" May 28 11:05:47.895430 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:47.895387 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-2t6dz" event={"ID":"af9fa108-1f8e-44cf-8d6c-6d6c1a98133e","Type":"ContainerStarted","Data":"e87c2dafdb8f8b11825181584746b31842be9fca5b1f811ea49f2f77676b1078"} May 28 11:05:51.248743 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:51.248706 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-ckpdn_f8d9f255-d921-4f5f-8206-a936c35d7701/kube-state-metrics/0.log" May 28 11:05:51.260384 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:51.260358 2551 patch_prober.go:28] interesting pod/image-registry-865858fc96-5rkkp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 28 11:05:51.260513 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:51.260415 2551 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-865858fc96-5rkkp" podUID="87747eaa-7924-4337-b061-3808eae4b037" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 28 11:05:51.445643 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:51.445616 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-ckpdn_f8d9f255-d921-4f5f-8206-a936c35d7701/kube-rbac-proxy-main/0.log" May 28 11:05:51.647813 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:51.647745 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-ckpdn_f8d9f255-d921-4f5f-8206-a936c35d7701/kube-rbac-proxy-self/0.log" May 28 11:05:51.845095 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:51.845052 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6b89b46767-7d4vk_801e2a7b-f30f-42d2-bc50-e4b3a65f5525/metrics-server/0.log" May 28 11:05:52.244840 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:52.244817 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4q9t4_c813f946-77a5-495a-b9fc-d2561ae25f56/init-textfile/0.log" May 28 11:05:52.358120 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:52.358089 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kcddp" May 28 11:05:52.361003 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:52.360985 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8gjbt\"" May 28 11:05:52.369199 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:52.369184 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kcddp" May 28 11:05:52.450139 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:52.450111 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4q9t4_c813f946-77a5-495a-b9fc-d2561ae25f56/node-exporter/0.log" May 28 11:05:52.504982 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:52.504958 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kcddp"] May 28 11:05:52.507439 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:05:52.507412 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89006b03_182a_475a_849d_a93d928d555b.slice/crio-729b393e8d9b45db1f499569b2c79b3fadf5d0822a8cbafb0adf1be3a29a2294 WatchSource:0}: Error finding container 729b393e8d9b45db1f499569b2c79b3fadf5d0822a8cbafb0adf1be3a29a2294: Status 404 returned error can't find the container with id 729b393e8d9b45db1f499569b2c79b3fadf5d0822a8cbafb0adf1be3a29a2294 May 28 11:05:52.645016 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:52.644981 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4q9t4_c813f946-77a5-495a-b9fc-d2561ae25f56/kube-rbac-proxy/0.log" May 28 11:05:52.911941 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:52.911899 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kcddp" event={"ID":"89006b03-182a-475a-849d-a93d928d555b","Type":"ContainerStarted","Data":"729b393e8d9b45db1f499569b2c79b3fadf5d0822a8cbafb0adf1be3a29a2294"} May 28 11:05:54.918355 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:54.918316 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kcddp" event={"ID":"89006b03-182a-475a-849d-a93d928d555b","Type":"ContainerStarted","Data":"99cc2bb4ec3f51f8d4305a9e3ea595d55a97e80d8e2034c658005cfacad0adcf"} May 28 11:05:54.934290 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:54.934246 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kcddp" podStartSLOduration=138.482189633 podStartE2EDuration="2m19.934232889s" podCreationTimestamp="2026-05-28 11:03:35 +0000 UTC" firstStartedPulling="2026-05-28 11:05:52.50927479 +0000 UTC m=+170.750934660" lastFinishedPulling="2026-05-28 11:05:53.961318047 +0000 UTC m=+172.202977916" observedRunningTime="2026-05-28 11:05:54.933514816 +0000 UTC m=+173.175174713" watchObservedRunningTime="2026-05-28 11:05:54.934232889 +0000 UTC m=+173.175892780" May 28 11:05:55.889969 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:55.889939 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2p4rf" May 28 11:05:56.559203 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:56.559176 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f7f7c9c49-jf942" May 28 11:05:56.562971 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:56.562943 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f7f7c9c49-jf942" May 28 11:05:56.650629 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:56.650589 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-679cb7bfbc-hd7zw_0a64a45c-25e3-42c1-b1e0-36a55fee8e70/thanos-query/0.log" May 28 11:05:56.848571 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:56.848488 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-679cb7bfbc-hd7zw_0a64a45c-25e3-42c1-b1e0-36a55fee8e70/kube-rbac-proxy-web/0.log" May 28 11:05:57.046422 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:57.046387 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-679cb7bfbc-hd7zw_0a64a45c-25e3-42c1-b1e0-36a55fee8e70/kube-rbac-proxy/0.log" May 28 11:05:57.248489 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:57.248406 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-679cb7bfbc-hd7zw_0a64a45c-25e3-42c1-b1e0-36a55fee8e70/prom-label-proxy/0.log" May 28 11:05:57.446470 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:57.446440 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-679cb7bfbc-hd7zw_0a64a45c-25e3-42c1-b1e0-36a55fee8e70/kube-rbac-proxy-rules/0.log" May 28 11:05:57.645184 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:57.645154 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-679cb7bfbc-hd7zw_0a64a45c-25e3-42c1-b1e0-36a55fee8e70/kube-rbac-proxy-metrics/0.log" May 28 11:05:58.645729 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:58.645702 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6f7f7c9c49-jf942_78d3b212-5a59-448a-afb2-dc8bc1b6c200/console/0.log" May 28 11:05:59.044675 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:59.044646 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2p4rf_58fc8bd1-415a-4618-971d-03a6d76be5ea/dns/0.log" May 28 11:05:59.246880 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:05:59.246844 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2p4rf_58fc8bd1-415a-4618-971d-03a6d76be5ea/kube-rbac-proxy/0.log" May 28 11:06:00.608895 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:00.608868 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6b89b46767-7d4vk" May 28 11:06:00.612779 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:00.612756 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6b89b46767-7d4vk" May 28 11:06:00.645095 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:00.645052 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sbnm7_8c1c4ad4-f62f-4d7d-9a30-0fae41b4738b/dns-node-resolver/0.log" May 28 11:06:01.045455 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:01.045422 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-865858fc96-5rkkp_87747eaa-7924-4337-b061-3808eae4b037/registry/0.log" May 28 11:06:01.261100 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:01.261046 2551 patch_prober.go:28] interesting pod/image-registry-865858fc96-5rkkp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 28 11:06:01.261242 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:01.261129 2551 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-865858fc96-5rkkp" podUID="87747eaa-7924-4337-b061-3808eae4b037" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 28 11:06:01.648379 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:01.648352 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xrf98_804fb564-4d88-4cc8-8c56-5b653c8f53cf/node-ca/0.log" May 28 11:06:02.245910 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:02.245878 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kcddp_89006b03-182a-475a-849d-a93d928d555b/serve-healthcheck-canary/0.log" May 28 11:06:04.841742 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:04.841701 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f7f7c9c49-jf942"] May 28 11:06:06.274874 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:06.274832 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-865858fc96-5rkkp" podUID="87747eaa-7924-4337-b061-3808eae4b037" containerName="registry" containerID="cri-o://b813201a7f5b262064642cb396752d5e618a69c512af35a28ef1905724729ae2" gracePeriod=30 May 28 11:06:07.956288 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:07.956254 2551 generic.go:358] "Generic (PLEG): container finished" podID="87747eaa-7924-4337-b061-3808eae4b037" containerID="b813201a7f5b262064642cb396752d5e618a69c512af35a28ef1905724729ae2" exitCode=0 May 28 11:06:07.956922 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:07.956338 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-865858fc96-5rkkp" event={"ID":"87747eaa-7924-4337-b061-3808eae4b037","Type":"ContainerDied","Data":"b813201a7f5b262064642cb396752d5e618a69c512af35a28ef1905724729ae2"} May 28 11:06:07.956922 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:07.956371 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-865858fc96-5rkkp" event={"ID":"87747eaa-7924-4337-b061-3808eae4b037","Type":"ContainerStarted","Data":"a1756cef6823f3bf848dc293c4461c45cba023f7bcdc5bc870e99883376e12d1"} May 28 11:06:07.956922 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:07.956430 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-865858fc96-5rkkp" May 28 11:06:28.963456 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:28.963426 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-865858fc96-5rkkp" May 28 11:06:29.864253 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:29.864195 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6f7f7c9c49-jf942" podUID="78d3b212-5a59-448a-afb2-dc8bc1b6c200" containerName="console" containerID="cri-o://f30ced8e0df5be6c76b6f2a01fd51431391f5674acc1d0e608410c5ea5563b6c" gracePeriod=15 May 28 11:06:30.019439 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:30.019415 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6f7f7c9c49-jf942_78d3b212-5a59-448a-afb2-dc8bc1b6c200/console/0.log" May 28 11:06:30.019769 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:30.019452 2551 generic.go:358] "Generic (PLEG): container finished" podID="78d3b212-5a59-448a-afb2-dc8bc1b6c200" containerID="f30ced8e0df5be6c76b6f2a01fd51431391f5674acc1d0e608410c5ea5563b6c" exitCode=2 May 28 11:06:30.019769 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:30.019526 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f7f7c9c49-jf942" event={"ID":"78d3b212-5a59-448a-afb2-dc8bc1b6c200","Type":"ContainerDied","Data":"f30ced8e0df5be6c76b6f2a01fd51431391f5674acc1d0e608410c5ea5563b6c"} May 28 11:06:30.097784 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:30.097764 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6f7f7c9c49-jf942_78d3b212-5a59-448a-afb2-dc8bc1b6c200/console/0.log" May 28 11:06:30.097892 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:30.097845 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f7f7c9c49-jf942" May 28 11:06:30.197668 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:30.197587 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75kbq\" (UniqueName: \"kubernetes.io/projected/78d3b212-5a59-448a-afb2-dc8bc1b6c200-kube-api-access-75kbq\") pod \"78d3b212-5a59-448a-afb2-dc8bc1b6c200\" (UID: \"78d3b212-5a59-448a-afb2-dc8bc1b6c200\") " May 28 11:06:30.197668 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:30.197649 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78d3b212-5a59-448a-afb2-dc8bc1b6c200-console-serving-cert\") pod \"78d3b212-5a59-448a-afb2-dc8bc1b6c200\" (UID: \"78d3b212-5a59-448a-afb2-dc8bc1b6c200\") " May 28 11:06:30.197880 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:30.197711 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78d3b212-5a59-448a-afb2-dc8bc1b6c200-service-ca\") pod \"78d3b212-5a59-448a-afb2-dc8bc1b6c200\" (UID: \"78d3b212-5a59-448a-afb2-dc8bc1b6c200\") " May 28 11:06:30.197880 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:30.197748 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78d3b212-5a59-448a-afb2-dc8bc1b6c200-console-oauth-config\") pod \"78d3b212-5a59-448a-afb2-dc8bc1b6c200\" (UID: \"78d3b212-5a59-448a-afb2-dc8bc1b6c200\") " May 28 11:06:30.197880 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:30.197776 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78d3b212-5a59-448a-afb2-dc8bc1b6c200-oauth-serving-cert\") pod \"78d3b212-5a59-448a-afb2-dc8bc1b6c200\" (UID: \"78d3b212-5a59-448a-afb2-dc8bc1b6c200\") " May 28 11:06:30.197880 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:30.197814 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78d3b212-5a59-448a-afb2-dc8bc1b6c200-console-config\") pod \"78d3b212-5a59-448a-afb2-dc8bc1b6c200\" (UID: \"78d3b212-5a59-448a-afb2-dc8bc1b6c200\") " May 28 11:06:30.198227 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:30.198195 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78d3b212-5a59-448a-afb2-dc8bc1b6c200-service-ca" (OuterVolumeSpecName: "service-ca") pod "78d3b212-5a59-448a-afb2-dc8bc1b6c200" (UID: "78d3b212-5a59-448a-afb2-dc8bc1b6c200"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 11:06:30.198340 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:30.198193 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78d3b212-5a59-448a-afb2-dc8bc1b6c200-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "78d3b212-5a59-448a-afb2-dc8bc1b6c200" (UID: "78d3b212-5a59-448a-afb2-dc8bc1b6c200"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 11:06:30.198340 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:30.198253 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78d3b212-5a59-448a-afb2-dc8bc1b6c200-console-config" (OuterVolumeSpecName: "console-config") pod "78d3b212-5a59-448a-afb2-dc8bc1b6c200" (UID: "78d3b212-5a59-448a-afb2-dc8bc1b6c200"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 11:06:30.199990 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:30.199961 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78d3b212-5a59-448a-afb2-dc8bc1b6c200-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "78d3b212-5a59-448a-afb2-dc8bc1b6c200" (UID: "78d3b212-5a59-448a-afb2-dc8bc1b6c200"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 11:06:30.199990 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:30.199969 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78d3b212-5a59-448a-afb2-dc8bc1b6c200-kube-api-access-75kbq" (OuterVolumeSpecName: "kube-api-access-75kbq") pod "78d3b212-5a59-448a-afb2-dc8bc1b6c200" (UID: "78d3b212-5a59-448a-afb2-dc8bc1b6c200"). InnerVolumeSpecName "kube-api-access-75kbq". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 11:06:30.200128 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:30.199987 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78d3b212-5a59-448a-afb2-dc8bc1b6c200-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "78d3b212-5a59-448a-afb2-dc8bc1b6c200" (UID: "78d3b212-5a59-448a-afb2-dc8bc1b6c200"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 11:06:30.298542 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:30.298514 2551 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/78d3b212-5a59-448a-afb2-dc8bc1b6c200-service-ca\") on node \"ip-10-0-130-105.ec2.internal\" DevicePath \"\"" May 28 11:06:30.298542 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:30.298539 2551 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/78d3b212-5a59-448a-afb2-dc8bc1b6c200-console-oauth-config\") on node \"ip-10-0-130-105.ec2.internal\" DevicePath \"\"" May 28 11:06:30.298691 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:30.298550 2551 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/78d3b212-5a59-448a-afb2-dc8bc1b6c200-oauth-serving-cert\") on node \"ip-10-0-130-105.ec2.internal\" DevicePath \"\"" May 28 11:06:30.298691 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:30.298558 2551 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/78d3b212-5a59-448a-afb2-dc8bc1b6c200-console-config\") on node \"ip-10-0-130-105.ec2.internal\" DevicePath \"\"" May 28 11:06:30.298691 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:30.298567 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75kbq\" (UniqueName: \"kubernetes.io/projected/78d3b212-5a59-448a-afb2-dc8bc1b6c200-kube-api-access-75kbq\") on node \"ip-10-0-130-105.ec2.internal\" DevicePath \"\"" May 28 11:06:30.298691 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:30.298578 2551 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/78d3b212-5a59-448a-afb2-dc8bc1b6c200-console-serving-cert\") on node \"ip-10-0-130-105.ec2.internal\" DevicePath \"\"" May 28 11:06:31.023830 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:31.023803 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6f7f7c9c49-jf942_78d3b212-5a59-448a-afb2-dc8bc1b6c200/console/0.log" May 28 11:06:31.024244 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:31.023864 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f7f7c9c49-jf942" event={"ID":"78d3b212-5a59-448a-afb2-dc8bc1b6c200","Type":"ContainerDied","Data":"ae6bc29dd23f4539084d1bfaf73b5be16fbbcf0882d35cd443a5447fd8ce2560"} May 28 11:06:31.024244 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:31.023895 2551 scope.go:117] "RemoveContainer" containerID="f30ced8e0df5be6c76b6f2a01fd51431391f5674acc1d0e608410c5ea5563b6c" May 28 11:06:31.024244 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:31.023902 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f7f7c9c49-jf942" May 28 11:06:31.040980 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:31.040955 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f7f7c9c49-jf942"] May 28 11:06:31.046967 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:31.046945 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f7f7c9c49-jf942"] May 28 11:06:32.358503 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:06:32.358473 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78d3b212-5a59-448a-afb2-dc8bc1b6c200" path="/var/lib/kubelet/pods/78d3b212-5a59-448a-afb2-dc8bc1b6c200/volumes" May 28 11:07:56.369392 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.369360 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-65ff78ddb8-6zz8s"] May 28 11:07:56.369829 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.369595 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78d3b212-5a59-448a-afb2-dc8bc1b6c200" containerName="console" May 28 11:07:56.369829 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.369605 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="78d3b212-5a59-448a-afb2-dc8bc1b6c200" containerName="console" May 28 11:07:56.369829 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.369661 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="78d3b212-5a59-448a-afb2-dc8bc1b6c200" containerName="console" May 28 11:07:56.371360 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.371340 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65ff78ddb8-6zz8s" May 28 11:07:56.374024 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.374004 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" May 28 11:07:56.375125 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.375107 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" May 28 11:07:56.375428 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.375396 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" May 28 11:07:56.375514 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.375472 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dz6rq\"" May 28 11:07:56.375514 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.375484 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" May 28 11:07:56.375514 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.375484 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" May 28 11:07:56.375676 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.375526 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" May 28 11:07:56.375767 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.375751 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" May 28 11:07:56.380253 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.380226 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" May 28 11:07:56.381479 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.381460 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65ff78ddb8-6zz8s"] May 28 11:07:56.520654 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.520622 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dswnh\" (UniqueName: \"kubernetes.io/projected/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-kube-api-access-dswnh\") pod \"console-65ff78ddb8-6zz8s\" (UID: \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\") " pod="openshift-console/console-65ff78ddb8-6zz8s" May 28 11:07:56.520813 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.520659 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-oauth-serving-cert\") pod \"console-65ff78ddb8-6zz8s\" (UID: \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\") " pod="openshift-console/console-65ff78ddb8-6zz8s" May 28 11:07:56.520813 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.520684 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-console-config\") pod \"console-65ff78ddb8-6zz8s\" (UID: \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\") " pod="openshift-console/console-65ff78ddb8-6zz8s" May 28 11:07:56.520813 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.520761 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-console-oauth-config\") pod \"console-65ff78ddb8-6zz8s\" (UID: \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\") " pod="openshift-console/console-65ff78ddb8-6zz8s" May 28 11:07:56.520813 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.520788 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-service-ca\") pod \"console-65ff78ddb8-6zz8s\" (UID: \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\") " pod="openshift-console/console-65ff78ddb8-6zz8s" May 28 11:07:56.520943 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.520820 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-trusted-ca-bundle\") pod \"console-65ff78ddb8-6zz8s\" (UID: \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\") " pod="openshift-console/console-65ff78ddb8-6zz8s" May 28 11:07:56.520943 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.520890 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-console-serving-cert\") pod \"console-65ff78ddb8-6zz8s\" (UID: \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\") " pod="openshift-console/console-65ff78ddb8-6zz8s" May 28 11:07:56.621777 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.621694 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-console-oauth-config\") pod \"console-65ff78ddb8-6zz8s\" (UID: \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\") " pod="openshift-console/console-65ff78ddb8-6zz8s" May 28 11:07:56.621777 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.621732 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-service-ca\") pod \"console-65ff78ddb8-6zz8s\" (UID: \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\") " pod="openshift-console/console-65ff78ddb8-6zz8s" May 28 11:07:56.621777 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.621758 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-trusted-ca-bundle\") pod \"console-65ff78ddb8-6zz8s\" (UID: \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\") " pod="openshift-console/console-65ff78ddb8-6zz8s" May 28 11:07:56.622027 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.621790 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-console-serving-cert\") pod \"console-65ff78ddb8-6zz8s\" (UID: \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\") " pod="openshift-console/console-65ff78ddb8-6zz8s" May 28 11:07:56.622027 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.621944 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dswnh\" (UniqueName: \"kubernetes.io/projected/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-kube-api-access-dswnh\") pod \"console-65ff78ddb8-6zz8s\" (UID: \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\") " pod="openshift-console/console-65ff78ddb8-6zz8s" May 28 11:07:56.622027 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.621998 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-oauth-serving-cert\") pod \"console-65ff78ddb8-6zz8s\" (UID: \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\") " pod="openshift-console/console-65ff78ddb8-6zz8s" May 28 11:07:56.622210 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.622036 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-console-config\") pod \"console-65ff78ddb8-6zz8s\" (UID: \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\") " pod="openshift-console/console-65ff78ddb8-6zz8s" May 28 11:07:56.622601 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.622564 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-service-ca\") pod \"console-65ff78ddb8-6zz8s\" (UID: \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\") " pod="openshift-console/console-65ff78ddb8-6zz8s" May 28 11:07:56.622718 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.622642 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-trusted-ca-bundle\") pod \"console-65ff78ddb8-6zz8s\" (UID: \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\") " pod="openshift-console/console-65ff78ddb8-6zz8s" May 28 11:07:56.622718 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.622646 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-oauth-serving-cert\") pod \"console-65ff78ddb8-6zz8s\" (UID: \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\") " pod="openshift-console/console-65ff78ddb8-6zz8s" May 28 11:07:56.622800 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.622745 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-console-config\") pod \"console-65ff78ddb8-6zz8s\" (UID: \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\") " pod="openshift-console/console-65ff78ddb8-6zz8s" May 28 11:07:56.624283 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.624263 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-console-serving-cert\") pod \"console-65ff78ddb8-6zz8s\" (UID: \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\") " pod="openshift-console/console-65ff78ddb8-6zz8s" May 28 11:07:56.624379 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.624295 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-console-oauth-config\") pod \"console-65ff78ddb8-6zz8s\" (UID: \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\") " pod="openshift-console/console-65ff78ddb8-6zz8s" May 28 11:07:56.631417 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.631397 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dswnh\" (UniqueName: \"kubernetes.io/projected/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-kube-api-access-dswnh\") pod \"console-65ff78ddb8-6zz8s\" (UID: \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\") " pod="openshift-console/console-65ff78ddb8-6zz8s" May 28 11:07:56.681490 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.681461 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65ff78ddb8-6zz8s" May 28 11:07:56.799656 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:56.799624 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65ff78ddb8-6zz8s"] May 28 11:07:56.802667 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:07:56.802645 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3df563a4_8d0a_4f61_ba73_82a0ae1de7fa.slice/crio-89a4a69c8a88cd03badb43bf833d242d8d7def702f7663d63d92a81ec01133f7 WatchSource:0}: Error finding container 89a4a69c8a88cd03badb43bf833d242d8d7def702f7663d63d92a81ec01133f7: Status 404 returned error can't find the container with id 89a4a69c8a88cd03badb43bf833d242d8d7def702f7663d63d92a81ec01133f7 May 28 11:07:57.241141 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:57.241098 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65ff78ddb8-6zz8s" event={"ID":"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa","Type":"ContainerStarted","Data":"bd9e4db2fcc091b45b3ac9e4d3b157e37ec8f9f79022efe7f9dc5fd2ad4765d2"} May 28 11:07:57.241141 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:57.241139 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65ff78ddb8-6zz8s" event={"ID":"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa","Type":"ContainerStarted","Data":"89a4a69c8a88cd03badb43bf833d242d8d7def702f7663d63d92a81ec01133f7"} May 28 11:07:57.261036 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:07:57.260986 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-65ff78ddb8-6zz8s" podStartSLOduration=1.260966292 podStartE2EDuration="1.260966292s" podCreationTimestamp="2026-05-28 11:07:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 11:07:57.260466889 +0000 UTC m=+295.502126781" watchObservedRunningTime="2026-05-28 11:07:57.260966292 +0000 UTC m=+295.502626186" May 28 11:08:02.241412 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:08:02.241374 2551 kubelet.go:1628] "Image garbage collection succeeded" May 28 11:08:06.681762 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:08:06.681717 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65ff78ddb8-6zz8s" May 28 11:08:06.681762 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:08:06.681762 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65ff78ddb8-6zz8s" May 28 11:08:06.686386 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:08:06.686366 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65ff78ddb8-6zz8s" May 28 11:08:07.271277 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:08:07.271239 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65ff78ddb8-6zz8s" May 28 11:10:11.161895 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:10:11.161859 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7f46844656-7pg7d"] May 28 11:10:11.164948 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:10:11.164932 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7f46844656-7pg7d" May 28 11:10:11.167422 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:10:11.167403 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" May 28 11:10:11.167538 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:10:11.167401 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" May 28 11:10:11.168424 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:10:11.168408 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-g4qnb\"" May 28 11:10:11.176321 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:10:11.176301 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7f46844656-7pg7d"] May 28 11:10:11.239457 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:10:11.239416 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqmxm\" (UniqueName: \"kubernetes.io/projected/b2ee8100-2db6-4165-97f6-a85ab8c8c6cd-kube-api-access-hqmxm\") pod \"feast-operator-controller-manager-7f46844656-7pg7d\" (UID: \"b2ee8100-2db6-4165-97f6-a85ab8c8c6cd\") " pod="feast-operator-system/feast-operator-controller-manager-7f46844656-7pg7d" May 28 11:10:11.340195 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:10:11.340152 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hqmxm\" (UniqueName: \"kubernetes.io/projected/b2ee8100-2db6-4165-97f6-a85ab8c8c6cd-kube-api-access-hqmxm\") pod \"feast-operator-controller-manager-7f46844656-7pg7d\" (UID: \"b2ee8100-2db6-4165-97f6-a85ab8c8c6cd\") " pod="feast-operator-system/feast-operator-controller-manager-7f46844656-7pg7d" May 28 11:10:11.347877 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:10:11.347847 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqmxm\" (UniqueName: \"kubernetes.io/projected/b2ee8100-2db6-4165-97f6-a85ab8c8c6cd-kube-api-access-hqmxm\") pod \"feast-operator-controller-manager-7f46844656-7pg7d\" (UID: \"b2ee8100-2db6-4165-97f6-a85ab8c8c6cd\") " pod="feast-operator-system/feast-operator-controller-manager-7f46844656-7pg7d" May 28 11:10:11.475099 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:10:11.474975 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7f46844656-7pg7d" May 28 11:10:11.597304 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:10:11.597274 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7f46844656-7pg7d"] May 28 11:10:11.599234 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:10:11.599209 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2ee8100_2db6_4165_97f6_a85ab8c8c6cd.slice/crio-83bfd0d182fb82332660d943c7590d0a1670b873ac3b62ecd1f9101762ac87ca WatchSource:0}: Error finding container 83bfd0d182fb82332660d943c7590d0a1670b873ac3b62ecd1f9101762ac87ca: Status 404 returned error can't find the container with id 83bfd0d182fb82332660d943c7590d0a1670b873ac3b62ecd1f9101762ac87ca May 28 11:10:11.601353 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:10:11.601333 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 11:10:12.585695 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:10:12.585656 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7f46844656-7pg7d" event={"ID":"b2ee8100-2db6-4165-97f6-a85ab8c8c6cd","Type":"ContainerStarted","Data":"83bfd0d182fb82332660d943c7590d0a1670b873ac3b62ecd1f9101762ac87ca"} May 28 11:10:14.592540 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:10:14.592506 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7f46844656-7pg7d" event={"ID":"b2ee8100-2db6-4165-97f6-a85ab8c8c6cd","Type":"ContainerStarted","Data":"c5c7a269255a69ee75008d2f5cd9966b5e6fbe7e751a045cb1d0225cf5f01c8f"} May 28 11:10:14.592984 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:10:14.592640 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-7f46844656-7pg7d" May 28 11:10:14.613554 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:10:14.613497 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-7f46844656-7pg7d" podStartSLOduration=1.051659686 podStartE2EDuration="3.613478704s" podCreationTimestamp="2026-05-28 11:10:11 +0000 UTC" firstStartedPulling="2026-05-28 11:10:11.601488964 +0000 UTC m=+429.843148833" lastFinishedPulling="2026-05-28 11:10:14.163307979 +0000 UTC m=+432.404967851" observedRunningTime="2026-05-28 11:10:14.612600103 +0000 UTC m=+432.854259999" watchObservedRunningTime="2026-05-28 11:10:14.613478704 +0000 UTC m=+432.855138598" May 28 11:10:25.597333 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:10:25.597250 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-7f46844656-7pg7d" May 28 11:11:44.183703 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:44.183669 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5497d86c74-9vc5z"] May 28 11:11:44.186755 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:44.186736 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5497d86c74-9vc5z" May 28 11:11:44.194954 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:44.194929 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5497d86c74-9vc5z"] May 28 11:11:44.346576 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:44.346541 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eefc833f-7dab-47ac-b55a-25a9a3b8f704-console-serving-cert\") pod \"console-5497d86c74-9vc5z\" (UID: \"eefc833f-7dab-47ac-b55a-25a9a3b8f704\") " pod="openshift-console/console-5497d86c74-9vc5z" May 28 11:11:44.346576 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:44.346579 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eefc833f-7dab-47ac-b55a-25a9a3b8f704-oauth-serving-cert\") pod \"console-5497d86c74-9vc5z\" (UID: \"eefc833f-7dab-47ac-b55a-25a9a3b8f704\") " pod="openshift-console/console-5497d86c74-9vc5z" May 28 11:11:44.346808 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:44.346601 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eefc833f-7dab-47ac-b55a-25a9a3b8f704-trusted-ca-bundle\") pod \"console-5497d86c74-9vc5z\" (UID: \"eefc833f-7dab-47ac-b55a-25a9a3b8f704\") " pod="openshift-console/console-5497d86c74-9vc5z" May 28 11:11:44.346808 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:44.346685 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr4tl\" (UniqueName: \"kubernetes.io/projected/eefc833f-7dab-47ac-b55a-25a9a3b8f704-kube-api-access-vr4tl\") pod \"console-5497d86c74-9vc5z\" (UID: \"eefc833f-7dab-47ac-b55a-25a9a3b8f704\") " pod="openshift-console/console-5497d86c74-9vc5z" May 28 11:11:44.346808 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:44.346748 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eefc833f-7dab-47ac-b55a-25a9a3b8f704-console-config\") pod \"console-5497d86c74-9vc5z\" (UID: \"eefc833f-7dab-47ac-b55a-25a9a3b8f704\") " pod="openshift-console/console-5497d86c74-9vc5z" May 28 11:11:44.346808 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:44.346798 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eefc833f-7dab-47ac-b55a-25a9a3b8f704-console-oauth-config\") pod \"console-5497d86c74-9vc5z\" (UID: \"eefc833f-7dab-47ac-b55a-25a9a3b8f704\") " pod="openshift-console/console-5497d86c74-9vc5z" May 28 11:11:44.346974 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:44.346849 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eefc833f-7dab-47ac-b55a-25a9a3b8f704-service-ca\") pod \"console-5497d86c74-9vc5z\" (UID: \"eefc833f-7dab-47ac-b55a-25a9a3b8f704\") " pod="openshift-console/console-5497d86c74-9vc5z" May 28 11:11:44.448033 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:44.447961 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eefc833f-7dab-47ac-b55a-25a9a3b8f704-console-oauth-config\") pod \"console-5497d86c74-9vc5z\" (UID: \"eefc833f-7dab-47ac-b55a-25a9a3b8f704\") " pod="openshift-console/console-5497d86c74-9vc5z" May 28 11:11:44.448033 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:44.448010 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eefc833f-7dab-47ac-b55a-25a9a3b8f704-service-ca\") pod \"console-5497d86c74-9vc5z\" (UID: \"eefc833f-7dab-47ac-b55a-25a9a3b8f704\") " pod="openshift-console/console-5497d86c74-9vc5z" May 28 11:11:44.448282 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:44.448262 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eefc833f-7dab-47ac-b55a-25a9a3b8f704-console-serving-cert\") pod \"console-5497d86c74-9vc5z\" (UID: \"eefc833f-7dab-47ac-b55a-25a9a3b8f704\") " pod="openshift-console/console-5497d86c74-9vc5z" May 28 11:11:44.448349 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:44.448327 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eefc833f-7dab-47ac-b55a-25a9a3b8f704-oauth-serving-cert\") pod \"console-5497d86c74-9vc5z\" (UID: \"eefc833f-7dab-47ac-b55a-25a9a3b8f704\") " pod="openshift-console/console-5497d86c74-9vc5z" May 28 11:11:44.448424 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:44.448405 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eefc833f-7dab-47ac-b55a-25a9a3b8f704-trusted-ca-bundle\") pod \"console-5497d86c74-9vc5z\" (UID: \"eefc833f-7dab-47ac-b55a-25a9a3b8f704\") " pod="openshift-console/console-5497d86c74-9vc5z" May 28 11:11:44.449015 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:44.448692 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vr4tl\" (UniqueName: \"kubernetes.io/projected/eefc833f-7dab-47ac-b55a-25a9a3b8f704-kube-api-access-vr4tl\") pod \"console-5497d86c74-9vc5z\" (UID: \"eefc833f-7dab-47ac-b55a-25a9a3b8f704\") " pod="openshift-console/console-5497d86c74-9vc5z" May 28 11:11:44.449015 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:44.448745 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eefc833f-7dab-47ac-b55a-25a9a3b8f704-console-config\") pod \"console-5497d86c74-9vc5z\" (UID: \"eefc833f-7dab-47ac-b55a-25a9a3b8f704\") " pod="openshift-console/console-5497d86c74-9vc5z" May 28 11:11:44.449015 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:44.448919 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eefc833f-7dab-47ac-b55a-25a9a3b8f704-service-ca\") pod \"console-5497d86c74-9vc5z\" (UID: \"eefc833f-7dab-47ac-b55a-25a9a3b8f704\") " pod="openshift-console/console-5497d86c74-9vc5z" May 28 11:11:44.449293 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:44.449157 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eefc833f-7dab-47ac-b55a-25a9a3b8f704-oauth-serving-cert\") pod \"console-5497d86c74-9vc5z\" (UID: \"eefc833f-7dab-47ac-b55a-25a9a3b8f704\") " pod="openshift-console/console-5497d86c74-9vc5z" May 28 11:11:44.449293 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:44.449252 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eefc833f-7dab-47ac-b55a-25a9a3b8f704-trusted-ca-bundle\") pod \"console-5497d86c74-9vc5z\" (UID: \"eefc833f-7dab-47ac-b55a-25a9a3b8f704\") " pod="openshift-console/console-5497d86c74-9vc5z" May 28 11:11:44.449442 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:44.449421 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eefc833f-7dab-47ac-b55a-25a9a3b8f704-console-config\") pod \"console-5497d86c74-9vc5z\" (UID: \"eefc833f-7dab-47ac-b55a-25a9a3b8f704\") " pod="openshift-console/console-5497d86c74-9vc5z" May 28 11:11:44.450718 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:44.450701 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eefc833f-7dab-47ac-b55a-25a9a3b8f704-console-serving-cert\") pod \"console-5497d86c74-9vc5z\" (UID: \"eefc833f-7dab-47ac-b55a-25a9a3b8f704\") " pod="openshift-console/console-5497d86c74-9vc5z" May 28 11:11:44.450810 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:44.450794 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eefc833f-7dab-47ac-b55a-25a9a3b8f704-console-oauth-config\") pod \"console-5497d86c74-9vc5z\" (UID: \"eefc833f-7dab-47ac-b55a-25a9a3b8f704\") " pod="openshift-console/console-5497d86c74-9vc5z" May 28 11:11:44.459555 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:44.459531 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr4tl\" (UniqueName: \"kubernetes.io/projected/eefc833f-7dab-47ac-b55a-25a9a3b8f704-kube-api-access-vr4tl\") pod \"console-5497d86c74-9vc5z\" (UID: \"eefc833f-7dab-47ac-b55a-25a9a3b8f704\") " pod="openshift-console/console-5497d86c74-9vc5z" May 28 11:11:44.497205 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:44.497181 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5497d86c74-9vc5z" May 28 11:11:44.615813 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:44.615662 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5497d86c74-9vc5z"] May 28 11:11:44.618340 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:11:44.618312 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeefc833f_7dab_47ac_b55a_25a9a3b8f704.slice/crio-95daf8d99f1333f9242d97a7651abb93ae1cb42439b3ee9ce1d5768ae82beb06 WatchSource:0}: Error finding container 95daf8d99f1333f9242d97a7651abb93ae1cb42439b3ee9ce1d5768ae82beb06: Status 404 returned error can't find the container with id 95daf8d99f1333f9242d97a7651abb93ae1cb42439b3ee9ce1d5768ae82beb06 May 28 11:11:44.839137 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:44.839101 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5497d86c74-9vc5z" event={"ID":"eefc833f-7dab-47ac-b55a-25a9a3b8f704","Type":"ContainerStarted","Data":"a37e1f38f4c5516a2be50ccb0dacb3495d88ff1274a5de98dcd559b8e8bd1396"} May 28 11:11:44.839137 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:44.839141 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5497d86c74-9vc5z" event={"ID":"eefc833f-7dab-47ac-b55a-25a9a3b8f704","Type":"ContainerStarted","Data":"95daf8d99f1333f9242d97a7651abb93ae1cb42439b3ee9ce1d5768ae82beb06"} May 28 11:11:44.857240 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:44.857194 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5497d86c74-9vc5z" podStartSLOduration=0.857180254 podStartE2EDuration="857.180254ms" podCreationTimestamp="2026-05-28 11:11:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 11:11:44.856630062 +0000 UTC m=+523.098289957" watchObservedRunningTime="2026-05-28 11:11:44.857180254 +0000 UTC m=+523.098840147" May 28 11:11:54.497811 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:54.497773 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5497d86c74-9vc5z" May 28 11:11:54.497811 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:54.497819 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5497d86c74-9vc5z" May 28 11:11:54.502679 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:54.502659 2551 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5497d86c74-9vc5z" May 28 11:11:54.869792 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:54.869764 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5497d86c74-9vc5z" May 28 11:11:54.916243 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:11:54.916209 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65ff78ddb8-6zz8s"] May 28 11:12:19.934567 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:19.934529 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-65ff78ddb8-6zz8s" podUID="3df563a4-8d0a-4f61-ba73-82a0ae1de7fa" containerName="console" containerID="cri-o://bd9e4db2fcc091b45b3ac9e4d3b157e37ec8f9f79022efe7f9dc5fd2ad4765d2" gracePeriod=15 May 28 11:12:20.160686 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.160657 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65ff78ddb8-6zz8s_3df563a4-8d0a-4f61-ba73-82a0ae1de7fa/console/0.log" May 28 11:12:20.160794 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.160716 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65ff78ddb8-6zz8s" May 28 11:12:20.217231 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.217152 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dswnh\" (UniqueName: \"kubernetes.io/projected/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-kube-api-access-dswnh\") pod \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\" (UID: \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\") " May 28 11:12:20.217231 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.217186 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-console-config\") pod \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\" (UID: \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\") " May 28 11:12:20.217231 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.217205 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-console-oauth-config\") pod \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\" (UID: \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\") " May 28 11:12:20.217231 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.217231 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-trusted-ca-bundle\") pod \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\" (UID: \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\") " May 28 11:12:20.217538 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.217282 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-console-serving-cert\") pod \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\" (UID: \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\") " May 28 11:12:20.217538 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.217305 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-service-ca\") pod \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\" (UID: \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\") " May 28 11:12:20.217538 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.217332 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-oauth-serving-cert\") pod \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\" (UID: \"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa\") " May 28 11:12:20.217745 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.217639 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-console-config" (OuterVolumeSpecName: "console-config") pod "3df563a4-8d0a-4f61-ba73-82a0ae1de7fa" (UID: "3df563a4-8d0a-4f61-ba73-82a0ae1de7fa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 11:12:20.217745 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.217734 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3df563a4-8d0a-4f61-ba73-82a0ae1de7fa" (UID: "3df563a4-8d0a-4f61-ba73-82a0ae1de7fa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 11:12:20.217881 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.217751 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-service-ca" (OuterVolumeSpecName: "service-ca") pod "3df563a4-8d0a-4f61-ba73-82a0ae1de7fa" (UID: "3df563a4-8d0a-4f61-ba73-82a0ae1de7fa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 11:12:20.217881 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.217799 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3df563a4-8d0a-4f61-ba73-82a0ae1de7fa" (UID: "3df563a4-8d0a-4f61-ba73-82a0ae1de7fa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 28 11:12:20.219344 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.219312 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3df563a4-8d0a-4f61-ba73-82a0ae1de7fa" (UID: "3df563a4-8d0a-4f61-ba73-82a0ae1de7fa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 11:12:20.219441 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.219348 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3df563a4-8d0a-4f61-ba73-82a0ae1de7fa" (UID: "3df563a4-8d0a-4f61-ba73-82a0ae1de7fa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 28 11:12:20.219441 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.219369 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-kube-api-access-dswnh" (OuterVolumeSpecName: "kube-api-access-dswnh") pod "3df563a4-8d0a-4f61-ba73-82a0ae1de7fa" (UID: "3df563a4-8d0a-4f61-ba73-82a0ae1de7fa"). InnerVolumeSpecName "kube-api-access-dswnh". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 11:12:20.318734 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.318698 2551 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-console-serving-cert\") on node \"ip-10-0-130-105.ec2.internal\" DevicePath \"\"" May 28 11:12:20.318734 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.318726 2551 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-service-ca\") on node \"ip-10-0-130-105.ec2.internal\" DevicePath \"\"" May 28 11:12:20.318734 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.318740 2551 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-oauth-serving-cert\") on node \"ip-10-0-130-105.ec2.internal\" DevicePath \"\"" May 28 11:12:20.318950 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.318753 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dswnh\" (UniqueName: \"kubernetes.io/projected/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-kube-api-access-dswnh\") on node \"ip-10-0-130-105.ec2.internal\" DevicePath \"\"" May 28 11:12:20.318950 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.318766 2551 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-console-config\") on node \"ip-10-0-130-105.ec2.internal\" DevicePath \"\"" May 28 11:12:20.318950 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.318778 2551 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-console-oauth-config\") on node \"ip-10-0-130-105.ec2.internal\" DevicePath \"\"" May 28 11:12:20.318950 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.318788 2551 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa-trusted-ca-bundle\") on node \"ip-10-0-130-105.ec2.internal\" DevicePath \"\"" May 28 11:12:20.941277 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.941245 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65ff78ddb8-6zz8s_3df563a4-8d0a-4f61-ba73-82a0ae1de7fa/console/0.log" May 28 11:12:20.941692 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.941289 2551 generic.go:358] "Generic (PLEG): container finished" podID="3df563a4-8d0a-4f61-ba73-82a0ae1de7fa" containerID="bd9e4db2fcc091b45b3ac9e4d3b157e37ec8f9f79022efe7f9dc5fd2ad4765d2" exitCode=2 May 28 11:12:20.941692 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.941375 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65ff78ddb8-6zz8s" May 28 11:12:20.941692 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.941371 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65ff78ddb8-6zz8s" event={"ID":"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa","Type":"ContainerDied","Data":"bd9e4db2fcc091b45b3ac9e4d3b157e37ec8f9f79022efe7f9dc5fd2ad4765d2"} May 28 11:12:20.941692 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.941479 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65ff78ddb8-6zz8s" event={"ID":"3df563a4-8d0a-4f61-ba73-82a0ae1de7fa","Type":"ContainerDied","Data":"89a4a69c8a88cd03badb43bf833d242d8d7def702f7663d63d92a81ec01133f7"} May 28 11:12:20.941692 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.941495 2551 scope.go:117] "RemoveContainer" containerID="bd9e4db2fcc091b45b3ac9e4d3b157e37ec8f9f79022efe7f9dc5fd2ad4765d2" May 28 11:12:20.948786 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.948768 2551 scope.go:117] "RemoveContainer" containerID="bd9e4db2fcc091b45b3ac9e4d3b157e37ec8f9f79022efe7f9dc5fd2ad4765d2" May 28 11:12:20.949029 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:12:20.949010 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd9e4db2fcc091b45b3ac9e4d3b157e37ec8f9f79022efe7f9dc5fd2ad4765d2\": container with ID starting with bd9e4db2fcc091b45b3ac9e4d3b157e37ec8f9f79022efe7f9dc5fd2ad4765d2 not found: ID does not exist" containerID="bd9e4db2fcc091b45b3ac9e4d3b157e37ec8f9f79022efe7f9dc5fd2ad4765d2" May 28 11:12:20.949132 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.949040 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd9e4db2fcc091b45b3ac9e4d3b157e37ec8f9f79022efe7f9dc5fd2ad4765d2"} err="failed to get container status \"bd9e4db2fcc091b45b3ac9e4d3b157e37ec8f9f79022efe7f9dc5fd2ad4765d2\": rpc error: code = NotFound desc = could not find container \"bd9e4db2fcc091b45b3ac9e4d3b157e37ec8f9f79022efe7f9dc5fd2ad4765d2\": container with ID starting with bd9e4db2fcc091b45b3ac9e4d3b157e37ec8f9f79022efe7f9dc5fd2ad4765d2 not found: ID does not exist" May 28 11:12:20.958973 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.958954 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65ff78ddb8-6zz8s"] May 28 11:12:20.961377 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:20.961351 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65ff78ddb8-6zz8s"] May 28 11:12:22.359992 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:12:22.359951 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3df563a4-8d0a-4f61-ba73-82a0ae1de7fa" path="/var/lib/kubelet/pods/3df563a4-8d0a-4f61-ba73-82a0ae1de7fa/volumes" May 28 11:22:24.545252 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:24.545160 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7f46844656-7pg7d"] May 28 11:22:24.545855 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:24.545465 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-7f46844656-7pg7d" podUID="b2ee8100-2db6-4165-97f6-a85ab8c8c6cd" containerName="manager" containerID="cri-o://c5c7a269255a69ee75008d2f5cd9966b5e6fbe7e751a045cb1d0225cf5f01c8f" gracePeriod=10 May 28 11:22:24.811901 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:24.811870 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7f46844656-7pg7d" May 28 11:22:24.904252 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:24.904224 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqmxm\" (UniqueName: \"kubernetes.io/projected/b2ee8100-2db6-4165-97f6-a85ab8c8c6cd-kube-api-access-hqmxm\") pod \"b2ee8100-2db6-4165-97f6-a85ab8c8c6cd\" (UID: \"b2ee8100-2db6-4165-97f6-a85ab8c8c6cd\") " May 28 11:22:24.906348 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:24.906312 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2ee8100-2db6-4165-97f6-a85ab8c8c6cd-kube-api-access-hqmxm" (OuterVolumeSpecName: "kube-api-access-hqmxm") pod "b2ee8100-2db6-4165-97f6-a85ab8c8c6cd" (UID: "b2ee8100-2db6-4165-97f6-a85ab8c8c6cd"). InnerVolumeSpecName "kube-api-access-hqmxm". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 11:22:25.005128 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:25.005099 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqmxm\" (UniqueName: \"kubernetes.io/projected/b2ee8100-2db6-4165-97f6-a85ab8c8c6cd-kube-api-access-hqmxm\") on node \"ip-10-0-130-105.ec2.internal\" DevicePath \"\"" May 28 11:22:25.557894 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:25.557854 2551 generic.go:358] "Generic (PLEG): container finished" podID="b2ee8100-2db6-4165-97f6-a85ab8c8c6cd" containerID="c5c7a269255a69ee75008d2f5cd9966b5e6fbe7e751a045cb1d0225cf5f01c8f" exitCode=0 May 28 11:22:25.558339 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:25.557917 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7f46844656-7pg7d" May 28 11:22:25.558339 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:25.557921 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7f46844656-7pg7d" event={"ID":"b2ee8100-2db6-4165-97f6-a85ab8c8c6cd","Type":"ContainerDied","Data":"c5c7a269255a69ee75008d2f5cd9966b5e6fbe7e751a045cb1d0225cf5f01c8f"} May 28 11:22:25.558339 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:25.557954 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7f46844656-7pg7d" event={"ID":"b2ee8100-2db6-4165-97f6-a85ab8c8c6cd","Type":"ContainerDied","Data":"83bfd0d182fb82332660d943c7590d0a1670b873ac3b62ecd1f9101762ac87ca"} May 28 11:22:25.558339 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:25.557972 2551 scope.go:117] "RemoveContainer" containerID="c5c7a269255a69ee75008d2f5cd9966b5e6fbe7e751a045cb1d0225cf5f01c8f" May 28 11:22:25.565639 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:25.565292 2551 scope.go:117] "RemoveContainer" containerID="c5c7a269255a69ee75008d2f5cd9966b5e6fbe7e751a045cb1d0225cf5f01c8f" May 28 11:22:25.565639 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:22:25.565604 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5c7a269255a69ee75008d2f5cd9966b5e6fbe7e751a045cb1d0225cf5f01c8f\": container with ID starting with c5c7a269255a69ee75008d2f5cd9966b5e6fbe7e751a045cb1d0225cf5f01c8f not found: ID does not exist" containerID="c5c7a269255a69ee75008d2f5cd9966b5e6fbe7e751a045cb1d0225cf5f01c8f" May 28 11:22:25.565760 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:25.565637 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5c7a269255a69ee75008d2f5cd9966b5e6fbe7e751a045cb1d0225cf5f01c8f"} err="failed to get container status \"c5c7a269255a69ee75008d2f5cd9966b5e6fbe7e751a045cb1d0225cf5f01c8f\": rpc error: code = NotFound desc = could not find container \"c5c7a269255a69ee75008d2f5cd9966b5e6fbe7e751a045cb1d0225cf5f01c8f\": container with ID starting with c5c7a269255a69ee75008d2f5cd9966b5e6fbe7e751a045cb1d0225cf5f01c8f not found: ID does not exist" May 28 11:22:25.578439 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:25.578415 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7f46844656-7pg7d"] May 28 11:22:25.582792 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:25.582769 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7f46844656-7pg7d"] May 28 11:22:26.358780 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:26.358748 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2ee8100-2db6-4165-97f6-a85ab8c8c6cd" path="/var/lib/kubelet/pods/b2ee8100-2db6-4165-97f6-a85ab8c8c6cd/volumes" May 28 11:22:36.168090 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:36.168024 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-ddqlz"] May 28 11:22:36.168693 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:36.168580 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3df563a4-8d0a-4f61-ba73-82a0ae1de7fa" containerName="console" May 28 11:22:36.168693 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:36.168600 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="3df563a4-8d0a-4f61-ba73-82a0ae1de7fa" containerName="console" May 28 11:22:36.168693 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:36.168634 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2ee8100-2db6-4165-97f6-a85ab8c8c6cd" containerName="manager" May 28 11:22:36.168693 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:36.168643 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2ee8100-2db6-4165-97f6-a85ab8c8c6cd" containerName="manager" May 28 11:22:36.168973 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:36.168739 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="b2ee8100-2db6-4165-97f6-a85ab8c8c6cd" containerName="manager" May 28 11:22:36.168973 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:36.168754 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="3df563a4-8d0a-4f61-ba73-82a0ae1de7fa" containerName="console" May 28 11:22:36.171795 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:36.171775 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-ddqlz" May 28 11:22:36.174749 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:36.174716 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-6ffjh\"" May 28 11:22:36.175671 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:36.175656 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" May 28 11:22:36.175757 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:36.175679 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" May 28 11:22:36.183157 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:36.183138 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-ddqlz"] May 28 11:22:36.292278 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:36.292249 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bftsf\" (UniqueName: \"kubernetes.io/projected/a13aa866-e18e-4bd1-a2da-ea73434e4581-kube-api-access-bftsf\") pod \"feast-operator-controller-manager-cf99db75-ddqlz\" (UID: \"a13aa866-e18e-4bd1-a2da-ea73434e4581\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-ddqlz" May 28 11:22:36.392651 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:36.392613 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bftsf\" (UniqueName: \"kubernetes.io/projected/a13aa866-e18e-4bd1-a2da-ea73434e4581-kube-api-access-bftsf\") pod \"feast-operator-controller-manager-cf99db75-ddqlz\" (UID: \"a13aa866-e18e-4bd1-a2da-ea73434e4581\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-ddqlz" May 28 11:22:36.402725 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:36.402694 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bftsf\" (UniqueName: \"kubernetes.io/projected/a13aa866-e18e-4bd1-a2da-ea73434e4581-kube-api-access-bftsf\") pod \"feast-operator-controller-manager-cf99db75-ddqlz\" (UID: \"a13aa866-e18e-4bd1-a2da-ea73434e4581\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-ddqlz" May 28 11:22:36.481756 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:36.481678 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-ddqlz" May 28 11:22:36.606283 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:36.606253 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-ddqlz"] May 28 11:22:36.609100 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:22:36.609072 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda13aa866_e18e_4bd1_a2da_ea73434e4581.slice/crio-698c32aca96cb85c9e50a9f0c567c36956404eef9aef250182f8f436ae26e2d7 WatchSource:0}: Error finding container 698c32aca96cb85c9e50a9f0c567c36956404eef9aef250182f8f436ae26e2d7: Status 404 returned error can't find the container with id 698c32aca96cb85c9e50a9f0c567c36956404eef9aef250182f8f436ae26e2d7 May 28 11:22:36.610848 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:36.610827 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 11:22:37.592627 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:37.592586 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-ddqlz" event={"ID":"a13aa866-e18e-4bd1-a2da-ea73434e4581","Type":"ContainerStarted","Data":"698c32aca96cb85c9e50a9f0c567c36956404eef9aef250182f8f436ae26e2d7"} May 28 11:22:39.601161 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:39.601129 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-ddqlz" event={"ID":"a13aa866-e18e-4bd1-a2da-ea73434e4581","Type":"ContainerStarted","Data":"8d86c648a2538eb7346b0b389295aee9e80dec2a252f1ab8d486602ecc8120be"} May 28 11:22:39.601523 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:39.601180 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-ddqlz" May 28 11:22:39.619076 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:39.619016 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-ddqlz" podStartSLOduration=1.6257134930000001 podStartE2EDuration="3.619003159s" podCreationTimestamp="2026-05-28 11:22:36 +0000 UTC" firstStartedPulling="2026-05-28 11:22:36.610956859 +0000 UTC m=+1174.852616730" lastFinishedPulling="2026-05-28 11:22:38.604246512 +0000 UTC m=+1176.845906396" observedRunningTime="2026-05-28 11:22:39.618585492 +0000 UTC m=+1177.860245385" watchObservedRunningTime="2026-05-28 11:22:39.619003159 +0000 UTC m=+1177.860663082" May 28 11:22:50.605081 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:22:50.605034 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-ddqlz" May 28 11:28:04.401722 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:04.401685 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-ddqlz"] May 28 11:28:04.402233 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:04.401963 2551 kuberuntime_container.go:864] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-ddqlz" podUID="a13aa866-e18e-4bd1-a2da-ea73434e4581" containerName="manager" containerID="cri-o://8d86c648a2538eb7346b0b389295aee9e80dec2a252f1ab8d486602ecc8120be" gracePeriod=10 May 28 11:28:04.638077 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:04.638041 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-ddqlz" May 28 11:28:04.754047 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:04.753951 2551 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bftsf\" (UniqueName: \"kubernetes.io/projected/a13aa866-e18e-4bd1-a2da-ea73434e4581-kube-api-access-bftsf\") pod \"a13aa866-e18e-4bd1-a2da-ea73434e4581\" (UID: \"a13aa866-e18e-4bd1-a2da-ea73434e4581\") " May 28 11:28:04.756099 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:04.756056 2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a13aa866-e18e-4bd1-a2da-ea73434e4581-kube-api-access-bftsf" (OuterVolumeSpecName: "kube-api-access-bftsf") pod "a13aa866-e18e-4bd1-a2da-ea73434e4581" (UID: "a13aa866-e18e-4bd1-a2da-ea73434e4581"). InnerVolumeSpecName "kube-api-access-bftsf". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 28 11:28:04.855188 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:04.855153 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bftsf\" (UniqueName: \"kubernetes.io/projected/a13aa866-e18e-4bd1-a2da-ea73434e4581-kube-api-access-bftsf\") on node \"ip-10-0-130-105.ec2.internal\" DevicePath \"\"" May 28 11:28:05.474038 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:05.474004 2551 generic.go:358] "Generic (PLEG): container finished" podID="a13aa866-e18e-4bd1-a2da-ea73434e4581" containerID="8d86c648a2538eb7346b0b389295aee9e80dec2a252f1ab8d486602ecc8120be" exitCode=0 May 28 11:28:05.474488 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:05.474046 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-ddqlz" event={"ID":"a13aa866-e18e-4bd1-a2da-ea73434e4581","Type":"ContainerDied","Data":"8d86c648a2538eb7346b0b389295aee9e80dec2a252f1ab8d486602ecc8120be"} May 28 11:28:05.474488 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:05.474088 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-ddqlz" event={"ID":"a13aa866-e18e-4bd1-a2da-ea73434e4581","Type":"ContainerDied","Data":"698c32aca96cb85c9e50a9f0c567c36956404eef9aef250182f8f436ae26e2d7"} May 28 11:28:05.474488 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:05.474095 2551 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-ddqlz" May 28 11:28:05.474488 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:05.474103 2551 scope.go:117] "RemoveContainer" containerID="8d86c648a2538eb7346b0b389295aee9e80dec2a252f1ab8d486602ecc8120be" May 28 11:28:05.481484 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:05.481466 2551 scope.go:117] "RemoveContainer" containerID="8d86c648a2538eb7346b0b389295aee9e80dec2a252f1ab8d486602ecc8120be" May 28 11:28:05.481710 ip-10-0-130-105 kubenswrapper[2551]: E0528 11:28:05.481691 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d86c648a2538eb7346b0b389295aee9e80dec2a252f1ab8d486602ecc8120be\": container with ID starting with 8d86c648a2538eb7346b0b389295aee9e80dec2a252f1ab8d486602ecc8120be not found: ID does not exist" containerID="8d86c648a2538eb7346b0b389295aee9e80dec2a252f1ab8d486602ecc8120be" May 28 11:28:05.481780 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:05.481719 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d86c648a2538eb7346b0b389295aee9e80dec2a252f1ab8d486602ecc8120be"} err="failed to get container status \"8d86c648a2538eb7346b0b389295aee9e80dec2a252f1ab8d486602ecc8120be\": rpc error: code = NotFound desc = could not find container \"8d86c648a2538eb7346b0b389295aee9e80dec2a252f1ab8d486602ecc8120be\": container with ID starting with 8d86c648a2538eb7346b0b389295aee9e80dec2a252f1ab8d486602ecc8120be not found: ID does not exist" May 28 11:28:05.507236 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:05.507208 2551 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-ddqlz"] May 28 11:28:05.515908 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:05.515880 2551 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-ddqlz"] May 28 11:28:06.358457 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:06.358426 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a13aa866-e18e-4bd1-a2da-ea73434e4581" path="/var/lib/kubelet/pods/a13aa866-e18e-4bd1-a2da-ea73434e4581/volumes" May 28 11:28:08.893758 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:08.893724 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-j2d6g"] May 28 11:28:08.894150 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:08.893990 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a13aa866-e18e-4bd1-a2da-ea73434e4581" containerName="manager" May 28 11:28:08.894150 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:08.894000 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="a13aa866-e18e-4bd1-a2da-ea73434e4581" containerName="manager" May 28 11:28:08.894150 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:08.894048 2551 memory_manager.go:356] "RemoveStaleState removing state" podUID="a13aa866-e18e-4bd1-a2da-ea73434e4581" containerName="manager" May 28 11:28:08.896770 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:08.896754 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-j2d6g" May 28 11:28:08.899470 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:08.899446 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" May 28 11:28:08.899583 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:08.899469 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-6ffjh\"" May 28 11:28:08.900515 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:08.900499 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" May 28 11:28:08.911631 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:08.911609 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-j2d6g"] May 28 11:28:08.984413 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:08.984386 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkkft\" (UniqueName: \"kubernetes.io/projected/bac11f45-19dd-4bbb-9dae-88c5db0deee0-kube-api-access-xkkft\") pod \"feast-operator-controller-manager-cf99db75-j2d6g\" (UID: \"bac11f45-19dd-4bbb-9dae-88c5db0deee0\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-j2d6g" May 28 11:28:09.085243 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:09.085213 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xkkft\" (UniqueName: \"kubernetes.io/projected/bac11f45-19dd-4bbb-9dae-88c5db0deee0-kube-api-access-xkkft\") pod \"feast-operator-controller-manager-cf99db75-j2d6g\" (UID: \"bac11f45-19dd-4bbb-9dae-88c5db0deee0\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-j2d6g" May 28 11:28:09.094588 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:09.094551 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkkft\" (UniqueName: \"kubernetes.io/projected/bac11f45-19dd-4bbb-9dae-88c5db0deee0-kube-api-access-xkkft\") pod \"feast-operator-controller-manager-cf99db75-j2d6g\" (UID: \"bac11f45-19dd-4bbb-9dae-88c5db0deee0\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-j2d6g" May 28 11:28:09.206852 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:09.206779 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-j2d6g" May 28 11:28:09.325124 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:09.325093 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-j2d6g"] May 28 11:28:09.328523 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:28:09.328490 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbac11f45_19dd_4bbb_9dae_88c5db0deee0.slice/crio-0d1e0f3e63d7b24f4817f42abd66e724d98b70f839aa5e3b6ec3f5e9ed1475ef WatchSource:0}: Error finding container 0d1e0f3e63d7b24f4817f42abd66e724d98b70f839aa5e3b6ec3f5e9ed1475ef: Status 404 returned error can't find the container with id 0d1e0f3e63d7b24f4817f42abd66e724d98b70f839aa5e3b6ec3f5e9ed1475ef May 28 11:28:09.330258 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:09.330240 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 11:28:09.486500 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:09.486420 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-j2d6g" event={"ID":"bac11f45-19dd-4bbb-9dae-88c5db0deee0","Type":"ContainerStarted","Data":"df268064c34d5e07285487463d84e79a16c18bd7b0ad8b60a8d89f668947fb3e"} May 28 11:28:09.486500 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:09.486457 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-j2d6g" event={"ID":"bac11f45-19dd-4bbb-9dae-88c5db0deee0","Type":"ContainerStarted","Data":"0d1e0f3e63d7b24f4817f42abd66e724d98b70f839aa5e3b6ec3f5e9ed1475ef"} May 28 11:28:09.486753 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:09.486543 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-j2d6g" May 28 11:28:09.517094 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:09.517041 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-j2d6g" podStartSLOduration=1.5170289000000001 podStartE2EDuration="1.5170289s" podCreationTimestamp="2026-05-28 11:28:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 11:28:09.515905279 +0000 UTC m=+1507.757565171" watchObservedRunningTime="2026-05-28 11:28:09.5170289 +0000 UTC m=+1507.758688792" May 28 11:28:20.491650 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:28:20.491622 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-j2d6g" May 28 11:33:36.139708 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:36.139674 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f968n/must-gather-ls8xz"] May 28 11:33:36.142784 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:36.142764 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f968n/must-gather-ls8xz" May 28 11:33:36.145423 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:36.145404 2551 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-f968n\"/\"default-dockercfg-vc2f4\"" May 28 11:33:36.145523 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:36.145444 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f968n\"/\"kube-root-ca.crt\"" May 28 11:33:36.146285 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:36.146265 2551 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f968n\"/\"openshift-service-ca.crt\"" May 28 11:33:36.149397 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:36.149377 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f968n/must-gather-ls8xz"] May 28 11:33:36.205273 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:36.205239 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b53254cd-cee3-47e0-8019-be33e8153934-must-gather-output\") pod \"must-gather-ls8xz\" (UID: \"b53254cd-cee3-47e0-8019-be33e8153934\") " pod="openshift-must-gather-f968n/must-gather-ls8xz" May 28 11:33:36.205460 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:36.205354 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8bjd\" (UniqueName: \"kubernetes.io/projected/b53254cd-cee3-47e0-8019-be33e8153934-kube-api-access-k8bjd\") pod \"must-gather-ls8xz\" (UID: \"b53254cd-cee3-47e0-8019-be33e8153934\") " pod="openshift-must-gather-f968n/must-gather-ls8xz" May 28 11:33:36.306644 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:36.306597 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k8bjd\" (UniqueName: \"kubernetes.io/projected/b53254cd-cee3-47e0-8019-be33e8153934-kube-api-access-k8bjd\") pod \"must-gather-ls8xz\" (UID: \"b53254cd-cee3-47e0-8019-be33e8153934\") " pod="openshift-must-gather-f968n/must-gather-ls8xz" May 28 11:33:36.306644 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:36.306656 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b53254cd-cee3-47e0-8019-be33e8153934-must-gather-output\") pod \"must-gather-ls8xz\" (UID: \"b53254cd-cee3-47e0-8019-be33e8153934\") " pod="openshift-must-gather-f968n/must-gather-ls8xz" May 28 11:33:36.306952 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:36.306936 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b53254cd-cee3-47e0-8019-be33e8153934-must-gather-output\") pod \"must-gather-ls8xz\" (UID: \"b53254cd-cee3-47e0-8019-be33e8153934\") " pod="openshift-must-gather-f968n/must-gather-ls8xz" May 28 11:33:36.316572 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:36.316542 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8bjd\" (UniqueName: \"kubernetes.io/projected/b53254cd-cee3-47e0-8019-be33e8153934-kube-api-access-k8bjd\") pod \"must-gather-ls8xz\" (UID: \"b53254cd-cee3-47e0-8019-be33e8153934\") " pod="openshift-must-gather-f968n/must-gather-ls8xz" May 28 11:33:36.452728 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:36.452630 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f968n/must-gather-ls8xz" May 28 11:33:36.574135 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:36.573901 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f968n/must-gather-ls8xz"] May 28 11:33:36.576308 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:33:36.576276 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb53254cd_cee3_47e0_8019_be33e8153934.slice/crio-b2640dcecd5834fdd1aae0d9af18bb8ad84c6ec34d2b34dfb84939c66be6fd95 WatchSource:0}: Error finding container b2640dcecd5834fdd1aae0d9af18bb8ad84c6ec34d2b34dfb84939c66be6fd95: Status 404 returned error can't find the container with id b2640dcecd5834fdd1aae0d9af18bb8ad84c6ec34d2b34dfb84939c66be6fd95 May 28 11:33:36.578039 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:36.578018 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 28 11:33:37.340627 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:37.340588 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f968n/must-gather-ls8xz" event={"ID":"b53254cd-cee3-47e0-8019-be33e8153934","Type":"ContainerStarted","Data":"b2640dcecd5834fdd1aae0d9af18bb8ad84c6ec34d2b34dfb84939c66be6fd95"} May 28 11:33:38.345508 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:38.345469 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f968n/must-gather-ls8xz" event={"ID":"b53254cd-cee3-47e0-8019-be33e8153934","Type":"ContainerStarted","Data":"c5e2fe46292993898a33264f1b646d2659400a6a4f0dc2d6fc23f771e5fb1bdd"} May 28 11:33:38.345508 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:38.345509 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f968n/must-gather-ls8xz" event={"ID":"b53254cd-cee3-47e0-8019-be33e8153934","Type":"ContainerStarted","Data":"f271192b120471578568effba5ee7614028b89bf1da42b789e5395a36ff82eff"} May 28 11:33:38.361804 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:38.361753 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-f968n/must-gather-ls8xz" podStartSLOduration=1.582632965 podStartE2EDuration="2.361738368s" podCreationTimestamp="2026-05-28 11:33:36 +0000 UTC" firstStartedPulling="2026-05-28 11:33:36.578168722 +0000 UTC m=+1834.819828591" lastFinishedPulling="2026-05-28 11:33:37.357274124 +0000 UTC m=+1835.598933994" observedRunningTime="2026-05-28 11:33:38.360475637 +0000 UTC m=+1836.602135530" watchObservedRunningTime="2026-05-28 11:33:38.361738368 +0000 UTC m=+1836.603398312" May 28 11:33:38.691698 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:38.691627 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pn6f9_c1bc63dc-1a2b-4366-9a88-7c97526f0367/global-pull-secret-syncer/0.log" May 28 11:33:38.839621 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:38.839582 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-t9hpt_aa7c8f3e-9641-416a-bf97-1b3cd1f94cb8/konnectivity-agent/0.log" May 28 11:33:38.861950 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:38.861924 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-105.ec2.internal_bfe7c384ac44926637b571b166b49362/haproxy/0.log" May 28 11:33:42.182540 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:42.182489 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-ckpdn_f8d9f255-d921-4f5f-8206-a936c35d7701/kube-state-metrics/0.log" May 28 11:33:42.200325 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:42.200259 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-ckpdn_f8d9f255-d921-4f5f-8206-a936c35d7701/kube-rbac-proxy-main/0.log" May 28 11:33:42.219680 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:42.219647 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-ckpdn_f8d9f255-d921-4f5f-8206-a936c35d7701/kube-rbac-proxy-self/0.log" May 28 11:33:42.252339 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:42.252308 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6b89b46767-7d4vk_801e2a7b-f30f-42d2-bc50-e4b3a65f5525/metrics-server/0.log" May 28 11:33:42.305048 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:42.304982 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4q9t4_c813f946-77a5-495a-b9fc-d2561ae25f56/node-exporter/0.log" May 28 11:33:42.326080 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:42.326041 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4q9t4_c813f946-77a5-495a-b9fc-d2561ae25f56/kube-rbac-proxy/0.log" May 28 11:33:42.347426 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:42.347400 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4q9t4_c813f946-77a5-495a-b9fc-d2561ae25f56/init-textfile/0.log" May 28 11:33:42.979182 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:42.979140 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-679cb7bfbc-hd7zw_0a64a45c-25e3-42c1-b1e0-36a55fee8e70/thanos-query/0.log" May 28 11:33:42.999955 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:42.999928 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-679cb7bfbc-hd7zw_0a64a45c-25e3-42c1-b1e0-36a55fee8e70/kube-rbac-proxy-web/0.log" May 28 11:33:43.020739 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:43.020711 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-679cb7bfbc-hd7zw_0a64a45c-25e3-42c1-b1e0-36a55fee8e70/kube-rbac-proxy/0.log" May 28 11:33:43.042926 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:43.042895 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-679cb7bfbc-hd7zw_0a64a45c-25e3-42c1-b1e0-36a55fee8e70/prom-label-proxy/0.log" May 28 11:33:43.070766 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:43.070732 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-679cb7bfbc-hd7zw_0a64a45c-25e3-42c1-b1e0-36a55fee8e70/kube-rbac-proxy-rules/0.log" May 28 11:33:43.093085 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:43.093029 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-679cb7bfbc-hd7zw_0a64a45c-25e3-42c1-b1e0-36a55fee8e70/kube-rbac-proxy-metrics/0.log" May 28 11:33:44.912289 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:44.912263 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5497d86c74-9vc5z_eefc833f-7dab-47ac-b55a-25a9a3b8f704/console/0.log" May 28 11:33:45.166115 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:45.166018 2551 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f968n/perf-node-gather-daemonset-h7zzq"] May 28 11:33:45.169124 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:45.169098 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f968n/perf-node-gather-daemonset-h7zzq" May 28 11:33:45.180340 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:45.180316 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f968n/perf-node-gather-daemonset-h7zzq"] May 28 11:33:45.289339 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:45.289283 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84a94cd3-ac7e-403f-bbce-cf831b3edca0-proc\") pod \"perf-node-gather-daemonset-h7zzq\" (UID: \"84a94cd3-ac7e-403f-bbce-cf831b3edca0\") " pod="openshift-must-gather-f968n/perf-node-gather-daemonset-h7zzq" May 28 11:33:45.289610 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:45.289586 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84a94cd3-ac7e-403f-bbce-cf831b3edca0-lib-modules\") pod \"perf-node-gather-daemonset-h7zzq\" (UID: \"84a94cd3-ac7e-403f-bbce-cf831b3edca0\") " pod="openshift-must-gather-f968n/perf-node-gather-daemonset-h7zzq" May 28 11:33:45.289774 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:45.289754 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84a94cd3-ac7e-403f-bbce-cf831b3edca0-sys\") pod \"perf-node-gather-daemonset-h7zzq\" (UID: \"84a94cd3-ac7e-403f-bbce-cf831b3edca0\") " pod="openshift-must-gather-f968n/perf-node-gather-daemonset-h7zzq" May 28 11:33:45.289848 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:45.289805 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9g86\" (UniqueName: \"kubernetes.io/projected/84a94cd3-ac7e-403f-bbce-cf831b3edca0-kube-api-access-d9g86\") pod \"perf-node-gather-daemonset-h7zzq\" (UID: \"84a94cd3-ac7e-403f-bbce-cf831b3edca0\") " pod="openshift-must-gather-f968n/perf-node-gather-daemonset-h7zzq" May 28 11:33:45.289925 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:45.289903 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84a94cd3-ac7e-403f-bbce-cf831b3edca0-podres\") pod \"perf-node-gather-daemonset-h7zzq\" (UID: \"84a94cd3-ac7e-403f-bbce-cf831b3edca0\") " pod="openshift-must-gather-f968n/perf-node-gather-daemonset-h7zzq" May 28 11:33:45.390821 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:45.390786 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84a94cd3-ac7e-403f-bbce-cf831b3edca0-proc\") pod \"perf-node-gather-daemonset-h7zzq\" (UID: \"84a94cd3-ac7e-403f-bbce-cf831b3edca0\") " pod="openshift-must-gather-f968n/perf-node-gather-daemonset-h7zzq" May 28 11:33:45.390821 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:45.390823 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84a94cd3-ac7e-403f-bbce-cf831b3edca0-lib-modules\") pod \"perf-node-gather-daemonset-h7zzq\" (UID: \"84a94cd3-ac7e-403f-bbce-cf831b3edca0\") " pod="openshift-must-gather-f968n/perf-node-gather-daemonset-h7zzq" May 28 11:33:45.391087 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:45.390930 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/84a94cd3-ac7e-403f-bbce-cf831b3edca0-proc\") pod \"perf-node-gather-daemonset-h7zzq\" (UID: \"84a94cd3-ac7e-403f-bbce-cf831b3edca0\") " pod="openshift-must-gather-f968n/perf-node-gather-daemonset-h7zzq" May 28 11:33:45.391087 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:45.390990 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84a94cd3-ac7e-403f-bbce-cf831b3edca0-lib-modules\") pod \"perf-node-gather-daemonset-h7zzq\" (UID: \"84a94cd3-ac7e-403f-bbce-cf831b3edca0\") " pod="openshift-must-gather-f968n/perf-node-gather-daemonset-h7zzq" May 28 11:33:45.391087 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:45.391050 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84a94cd3-ac7e-403f-bbce-cf831b3edca0-sys\") pod \"perf-node-gather-daemonset-h7zzq\" (UID: \"84a94cd3-ac7e-403f-bbce-cf831b3edca0\") " pod="openshift-must-gather-f968n/perf-node-gather-daemonset-h7zzq" May 28 11:33:45.391251 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:45.391144 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84a94cd3-ac7e-403f-bbce-cf831b3edca0-sys\") pod \"perf-node-gather-daemonset-h7zzq\" (UID: \"84a94cd3-ac7e-403f-bbce-cf831b3edca0\") " pod="openshift-must-gather-f968n/perf-node-gather-daemonset-h7zzq" May 28 11:33:45.391251 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:45.391148 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d9g86\" (UniqueName: \"kubernetes.io/projected/84a94cd3-ac7e-403f-bbce-cf831b3edca0-kube-api-access-d9g86\") pod \"perf-node-gather-daemonset-h7zzq\" (UID: \"84a94cd3-ac7e-403f-bbce-cf831b3edca0\") " pod="openshift-must-gather-f968n/perf-node-gather-daemonset-h7zzq" May 28 11:33:45.391251 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:45.391213 2551 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84a94cd3-ac7e-403f-bbce-cf831b3edca0-podres\") pod \"perf-node-gather-daemonset-h7zzq\" (UID: \"84a94cd3-ac7e-403f-bbce-cf831b3edca0\") " pod="openshift-must-gather-f968n/perf-node-gather-daemonset-h7zzq" May 28 11:33:45.391393 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:45.391320 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/84a94cd3-ac7e-403f-bbce-cf831b3edca0-podres\") pod \"perf-node-gather-daemonset-h7zzq\" (UID: \"84a94cd3-ac7e-403f-bbce-cf831b3edca0\") " pod="openshift-must-gather-f968n/perf-node-gather-daemonset-h7zzq" May 28 11:33:45.398427 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:45.398404 2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9g86\" (UniqueName: \"kubernetes.io/projected/84a94cd3-ac7e-403f-bbce-cf831b3edca0-kube-api-access-d9g86\") pod \"perf-node-gather-daemonset-h7zzq\" (UID: \"84a94cd3-ac7e-403f-bbce-cf831b3edca0\") " pod="openshift-must-gather-f968n/perf-node-gather-daemonset-h7zzq" May 28 11:33:45.480255 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:45.480172 2551 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f968n/perf-node-gather-daemonset-h7zzq" May 28 11:33:45.611157 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:45.610993 2551 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f968n/perf-node-gather-daemonset-h7zzq"] May 28 11:33:45.614015 ip-10-0-130-105 kubenswrapper[2551]: W0528 11:33:45.613982 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod84a94cd3_ac7e_403f_bbce_cf831b3edca0.slice/crio-77952348ec7705fc942f76c9b4ea61f3e031e4d766b92556402ca704b7de5148 WatchSource:0}: Error finding container 77952348ec7705fc942f76c9b4ea61f3e031e4d766b92556402ca704b7de5148: Status 404 returned error can't find the container with id 77952348ec7705fc942f76c9b4ea61f3e031e4d766b92556402ca704b7de5148 May 28 11:33:46.036518 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:46.036487 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2p4rf_58fc8bd1-415a-4618-971d-03a6d76be5ea/dns/0.log" May 28 11:33:46.057765 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:46.057743 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2p4rf_58fc8bd1-415a-4618-971d-03a6d76be5ea/kube-rbac-proxy/0.log" May 28 11:33:46.255365 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:46.255340 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sbnm7_8c1c4ad4-f62f-4d7d-9a30-0fae41b4738b/dns-node-resolver/0.log" May 28 11:33:46.375990 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:46.375897 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f968n/perf-node-gather-daemonset-h7zzq" event={"ID":"84a94cd3-ac7e-403f-bbce-cf831b3edca0","Type":"ContainerStarted","Data":"3b11cf2dd57d8254403134bcfe54e81372ad4b5e3d74399b067526452afc9d4a"} May 28 11:33:46.375990 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:46.375974 2551 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f968n/perf-node-gather-daemonset-h7zzq" event={"ID":"84a94cd3-ac7e-403f-bbce-cf831b3edca0","Type":"ContainerStarted","Data":"77952348ec7705fc942f76c9b4ea61f3e031e4d766b92556402ca704b7de5148"} May 28 11:33:46.376242 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:46.376098 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-f968n/perf-node-gather-daemonset-h7zzq" May 28 11:33:46.394570 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:46.394519 2551 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-f968n/perf-node-gather-daemonset-h7zzq" podStartSLOduration=1.394501016 podStartE2EDuration="1.394501016s" podCreationTimestamp="2026-05-28 11:33:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 11:33:46.392866807 +0000 UTC m=+1844.634526710" watchObservedRunningTime="2026-05-28 11:33:46.394501016 +0000 UTC m=+1844.636160911" May 28 11:33:46.629257 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:46.629171 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-865858fc96-5rkkp_87747eaa-7924-4337-b061-3808eae4b037/registry/0.log" May 28 11:33:46.636455 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:46.636419 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-865858fc96-5rkkp_87747eaa-7924-4337-b061-3808eae4b037/registry/1.log" May 28 11:33:46.706908 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:46.705168 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xrf98_804fb564-4d88-4cc8-8c56-5b653c8f53cf/node-ca/0.log" May 28 11:33:47.672601 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:47.672567 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kcddp_89006b03-182a-475a-849d-a93d928d555b/serve-healthcheck-canary/0.log" May 28 11:33:48.027385 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:48.027355 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bx9w7_98f48786-bb87-492f-b3a9-fe114df9677c/kube-rbac-proxy/0.log" May 28 11:33:48.048140 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:48.048116 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bx9w7_98f48786-bb87-492f-b3a9-fe114df9677c/exporter/0.log" May 28 11:33:48.066852 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:48.066833 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bx9w7_98f48786-bb87-492f-b3a9-fe114df9677c/extractor/0.log" May 28 11:33:52.388767 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:52.388738 2551 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-f968n/perf-node-gather-daemonset-h7zzq" May 28 11:33:53.051701 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:53.051672 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4g2xp_97c5bb3c-8bc1-40c4-908d-46f349f6513f/kube-multus/0.log" May 28 11:33:53.400864 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:53.400786 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9dfm_ae806252-dc90-4483-83b3-d4226fea2310/kube-multus-additional-cni-plugins/0.log" May 28 11:33:53.422015 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:53.421989 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9dfm_ae806252-dc90-4483-83b3-d4226fea2310/egress-router-binary-copy/0.log" May 28 11:33:53.441399 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:53.441379 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9dfm_ae806252-dc90-4483-83b3-d4226fea2310/cni-plugins/0.log" May 28 11:33:53.463457 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:53.463431 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9dfm_ae806252-dc90-4483-83b3-d4226fea2310/bond-cni-plugin/0.log" May 28 11:33:53.486838 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:53.486818 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9dfm_ae806252-dc90-4483-83b3-d4226fea2310/routeoverride-cni/0.log" May 28 11:33:53.506977 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:53.506957 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9dfm_ae806252-dc90-4483-83b3-d4226fea2310/whereabouts-cni-bincopy/0.log" May 28 11:33:53.526001 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:53.525975 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r9dfm_ae806252-dc90-4483-83b3-d4226fea2310/whereabouts-cni/0.log" May 28 11:33:53.657837 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:53.657775 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-k5dvc_651502be-d3a5-4259-a6be-3282eda430db/network-metrics-daemon/0.log" May 28 11:33:53.675337 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:53.675313 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-k5dvc_651502be-d3a5-4259-a6be-3282eda430db/kube-rbac-proxy/0.log" May 28 11:33:55.183336 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:55.183311 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rv2r4_31f22620-e687-49e2-a50b-60b1d5239a01/ovn-controller/0.log" May 28 11:33:55.208719 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:55.208693 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rv2r4_31f22620-e687-49e2-a50b-60b1d5239a01/ovn-acl-logging/0.log" May 28 11:33:55.224245 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:55.224222 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rv2r4_31f22620-e687-49e2-a50b-60b1d5239a01/kube-rbac-proxy-node/0.log" May 28 11:33:55.245013 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:55.244992 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rv2r4_31f22620-e687-49e2-a50b-60b1d5239a01/kube-rbac-proxy-ovn-metrics/0.log" May 28 11:33:55.262104 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:55.262082 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rv2r4_31f22620-e687-49e2-a50b-60b1d5239a01/northd/0.log" May 28 11:33:55.280902 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:55.280879 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rv2r4_31f22620-e687-49e2-a50b-60b1d5239a01/nbdb/0.log" May 28 11:33:55.301698 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:55.301666 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rv2r4_31f22620-e687-49e2-a50b-60b1d5239a01/sbdb/0.log" May 28 11:33:55.435534 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:55.435451 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rv2r4_31f22620-e687-49e2-a50b-60b1d5239a01/ovnkube-controller/0.log" May 28 11:33:56.422990 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:56.422913 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-tb8vv_9bc40b8d-8878-48e4-bf31-adae0ae6ef7b/network-check-target-container/0.log" May 28 11:33:57.239533 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:57.239503 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-jwtkt_beb4d19c-3f94-4eca-a161-0e9ca088ab97/iptables-alerter/0.log" May 28 11:33:57.875530 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:33:57.875499 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-kgg5s_714bfb15-bce6-4d8a-b81e-2af3366caf14/tuned/0.log" May 28 11:34:00.384607 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:34:00.384579 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-57b5b68b8-2t6dz_af9fa108-1f8e-44cf-8d6c-6d6c1a98133e/service-ca-operator/1.log" May 28 11:34:00.385758 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:34:00.385735 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-57b5b68b8-2t6dz_af9fa108-1f8e-44cf-8d6c-6d6c1a98133e/service-ca-operator/0.log" May 28 11:34:01.087678 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:34:01.087608 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-ng4m6_8102dd33-f306-4bc2-a3a2-b0681b2b0eda/csi-driver/0.log" May 28 11:34:01.112169 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:34:01.112132 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-ng4m6_8102dd33-f306-4bc2-a3a2-b0681b2b0eda/csi-node-driver-registrar/0.log" May 28 11:34:01.133154 ip-10-0-130-105 kubenswrapper[2551]: I0528 11:34:01.133120 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-ng4m6_8102dd33-f306-4bc2-a3a2-b0681b2b0eda/csi-liveness-probe/0.log"