Jun 02 01:08:05.823429 ip-10-0-138-192 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 02 01:08:05.823440 ip-10-0-138-192 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 02 01:08:05.823447 ip-10-0-138-192 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 02 01:08:05.823705 ip-10-0-138-192 systemd[1]: Failed to start Kubernetes Kubelet. Jun 02 01:08:15.914039 ip-10-0-138-192 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 02 01:08:15.914060 ip-10-0-138-192 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot fadc084bec8e4ca5b7ab80d679b52568 -- Jun 02 01:10:55.712680 ip-10-0-138-192 systemd[1]: Starting Kubernetes Kubelet... Jun 02 01:10:56.160905 ip-10-0-138-192 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 01:10:56.160905 ip-10-0-138-192 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 01:10:56.160905 ip-10-0-138-192 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 01:10:56.160905 ip-10-0-138-192 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 01:10:56.160905 ip-10-0-138-192 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 01:10:56.163585 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.163487 2576 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 01:10:56.166673 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166654 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:10:56.166673 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166672 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:10:56.166741 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166676 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:10:56.166741 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166679 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:10:56.166741 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166682 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:10:56.166741 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166686 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:10:56.166741 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166689 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:10:56.166741 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166692 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:10:56.166741 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166697 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:10:56.166741 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166701 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:10:56.166741 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166709 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:10:56.166741 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166712 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:10:56.166741 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166715 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:10:56.166741 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166718 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:10:56.166741 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166722 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:10:56.166741 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166726 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:10:56.166741 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166728 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:10:56.166741 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166732 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:10:56.166741 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166736 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:10:56.166741 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166739 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:10:56.166741 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166742 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:10:56.167196 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166744 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:10:56.167196 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166747 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:10:56.167196 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166750 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:10:56.167196 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166759 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:10:56.167196 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166762 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:10:56.167196 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166765 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:10:56.167196 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166767 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:10:56.167196 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166771 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:10:56.167196 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166773 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:10:56.167196 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166776 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:10:56.167196 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166778 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:10:56.167196 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166781 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:10:56.167196 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166783 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:10:56.167196 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166786 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:10:56.167196 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166789 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:10:56.167196 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166791 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:10:56.167196 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166794 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:10:56.167196 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166796 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:10:56.167196 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166799 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:10:56.167196 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166805 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:10:56.167704 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166808 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:10:56.167704 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166811 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:10:56.167704 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166813 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:10:56.167704 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166815 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:10:56.167704 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166818 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:10:56.167704 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166821 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:10:56.167704 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166823 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:10:56.167704 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166826 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:10:56.167704 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166828 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:10:56.167704 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166830 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:10:56.167704 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166833 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:10:56.167704 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166836 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:10:56.167704 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166838 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:10:56.167704 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166841 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:10:56.167704 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166844 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:10:56.167704 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166848 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:10:56.167704 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166851 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:10:56.167704 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166853 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:10:56.167704 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166856 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:10:56.167704 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166858 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:10:56.168191 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166861 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:10:56.168191 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166864 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:10:56.168191 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166866 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:10:56.168191 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166871 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:10:56.168191 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166874 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:10:56.168191 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166876 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:10:56.168191 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166879 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:10:56.168191 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166882 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:10:56.168191 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166884 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:10:56.168191 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166886 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:10:56.168191 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166889 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:10:56.168191 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166892 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:10:56.168191 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166899 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:10:56.168191 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166902 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:10:56.168191 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166905 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:10:56.168191 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166907 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:10:56.168191 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166910 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:10:56.168191 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166913 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:10:56.168191 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166915 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:10:56.168191 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166918 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:10:56.168686 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166920 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:10:56.168686 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166923 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:10:56.168686 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166925 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:10:56.168686 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166928 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:10:56.168686 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.166930 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:10:56.168686 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167385 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:10:56.168686 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167390 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:10:56.168686 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167393 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:10:56.168686 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167396 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:10:56.168686 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167399 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:10:56.168686 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167402 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:10:56.168686 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167404 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:10:56.168686 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167407 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:10:56.168686 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167410 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:10:56.168686 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167412 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:10:56.168686 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167415 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:10:56.168686 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167418 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:10:56.168686 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167422 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:10:56.168686 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167426 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:10:56.168686 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167429 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:10:56.169181 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167432 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:10:56.169181 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167435 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:10:56.169181 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167438 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:10:56.169181 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167441 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:10:56.169181 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167445 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:10:56.169181 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167447 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:10:56.169181 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167451 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:10:56.169181 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167454 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:10:56.169181 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167457 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:10:56.169181 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167459 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:10:56.169181 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167462 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:10:56.169181 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167464 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:10:56.169181 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167467 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:10:56.169181 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167469 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:10:56.169181 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167472 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:10:56.169181 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167475 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:10:56.169181 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167477 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:10:56.169181 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167480 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:10:56.169181 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167483 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:10:56.169181 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167486 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:10:56.169709 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167488 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:10:56.169709 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167491 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:10:56.169709 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167493 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:10:56.169709 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167496 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:10:56.169709 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167498 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:10:56.169709 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167501 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:10:56.169709 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167504 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:10:56.169709 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167506 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:10:56.169709 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167508 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:10:56.169709 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167511 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:10:56.169709 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167514 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:10:56.169709 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167516 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:10:56.169709 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167519 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:10:56.169709 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167521 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:10:56.169709 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167524 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:10:56.169709 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167526 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:10:56.169709 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167530 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:10:56.169709 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167533 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:10:56.169709 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167538 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:10:56.170175 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167541 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:10:56.170175 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167543 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:10:56.170175 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167546 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:10:56.170175 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167549 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:10:56.170175 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167552 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:10:56.170175 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167555 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:10:56.170175 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167557 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:10:56.170175 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167560 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:10:56.170175 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167562 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:10:56.170175 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167565 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:10:56.170175 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167567 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:10:56.170175 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167571 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:10:56.170175 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167573 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:10:56.170175 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167576 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:10:56.170175 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167578 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:10:56.170175 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167581 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:10:56.170175 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167584 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:10:56.170175 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167586 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:10:56.170175 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167589 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:10:56.170175 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167592 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:10:56.170699 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167594 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:10:56.170699 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167597 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:10:56.170699 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167600 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:10:56.170699 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167602 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:10:56.170699 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167605 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:10:56.170699 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167607 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:10:56.170699 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167610 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:10:56.170699 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167612 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:10:56.170699 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167615 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:10:56.170699 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167619 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:10:56.170699 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167621 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:10:56.170699 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.167625 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:10:56.170699 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169540 2576 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 01:10:56.170699 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169551 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 01:10:56.170699 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169558 2576 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 01:10:56.170699 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169563 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 01:10:56.170699 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169568 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 01:10:56.170699 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169571 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 01:10:56.170699 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169576 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 01:10:56.170699 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169585 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 01:10:56.170699 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169589 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 01:10:56.171328 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169592 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 01:10:56.171328 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169596 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 01:10:56.171328 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169600 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 01:10:56.171328 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169604 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 01:10:56.171328 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169607 2576 flags.go:64] FLAG: --cgroup-root="" Jun 02 01:10:56.171328 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169610 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 01:10:56.171328 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169613 2576 flags.go:64] FLAG: --client-ca-file="" Jun 02 01:10:56.171328 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169616 2576 flags.go:64] FLAG: --cloud-config="" Jun 02 01:10:56.171328 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169618 2576 flags.go:64] FLAG: --cloud-provider="external" Jun 02 01:10:56.171328 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169621 2576 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 01:10:56.171328 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169630 2576 flags.go:64] FLAG: --cluster-domain="" Jun 02 01:10:56.171328 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169633 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 01:10:56.171328 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169637 2576 flags.go:64] FLAG: --config-dir="" Jun 02 01:10:56.171328 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169640 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 01:10:56.171328 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169644 2576 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 01:10:56.171328 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169648 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 01:10:56.171328 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169651 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 01:10:56.171328 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169654 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 01:10:56.171328 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169657 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 01:10:56.171328 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169660 2576 flags.go:64] FLAG: --contention-profiling="false" Jun 02 01:10:56.171328 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169663 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 01:10:56.171328 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169666 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 01:10:56.171328 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169670 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 01:10:56.171328 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169675 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 01:10:56.171328 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169679 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 01:10:56.171947 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169682 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 01:10:56.171947 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169700 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 01:10:56.171947 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169705 2576 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 01:10:56.171947 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169709 2576 flags.go:64] FLAG: --enable-server="true" Jun 02 01:10:56.171947 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169712 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 01:10:56.171947 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169720 2576 flags.go:64] FLAG: --event-burst="100" Jun 02 01:10:56.171947 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169724 2576 flags.go:64] FLAG: --event-qps="50" Jun 02 01:10:56.171947 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169727 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 01:10:56.171947 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169730 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 01:10:56.171947 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169733 2576 flags.go:64] FLAG: --eviction-hard="" Jun 02 01:10:56.171947 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169737 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 01:10:56.171947 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169740 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 01:10:56.171947 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169743 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 01:10:56.171947 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169746 2576 flags.go:64] FLAG: --eviction-soft="" Jun 02 01:10:56.171947 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169749 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 01:10:56.171947 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169752 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 01:10:56.171947 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169755 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 01:10:56.171947 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169758 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 01:10:56.171947 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169761 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 01:10:56.171947 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169764 2576 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 01:10:56.171947 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169767 2576 flags.go:64] FLAG: --feature-gates="" Jun 02 01:10:56.171947 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169771 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 01:10:56.171947 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169774 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 01:10:56.171947 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169777 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 01:10:56.171947 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169780 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 01:10:56.172555 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169783 2576 flags.go:64] FLAG: --healthz-port="10248" Jun 02 01:10:56.172555 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169786 2576 flags.go:64] FLAG: --help="false" Jun 02 01:10:56.172555 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169789 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-138-192.ec2.internal" Jun 02 01:10:56.172555 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169792 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 01:10:56.172555 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169796 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 01:10:56.172555 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169799 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 01:10:56.172555 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169803 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 01:10:56.172555 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169807 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 01:10:56.172555 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169810 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 01:10:56.172555 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169814 2576 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 01:10:56.172555 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169816 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 01:10:56.172555 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169820 2576 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 01:10:56.172555 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169822 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 01:10:56.172555 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169826 2576 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 01:10:56.172555 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169829 2576 flags.go:64] FLAG: --kube-reserved="" Jun 02 01:10:56.172555 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169832 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 01:10:56.172555 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169834 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 01:10:56.172555 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169837 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 01:10:56.172555 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169840 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 01:10:56.172555 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169843 2576 flags.go:64] FLAG: --lock-file="" Jun 02 01:10:56.172555 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169846 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 01:10:56.172555 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169849 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 01:10:56.172555 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169852 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 01:10:56.172555 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169857 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 01:10:56.173180 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169860 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 01:10:56.173180 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169863 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 01:10:56.173180 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169866 2576 flags.go:64] FLAG: --logging-format="text" Jun 02 01:10:56.173180 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169869 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 01:10:56.173180 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169872 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 01:10:56.173180 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169875 2576 flags.go:64] FLAG: --manifest-url="" Jun 02 01:10:56.173180 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169878 2576 flags.go:64] FLAG: --manifest-url-header="" Jun 02 01:10:56.173180 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169883 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 01:10:56.173180 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169886 2576 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 01:10:56.173180 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169890 2576 flags.go:64] FLAG: --max-pods="110" Jun 02 01:10:56.173180 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169893 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 01:10:56.173180 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169897 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 01:10:56.173180 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169900 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 01:10:56.173180 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169904 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 01:10:56.173180 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169907 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 01:10:56.173180 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169912 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 01:10:56.173180 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169916 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 01:10:56.173180 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169924 2576 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 01:10:56.173180 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169928 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 01:10:56.173180 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169931 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 01:10:56.173180 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169934 2576 flags.go:64] FLAG: --pod-cidr="" Jun 02 01:10:56.173180 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169937 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 01:10:56.173180 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169943 2576 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 01:10:56.173758 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169946 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 01:10:56.173758 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169949 2576 flags.go:64] FLAG: --pods-per-core="0" Jun 02 01:10:56.173758 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169952 2576 flags.go:64] FLAG: --port="10250" Jun 02 01:10:56.173758 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169956 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 01:10:56.173758 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169959 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0891584e8c7f1de26" Jun 02 01:10:56.173758 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169962 2576 flags.go:64] FLAG: --qos-reserved="" Jun 02 01:10:56.173758 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169965 2576 flags.go:64] FLAG: --read-only-port="10255" Jun 02 01:10:56.173758 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169968 2576 flags.go:64] FLAG: --register-node="true" Jun 02 01:10:56.173758 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169971 2576 flags.go:64] FLAG: --register-schedulable="true" Jun 02 01:10:56.173758 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169975 2576 flags.go:64] FLAG: --register-with-taints="" Jun 02 01:10:56.173758 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169978 2576 flags.go:64] FLAG: --registry-burst="10" Jun 02 01:10:56.173758 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169981 2576 flags.go:64] FLAG: --registry-qps="5" Jun 02 01:10:56.173758 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169984 2576 flags.go:64] FLAG: --reserved-cpus="" Jun 02 01:10:56.173758 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169987 2576 flags.go:64] FLAG: --reserved-memory="" Jun 02 01:10:56.173758 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169991 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 01:10:56.173758 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169994 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 01:10:56.173758 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.169997 2576 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 01:10:56.173758 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.170000 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 01:10:56.173758 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.170003 2576 flags.go:64] FLAG: --runonce="false" Jun 02 01:10:56.173758 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.170006 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 01:10:56.173758 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.170009 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 01:10:56.173758 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.170012 2576 flags.go:64] FLAG: --seccomp-default="false" Jun 02 01:10:56.173758 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.170015 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 01:10:56.173758 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.170018 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 01:10:56.173758 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.170021 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 01:10:56.173758 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.170025 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 01:10:56.174451 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.170028 2576 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 01:10:56.174451 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.170031 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 01:10:56.174451 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.170034 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 01:10:56.174451 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.170037 2576 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 01:10:56.174451 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.170040 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 01:10:56.174451 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.170043 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 01:10:56.174451 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.170046 2576 flags.go:64] FLAG: --system-cgroups="" Jun 02 01:10:56.174451 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.170049 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 01:10:56.174451 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.170054 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 01:10:56.174451 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.170057 2576 flags.go:64] FLAG: --tls-cert-file="" Jun 02 01:10:56.174451 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.170060 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 01:10:56.174451 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.170064 2576 flags.go:64] FLAG: --tls-min-version="" Jun 02 01:10:56.174451 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.170067 2576 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 01:10:56.174451 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.170070 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 01:10:56.174451 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.170073 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 01:10:56.174451 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.170076 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 01:10:56.174451 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.170079 2576 flags.go:64] FLAG: --v="2" Jun 02 01:10:56.174451 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.170083 2576 flags.go:64] FLAG: --version="false" Jun 02 01:10:56.174451 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.170088 2576 flags.go:64] FLAG: --vmodule="" Jun 02 01:10:56.174451 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.170092 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 01:10:56.174451 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.170095 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 01:10:56.174451 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170218 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:10:56.174451 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170222 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:10:56.174451 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170226 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:10:56.175028 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170229 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:10:56.175028 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170232 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:10:56.175028 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170235 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:10:56.175028 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170237 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:10:56.175028 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170240 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:10:56.175028 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170243 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:10:56.175028 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170246 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:10:56.175028 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170248 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:10:56.175028 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170252 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:10:56.175028 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170254 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:10:56.175028 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170257 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:10:56.175028 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170259 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:10:56.175028 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170262 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:10:56.175028 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170266 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:10:56.175028 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170270 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:10:56.175028 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170273 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:10:56.175028 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170275 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:10:56.175028 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170278 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:10:56.175028 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170281 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:10:56.175521 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170284 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:10:56.175521 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170287 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:10:56.175521 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170289 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:10:56.175521 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170291 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:10:56.175521 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170294 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:10:56.175521 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170297 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:10:56.175521 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170300 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:10:56.175521 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170302 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:10:56.175521 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170305 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:10:56.175521 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170308 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:10:56.175521 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170310 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:10:56.175521 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170313 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:10:56.175521 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170315 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:10:56.175521 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170318 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:10:56.175521 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170320 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:10:56.175521 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170324 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:10:56.175521 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170326 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:10:56.175521 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170329 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:10:56.175521 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170332 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:10:56.175521 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170334 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:10:56.176023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170336 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:10:56.176023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170339 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:10:56.176023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170342 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:10:56.176023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170345 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:10:56.176023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170347 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:10:56.176023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170350 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:10:56.176023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170352 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:10:56.176023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170355 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:10:56.176023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170357 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:10:56.176023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170360 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:10:56.176023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170362 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:10:56.176023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170377 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:10:56.176023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170380 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:10:56.176023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170382 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:10:56.176023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170385 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:10:56.176023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170389 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:10:56.176023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170392 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:10:56.176023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170394 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:10:56.176023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170397 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:10:56.176023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170400 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:10:56.176537 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170402 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:10:56.176537 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170405 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:10:56.176537 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170408 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:10:56.176537 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170410 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:10:56.176537 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170413 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:10:56.176537 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170415 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:10:56.176537 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170418 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:10:56.176537 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170421 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:10:56.176537 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170424 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:10:56.176537 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170427 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:10:56.176537 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170430 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:10:56.176537 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170433 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:10:56.176537 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170435 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:10:56.176537 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170438 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:10:56.176537 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170440 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:10:56.176537 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170443 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:10:56.176537 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170446 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:10:56.176537 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170449 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:10:56.176537 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170451 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:10:56.176537 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170454 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:10:56.177352 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170456 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:10:56.177352 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170461 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:10:56.177352 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170464 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:10:56.177352 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.170466 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:10:56.177352 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.171011 2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 01:10:56.179378 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.179336 2576 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 01:10:56.179378 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.179361 2576 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 01:10:56.179518 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179429 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:10:56.179518 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179436 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:10:56.179518 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179439 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:10:56.179518 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179443 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:10:56.179518 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179447 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:10:56.179518 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179450 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:10:56.179518 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179452 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:10:56.179518 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179456 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:10:56.179518 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179459 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:10:56.179518 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179462 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:10:56.179518 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179464 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:10:56.179518 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179467 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:10:56.179518 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179470 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:10:56.179518 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179472 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:10:56.179518 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179475 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:10:56.179518 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179478 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:10:56.179518 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179481 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:10:56.179518 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179484 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:10:56.179518 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179486 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:10:56.179518 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179489 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:10:56.180023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179491 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:10:56.180023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179494 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:10:56.180023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179497 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:10:56.180023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179500 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:10:56.180023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179502 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:10:56.180023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179505 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:10:56.180023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179508 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:10:56.180023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179511 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:10:56.180023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179513 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:10:56.180023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179516 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:10:56.180023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179520 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:10:56.180023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179525 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:10:56.180023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179529 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:10:56.180023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179532 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:10:56.180023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179535 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:10:56.180023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179538 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:10:56.180023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179541 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:10:56.180023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179543 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:10:56.180023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179546 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:10:56.180023 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179548 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:10:56.180535 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179551 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:10:56.180535 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179553 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:10:56.180535 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179556 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:10:56.180535 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179558 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:10:56.180535 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179561 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:10:56.180535 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179563 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:10:56.180535 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179566 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:10:56.180535 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179569 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:10:56.180535 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179571 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:10:56.180535 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179574 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:10:56.180535 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179576 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:10:56.180535 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179579 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:10:56.180535 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179581 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:10:56.180535 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179584 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:10:56.180535 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179587 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:10:56.180535 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179590 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:10:56.180535 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179593 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:10:56.180535 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179595 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:10:56.180535 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179598 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:10:56.181008 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179600 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:10:56.181008 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179603 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:10:56.181008 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179605 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:10:56.181008 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179609 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:10:56.181008 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179612 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:10:56.181008 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179615 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:10:56.181008 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179617 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:10:56.181008 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179620 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:10:56.181008 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179623 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:10:56.181008 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179625 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:10:56.181008 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179627 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:10:56.181008 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179630 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:10:56.181008 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179633 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:10:56.181008 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179636 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:10:56.181008 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179638 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:10:56.181008 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179641 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:10:56.181008 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179643 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:10:56.181008 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179647 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:10:56.181008 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179649 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:10:56.181500 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179652 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:10:56.181500 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179655 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:10:56.181500 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179657 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:10:56.181500 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179660 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:10:56.181500 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179662 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:10:56.181500 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179665 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:10:56.181500 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179668 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:10:56.181500 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179670 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:10:56.181500 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.179676 2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 01:10:56.181500 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179777 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:10:56.181500 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179782 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:10:56.181500 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179784 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:10:56.181500 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179787 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:10:56.181500 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179790 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:10:56.181500 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179792 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:10:56.181500 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179795 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:10:56.181913 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179797 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:10:56.181913 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179800 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:10:56.181913 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179802 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:10:56.181913 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179805 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:10:56.181913 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179808 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:10:56.181913 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179810 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:10:56.181913 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179813 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:10:56.181913 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179815 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:10:56.181913 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179818 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:10:56.181913 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179820 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:10:56.181913 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179823 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:10:56.181913 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179825 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:10:56.181913 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179827 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:10:56.181913 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179830 2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:10:56.181913 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179832 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:10:56.181913 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179835 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:10:56.181913 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179838 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:10:56.181913 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179841 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:10:56.181913 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179843 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:10:56.182411 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179846 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:10:56.182411 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179849 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:10:56.182411 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179851 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:10:56.182411 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179854 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:10:56.182411 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179856 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:10:56.182411 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179859 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:10:56.182411 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179862 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:10:56.182411 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179864 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:10:56.182411 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179867 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:10:56.182411 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179870 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:10:56.182411 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179872 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:10:56.182411 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179875 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:10:56.182411 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179878 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:10:56.182411 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179881 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:10:56.182411 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179883 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:10:56.182411 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179886 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:10:56.182411 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179889 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:10:56.182411 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179891 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:10:56.182411 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179894 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:10:56.182411 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179896 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:10:56.182969 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179899 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:10:56.182969 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179901 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:10:56.182969 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179904 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:10:56.182969 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179906 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:10:56.182969 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179909 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:10:56.182969 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179911 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:10:56.182969 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179913 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:10:56.182969 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179916 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:10:56.182969 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179918 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:10:56.182969 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179922 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:10:56.182969 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179925 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:10:56.182969 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179927 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:10:56.182969 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179930 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:10:56.182969 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179932 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:10:56.182969 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179935 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:10:56.182969 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179938 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:10:56.182969 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179940 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:10:56.182969 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179944 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:10:56.182969 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179946 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:10:56.182969 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179949 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:10:56.183507 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179951 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:10:56.183507 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179954 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:10:56.183507 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179956 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:10:56.183507 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179959 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:10:56.183507 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179962 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:10:56.183507 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179965 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:10:56.183507 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179969 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:10:56.183507 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179972 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:10:56.183507 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179975 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:10:56.183507 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179978 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:10:56.183507 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179980 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:10:56.183507 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179983 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:10:56.183507 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179986 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:10:56.183507 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179988 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:10:56.183507 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179990 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:10:56.183507 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179993 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:10:56.183507 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179995 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:10:56.183507 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.179998 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:10:56.183507 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.180001 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:10:56.183987 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:56.180003 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:10:56.183987 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.180008 2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 01:10:56.183987 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.180600 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 01:10:56.183987 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.182538 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 01:10:56.183987 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.183523 2576 server.go:1019] "Starting client certificate rotation" Jun 02 01:10:56.183987 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.183622 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 01:10:56.183987 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.183653 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 01:10:56.207613 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.207587 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 01:10:56.209509 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.209490 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 01:10:56.224255 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.224228 2576 log.go:25] "Validated CRI v1 runtime API" Jun 02 01:10:56.230784 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.230767 2576 log.go:25] "Validated CRI v1 image API" Jun 02 01:10:56.232034 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.232006 2576 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 01:10:56.235108 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.235080 2576 fs.go:135] Filesystem UUIDs: map[2ded4efb-0a20-4673-8dfc-cdae0a8fc8e4:/dev/nvme0n1p3 40f400a0-63a0-432c-be89-4b8974a59fd2:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 02 01:10:56.235188 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.235103 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 01:10:56.239547 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.239527 2576 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 01:10:56.240201 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.240087 2576 manager.go:217] Machine: {Timestamp:2026-06-02 01:10:56.239478026 +0000 UTC m=+0.410020208 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3130027 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a75b14e4650d0e93477a4fb2e7ed7 SystemUUID:ec2a75b1-4e46-50d0-e934-77a4fb2e7ed7 BootID:fadc084b-ec8e-4ca5-b7ab-80d679b52568 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:16:9f:bb:47:9d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:16:9f:bb:47:9d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:fc:70:1c:a2:7d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 01:10:56.241080 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.241069 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 01:10:56.241176 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.241163 2576 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 01:10:56.244654 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.244625 2576 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 01:10:56.244869 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.244657 2576 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-192.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 01:10:56.244949 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.244885 2576 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 01:10:56.244949 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.244899 2576 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 01:10:56.244949 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.244909 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 01:10:56.246318 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.246305 2576 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 01:10:56.247821 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.247808 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 02 01:10:56.248149 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.248135 2576 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 01:10:56.250264 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.250253 2576 kubelet.go:491] "Attempting to sync node with API server" Jun 02 01:10:56.250321 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.250272 2576 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 01:10:56.250321 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.250289 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 01:10:56.250321 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.250303 2576 kubelet.go:397] "Adding apiserver pod source" Jun 02 01:10:56.250321 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.250317 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 01:10:56.251570 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.251556 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 01:10:56.251637 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.251579 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 01:10:56.254956 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.254939 2576 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 01:10:56.257203 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.257189 2576 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 01:10:56.259136 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.259118 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b22qs" Jun 02 01:10:56.259493 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.259479 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 01:10:56.259586 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.259498 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 01:10:56.259586 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.259505 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 01:10:56.259586 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.259511 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 01:10:56.259586 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.259521 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 01:10:56.259586 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.259527 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 01:10:56.259586 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.259534 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 01:10:56.259586 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.259540 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 01:10:56.259586 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.259547 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 01:10:56.259586 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.259553 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 01:10:56.259586 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.259570 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 01:10:56.259586 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.259576 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 01:10:56.260462 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.260449 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 01:10:56.260462 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.260463 2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 01:10:56.263761 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.263746 2576 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 01:10:56.263840 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.263786 2576 server.go:1295] "Started kubelet" Jun 02 01:10:56.263920 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.263881 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 01:10:56.264235 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.264198 2576 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 01:10:56.264288 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.264247 2576 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 01:10:56.264736 ip-10-0-138-192 systemd[1]: Started Kubernetes Kubelet. Jun 02 01:10:56.265555 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.265537 2576 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 01:10:56.266106 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.266082 2576 server.go:317] "Adding debug handlers to kubelet server" Jun 02 01:10:56.266199 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.266145 2576 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-192.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 01:10:56.266199 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:56.266166 2576 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-192.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 01:10:56.266279 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:56.266205 2576 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 01:10:56.266478 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.266463 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b22qs" Jun 02 01:10:56.271728 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:56.270805 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-192.ec2.internal.18b51e6731f8ea5d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-192.ec2.internal,UID:ip-10-0-138-192.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-192.ec2.internal,},FirstTimestamp:2026-06-02 01:10:56.263760477 +0000 UTC m=+0.434302654,LastTimestamp:2026-06-02 01:10:56.263760477 +0000 UTC m=+0.434302654,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-192.ec2.internal,}" Jun 02 01:10:56.273521 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:56.273489 2576 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 01:10:56.273904 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.273889 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 01:10:56.274427 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.274411 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 01:10:56.274572 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.274551 2576 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 01:10:56.274572 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.274569 2576 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 01:10:56.274714 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.274661 2576 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 01:10:56.274714 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.274708 2576 reconstruct.go:97] "Volume reconstruction finished" Jun 02 01:10:56.274714 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.274717 2576 reconciler.go:26] "Reconciler: start to sync state" Jun 02 01:10:56.275055 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.275034 2576 factory.go:55] Registering systemd factory Jun 02 01:10:56.275055 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.275050 2576 factory.go:223] Registration of the systemd container factory successfully Jun 02 01:10:56.275181 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:56.275159 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-192.ec2.internal\" not found" Jun 02 01:10:56.275270 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.275256 2576 factory.go:153] Registering CRI-O factory Jun 02 01:10:56.275314 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.275274 2576 factory.go:223] Registration of the crio container factory successfully Jun 02 01:10:56.275342 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.275325 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 01:10:56.275401 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.275343 2576 factory.go:103] Registering Raw factory Jun 02 01:10:56.275401 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.275357 2576 manager.go:1196] Started watching for new ooms in manager Jun 02 01:10:56.275788 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.275770 2576 manager.go:319] Starting recovery of all containers Jun 02 01:10:56.278677 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.278654 2576 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:10:56.282216 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:56.282057 2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-192.ec2.internal\" not found" node="ip-10-0-138-192.ec2.internal" Jun 02 01:10:56.285674 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.285655 2576 manager.go:324] Recovery completed Jun 02 01:10:56.291026 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.291012 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:10:56.293329 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.293312 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:10:56.293436 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.293346 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:10:56.293436 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.293358 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:10:56.293941 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.293925 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 01:10:56.294012 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.293941 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 01:10:56.294012 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.293990 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 02 01:10:56.295911 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.295898 2576 policy_none.go:49] "None policy: Start" Jun 02 01:10:56.295962 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.295915 2576 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 01:10:56.295962 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.295926 2576 state_mem.go:35] "Initializing new in-memory state store" Jun 02 01:10:56.332996 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.332977 2576 manager.go:341] "Starting Device Plugin manager" Jun 02 01:10:56.357877 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:56.333028 2576 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 01:10:56.357877 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.333042 2576 server.go:85] "Starting device plugin registration server" Jun 02 01:10:56.357877 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.333301 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 01:10:56.357877 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.333312 2576 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 01:10:56.357877 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.333421 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 01:10:56.357877 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.333499 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 01:10:56.357877 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.333506 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 01:10:56.357877 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:56.334135 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 01:10:56.357877 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:56.334182 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-192.ec2.internal\" not found" Jun 02 01:10:56.399776 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.399738 2576 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 01:10:56.401016 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.400998 2576 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 01:10:56.401116 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.401027 2576 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 01:10:56.401116 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.401050 2576 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 01:10:56.401116 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.401061 2576 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 01:10:56.401116 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:56.401108 2576 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 01:10:56.403667 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.403647 2576 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:10:56.433745 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.433680 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:10:56.435021 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.435004 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:10:56.435094 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.435037 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:10:56.435094 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.435048 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:10:56.435094 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.435074 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-192.ec2.internal" Jun 02 01:10:56.441598 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.441580 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-192.ec2.internal" Jun 02 01:10:56.441642 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:56.441606 2576 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-192.ec2.internal\": node \"ip-10-0-138-192.ec2.internal\" not found" Jun 02 01:10:56.460484 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:56.460458 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-192.ec2.internal\" not found" Jun 02 01:10:56.501828 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.501780 2576 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-192.ec2.internal"] Jun 02 01:10:56.501901 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.501879 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:10:56.503489 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.503470 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:10:56.503578 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.503499 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:10:56.503578 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.503509 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:10:56.504705 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.504693 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:10:56.504873 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.504860 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal" Jun 02 01:10:56.504909 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.504889 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:10:56.505398 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.505383 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:10:56.505476 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.505400 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:10:56.505476 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.505411 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:10:56.505476 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.505423 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:10:56.505476 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.505426 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:10:56.505476 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.505438 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:10:56.506910 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.506898 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-192.ec2.internal" Jun 02 01:10:56.506954 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.506921 2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:10:56.507770 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.507752 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:10:56.507873 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.507780 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:10:56.507873 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.507790 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:10:56.533399 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:56.533354 2576 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-192.ec2.internal\" not found" node="ip-10-0-138-192.ec2.internal" Jun 02 01:10:56.538035 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:56.538014 2576 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-192.ec2.internal\" not found" node="ip-10-0-138-192.ec2.internal" Jun 02 01:10:56.561064 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:56.561039 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-192.ec2.internal\" not found" Jun 02 01:10:56.575939 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.575911 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/262b761e3be937ee9d90f547e448dd74-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal\" (UID: \"262b761e3be937ee9d90f547e448dd74\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal" Jun 02 01:10:56.576037 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.575944 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b03870c6e03d09f5797a675c8ae41336-config\") pod \"kube-apiserver-proxy-ip-10-0-138-192.ec2.internal\" (UID: \"b03870c6e03d09f5797a675c8ae41336\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-192.ec2.internal" Jun 02 01:10:56.576037 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.575961 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/262b761e3be937ee9d90f547e448dd74-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal\" (UID: \"262b761e3be937ee9d90f547e448dd74\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal" Jun 02 01:10:56.661909 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:56.661882 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-192.ec2.internal\" not found" Jun 02 01:10:56.676257 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.676229 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/262b761e3be937ee9d90f547e448dd74-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal\" (UID: \"262b761e3be937ee9d90f547e448dd74\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal" Jun 02 01:10:56.676410 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.676277 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/262b761e3be937ee9d90f547e448dd74-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal\" (UID: \"262b761e3be937ee9d90f547e448dd74\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal" Jun 02 01:10:56.676410 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.676295 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b03870c6e03d09f5797a675c8ae41336-config\") pod \"kube-apiserver-proxy-ip-10-0-138-192.ec2.internal\" (UID: \"b03870c6e03d09f5797a675c8ae41336\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-192.ec2.internal" Jun 02 01:10:56.676410 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.676319 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b03870c6e03d09f5797a675c8ae41336-config\") pod \"kube-apiserver-proxy-ip-10-0-138-192.ec2.internal\" (UID: \"b03870c6e03d09f5797a675c8ae41336\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-192.ec2.internal" Jun 02 01:10:56.676410 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.676232 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/262b761e3be937ee9d90f547e448dd74-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal\" (UID: \"262b761e3be937ee9d90f547e448dd74\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal" Jun 02 01:10:56.676410 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.676397 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/262b761e3be937ee9d90f547e448dd74-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal\" (UID: \"262b761e3be937ee9d90f547e448dd74\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal" Jun 02 01:10:56.762713 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:56.762631 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-192.ec2.internal\" not found" Jun 02 01:10:56.835113 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.835081 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal" Jun 02 01:10:56.840633 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:56.840604 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-192.ec2.internal" Jun 02 01:10:56.863236 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:56.863206 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-192.ec2.internal\" not found" Jun 02 01:10:56.963773 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:56.963729 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-192.ec2.internal\" not found" Jun 02 01:10:57.064264 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:57.064193 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-192.ec2.internal\" not found" Jun 02 01:10:57.164799 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:57.164772 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-192.ec2.internal\" not found" Jun 02 01:10:57.183237 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:57.183209 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 01:10:57.183396 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:57.183361 2576 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 01:10:57.183440 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:57.183419 2576 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 01:10:57.265800 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:57.265765 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-192.ec2.internal\" not found" Jun 02 01:10:57.271630 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:57.271591 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 01:05:56 +0000 UTC" deadline="2027-12-08 05:33:35.537060072 +0000 UTC" Jun 02 01:10:57.271630 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:57.271626 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13300h22m38.265437661s" Jun 02 01:10:57.275256 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:57.275224 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 01:10:57.286882 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:57.286852 2576 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 01:10:57.306916 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:57.306883 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7ldk5" Jun 02 01:10:57.312285 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:57.312259 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7ldk5" Jun 02 01:10:57.366853 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:57.366819 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-192.ec2.internal\" not found" Jun 02 01:10:57.368021 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:57.367993 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb03870c6e03d09f5797a675c8ae41336.slice/crio-90350886cbe8aa67ca9671190324ab2815fc35664de0962d9071f9d4529866f8 WatchSource:0}: Error finding container 90350886cbe8aa67ca9671190324ab2815fc35664de0962d9071f9d4529866f8: Status 404 returned error can't find the container with id 90350886cbe8aa67ca9671190324ab2815fc35664de0962d9071f9d4529866f8 Jun 02 01:10:57.368285 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:57.368262 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod262b761e3be937ee9d90f547e448dd74.slice/crio-7ee6c2eed6a74b8c53efd16ed3ebfc18663e51aab06ff5024f6763e2b2d68eea WatchSource:0}: Error finding container 7ee6c2eed6a74b8c53efd16ed3ebfc18663e51aab06ff5024f6763e2b2d68eea: Status 404 returned error can't find the container with id 7ee6c2eed6a74b8c53efd16ed3ebfc18663e51aab06ff5024f6763e2b2d68eea Jun 02 01:10:57.372782 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:57.372764 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 01:10:57.404525 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:57.404474 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal" event={"ID":"262b761e3be937ee9d90f547e448dd74","Type":"ContainerStarted","Data":"7ee6c2eed6a74b8c53efd16ed3ebfc18663e51aab06ff5024f6763e2b2d68eea"} Jun 02 01:10:57.405410 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:57.405385 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-192.ec2.internal" event={"ID":"b03870c6e03d09f5797a675c8ae41336","Type":"ContainerStarted","Data":"90350886cbe8aa67ca9671190324ab2815fc35664de0962d9071f9d4529866f8"} Jun 02 01:10:57.418885 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:57.418857 2576 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:10:57.467075 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:57.467045 2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-192.ec2.internal\" not found" Jun 02 01:10:57.481658 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:57.481634 2576 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:10:57.574793 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:57.574762 2576 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal" Jun 02 01:10:57.584274 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:57.584250 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 01:10:57.585349 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:57.585336 2576 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-192.ec2.internal" Jun 02 01:10:57.591613 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:57.591598 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 01:10:58.145671 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.145641 2576 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:10:58.251122 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.251090 2576 apiserver.go:52] "Watching apiserver" Jun 02 01:10:58.258356 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.258329 2576 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 01:10:58.258775 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.258748 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-svwjt","openshift-multus/network-metrics-daemon-gntp5","kube-system/konnectivity-agent-k7hnj","openshift-dns/node-resolver-smvzg","openshift-image-registry/node-ca-h8fml","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal","openshift-multus/multus-additional-cni-plugins-8p5xf","openshift-network-diagnostics/network-check-target-55g5j","openshift-network-operator/iptables-alerter-fx5td","openshift-ovn-kubernetes/ovnkube-node-lkf95","kube-system/kube-apiserver-proxy-ip-10-0-138-192.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l98v","openshift-cluster-node-tuning-operator/tuned-7qlgt"] Jun 02 01:10:58.260446 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.260417 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8p5xf" Jun 02 01:10:58.261340 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.261314 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:10:58.261464 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:58.261408 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gntp5" podUID="b0c654e7-08a1-4ca8-81c4-5164c7c30e26" Jun 02 01:10:58.262738 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.262713 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k7hnj" Jun 02 01:10:58.262928 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.262907 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 01:10:58.263528 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.263212 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 01:10:58.263528 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.263274 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-57wjp\"" Jun 02 01:10:58.263528 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.263311 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 01:10:58.263528 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.263422 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 01:10:58.263528 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.263451 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 01:10:58.265030 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.265003 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 01:10:58.266298 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.266262 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h8fml" Jun 02 01:10:58.266813 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.266788 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-l8c6d\"" Jun 02 01:10:58.267138 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.267071 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 01:10:58.268966 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.268945 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-smvzg" Jun 02 01:10:58.269071 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.269034 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.269607 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.269588 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5rgxq\"" Jun 02 01:10:58.269828 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.269772 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 01:10:58.269916 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.269827 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 01:10:58.269916 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.269908 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 01:10:58.270037 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.270025 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:10:58.270096 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:58.270076 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55g5j" podUID="629ae262-2447-41a6-b07c-0dd56b001344" Jun 02 01:10:58.271263 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.271243 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fx5td" Jun 02 01:10:58.271484 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.271462 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 01:10:58.271587 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.271515 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9sq9t\"" Jun 02 01:10:58.271587 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.271562 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 01:10:58.271587 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.271580 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4njkl\"" Jun 02 01:10:58.271744 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.271657 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 01:10:58.273062 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.272975 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.274002 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.273818 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-drbbs\"" Jun 02 01:10:58.274002 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.273844 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 01:10:58.274656 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.274573 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 01:10:58.274656 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.274595 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:10:58.275268 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.274927 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l98v" Jun 02 01:10:58.275900 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.275881 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 01:10:58.275991 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.275911 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 01:10:58.275991 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.275922 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 01:10:58.276096 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.276066 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 01:10:58.276201 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.276184 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 01:10:58.276255 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.276239 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 01:10:58.276255 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.276245 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.276514 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.276413 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tq24g\"" Jun 02 01:10:58.277032 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.277009 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-w8975\"" Jun 02 01:10:58.277217 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.277189 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 01:10:58.277217 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.277200 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 01:10:58.277524 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.277506 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 01:10:58.278541 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.278515 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lwqs7\"" Jun 02 01:10:58.278632 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.278520 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:10:58.278876 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.278832 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 01:10:58.282863 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.282844 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c2983f4a-20eb-4157-81bf-6d793bc6038e-multus-daemon-config\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.282948 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.282878 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql2nv\" (UniqueName: \"kubernetes.io/projected/c2983f4a-20eb-4157-81bf-6d793bc6038e-kube-api-access-ql2nv\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.282948 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.282907 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0bb6450b-b60a-43ec-882c-bb797f71572f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5l98v\" (UID: \"0bb6450b-b60a-43ec-882c-bb797f71572f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l98v" Jun 02 01:10:58.282948 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.282927 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0bb6450b-b60a-43ec-882c-bb797f71572f-sys-fs\") pod \"aws-ebs-csi-driver-node-5l98v\" (UID: \"0bb6450b-b60a-43ec-882c-bb797f71572f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l98v" Jun 02 01:10:58.282948 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.282942 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-log-socket\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.283147 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.282992 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-host-run-ovn-kubernetes\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.283147 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283021 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0bb6450b-b60a-43ec-882c-bb797f71572f-registration-dir\") pod \"aws-ebs-csi-driver-node-5l98v\" (UID: \"0bb6450b-b60a-43ec-882c-bb797f71572f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l98v" Jun 02 01:10:58.283147 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283048 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c56a8f7e-11e7-4958-9d61-b56975c37dbe-cni-binary-copy\") pod \"multus-additional-cni-plugins-8p5xf\" (UID: \"c56a8f7e-11e7-4958-9d61-b56975c37dbe\") " pod="openshift-multus/multus-additional-cni-plugins-8p5xf" Jun 02 01:10:58.283147 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283076 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdt2k\" (UniqueName: \"kubernetes.io/projected/c56a8f7e-11e7-4958-9d61-b56975c37dbe-kube-api-access-gdt2k\") pod \"multus-additional-cni-plugins-8p5xf\" (UID: \"c56a8f7e-11e7-4958-9d61-b56975c37dbe\") " pod="openshift-multus/multus-additional-cni-plugins-8p5xf" Jun 02 01:10:58.283147 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283101 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ff5cd010-d35b-4b58-8008-5c3a1f22deec-hosts-file\") pod \"node-resolver-smvzg\" (UID: \"ff5cd010-d35b-4b58-8008-5c3a1f22deec\") " pod="openshift-dns/node-resolver-smvzg" Jun 02 01:10:58.283395 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283149 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rksvd\" (UniqueName: \"kubernetes.io/projected/2200ba73-d59d-4591-8254-fe06a7ee0bde-kube-api-access-rksvd\") pod \"node-ca-h8fml\" (UID: \"2200ba73-d59d-4591-8254-fe06a7ee0bde\") " pod="openshift-image-registry/node-ca-h8fml" Jun 02 01:10:58.283395 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283174 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-ovnkube-config\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.283395 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283199 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-host-var-lib-cni-bin\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.283395 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283216 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-host-var-lib-cni-multus\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.283395 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283236 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-run\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.283395 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283251 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9kfm\" (UniqueName: \"kubernetes.io/projected/816f36fb-7419-4dcf-950e-4015afa995c2-kube-api-access-g9kfm\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.283395 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283269 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2200ba73-d59d-4591-8254-fe06a7ee0bde-serviceca\") pod \"node-ca-h8fml\" (UID: \"2200ba73-d59d-4591-8254-fe06a7ee0bde\") " pod="openshift-image-registry/node-ca-h8fml" Jun 02 01:10:58.283395 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283294 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-multus-cni-dir\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.283395 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283335 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-cnibin\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.283395 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283359 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-etc-sysctl-d\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.283863 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283403 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c56a8f7e-11e7-4958-9d61-b56975c37dbe-os-release\") pod \"multus-additional-cni-plugins-8p5xf\" (UID: \"c56a8f7e-11e7-4958-9d61-b56975c37dbe\") " pod="openshift-multus/multus-additional-cni-plugins-8p5xf" Jun 02 01:10:58.283863 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283434 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c56a8f7e-11e7-4958-9d61-b56975c37dbe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8p5xf\" (UID: \"c56a8f7e-11e7-4958-9d61-b56975c37dbe\") " pod="openshift-multus/multus-additional-cni-plugins-8p5xf" Jun 02 01:10:58.283863 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283449 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-systemd-units\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.283863 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283465 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-ovn-node-metrics-cert\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.283863 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283512 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-ovnkube-script-lib\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.283863 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283547 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-etc-kubernetes\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.283863 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283575 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-node-log\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.283863 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283598 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrqw8\" (UniqueName: \"kubernetes.io/projected/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-kube-api-access-xrqw8\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.283863 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283624 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0bb6450b-b60a-43ec-882c-bb797f71572f-device-dir\") pod \"aws-ebs-csi-driver-node-5l98v\" (UID: \"0bb6450b-b60a-43ec-882c-bb797f71572f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l98v" Jun 02 01:10:58.283863 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283654 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0c654e7-08a1-4ca8-81c4-5164c7c30e26-metrics-certs\") pod \"network-metrics-daemon-gntp5\" (UID: \"b0c654e7-08a1-4ca8-81c4-5164c7c30e26\") " pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:10:58.283863 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283678 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-host-cni-netd\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.283863 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283699 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-os-release\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.283863 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283721 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-host-run-k8s-cni-cncf-io\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.283863 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283745 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-lib-modules\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.283863 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283769 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2200ba73-d59d-4591-8254-fe06a7ee0bde-host\") pod \"node-ca-h8fml\" (UID: \"2200ba73-d59d-4591-8254-fe06a7ee0bde\") " pod="openshift-image-registry/node-ca-h8fml" Jun 02 01:10:58.283863 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283791 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-etc-kubernetes\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.284621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283837 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-etc-systemd\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.284621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283861 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-var-lib-kubelet\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.284621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283922 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/816f36fb-7419-4dcf-950e-4015afa995c2-etc-tuned\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.284621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283950 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2650d71e-93d2-4e35-930c-aa912e819502-iptables-alerter-script\") pod \"iptables-alerter-fx5td\" (UID: \"2650d71e-93d2-4e35-930c-aa912e819502\") " pod="openshift-network-operator/iptables-alerter-fx5td" Jun 02 01:10:58.284621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.283976 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-host-run-netns\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.284621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.284005 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0bb6450b-b60a-43ec-882c-bb797f71572f-socket-dir\") pod \"aws-ebs-csi-driver-node-5l98v\" (UID: \"0bb6450b-b60a-43ec-882c-bb797f71572f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l98v" Jun 02 01:10:58.284621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.284032 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-host\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.284621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.284056 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c56a8f7e-11e7-4958-9d61-b56975c37dbe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8p5xf\" (UID: \"c56a8f7e-11e7-4958-9d61-b56975c37dbe\") " pod="openshift-multus/multus-additional-cni-plugins-8p5xf" Jun 02 01:10:58.284621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.284082 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c56a8f7e-11e7-4958-9d61-b56975c37dbe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8p5xf\" (UID: \"c56a8f7e-11e7-4958-9d61-b56975c37dbe\") " pod="openshift-multus/multus-additional-cni-plugins-8p5xf" Jun 02 01:10:58.284621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.284164 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-host-slash\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.284621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.284196 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-run-systemd\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.284621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.284221 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff5cd010-d35b-4b58-8008-5c3a1f22deec-tmp-dir\") pod \"node-resolver-smvzg\" (UID: \"ff5cd010-d35b-4b58-8008-5c3a1f22deec\") " pod="openshift-dns/node-resolver-smvzg" Jun 02 01:10:58.284621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.284244 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-sys\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.284621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.284277 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c56a8f7e-11e7-4958-9d61-b56975c37dbe-cnibin\") pod \"multus-additional-cni-plugins-8p5xf\" (UID: \"c56a8f7e-11e7-4958-9d61-b56975c37dbe\") " pod="openshift-multus/multus-additional-cni-plugins-8p5xf" Jun 02 01:10:58.284621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.284314 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f2d9cb2f-663e-4816-8cd2-9c197fe85ece-konnectivity-ca\") pod \"konnectivity-agent-k7hnj\" (UID: \"f2d9cb2f-663e-4816-8cd2-9c197fe85ece\") " pod="kube-system/konnectivity-agent-k7hnj" Jun 02 01:10:58.284621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.284344 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx7m2\" (UniqueName: \"kubernetes.io/projected/ff5cd010-d35b-4b58-8008-5c3a1f22deec-kube-api-access-fx7m2\") pod \"node-resolver-smvzg\" (UID: \"ff5cd010-d35b-4b58-8008-5c3a1f22deec\") " pod="openshift-dns/node-resolver-smvzg" Jun 02 01:10:58.285346 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.284403 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2983f4a-20eb-4157-81bf-6d793bc6038e-cni-binary-copy\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.285346 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.284431 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-multus-conf-dir\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.285346 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.284462 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-etc-modprobe-d\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.285346 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.284485 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c56a8f7e-11e7-4958-9d61-b56975c37dbe-system-cni-dir\") pod \"multus-additional-cni-plugins-8p5xf\" (UID: \"c56a8f7e-11e7-4958-9d61-b56975c37dbe\") " pod="openshift-multus/multus-additional-cni-plugins-8p5xf" Jun 02 01:10:58.285346 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.284501 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-host-var-lib-kubelet\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.285346 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.284523 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/816f36fb-7419-4dcf-950e-4015afa995c2-tmp\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.285346 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.284545 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj2p6\" (UniqueName: \"kubernetes.io/projected/b0c654e7-08a1-4ca8-81c4-5164c7c30e26-kube-api-access-qj2p6\") pod \"network-metrics-daemon-gntp5\" (UID: \"b0c654e7-08a1-4ca8-81c4-5164c7c30e26\") " pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:10:58.285346 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.284584 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2650d71e-93d2-4e35-930c-aa912e819502-host-slash\") pod \"iptables-alerter-fx5td\" (UID: \"2650d71e-93d2-4e35-930c-aa912e819502\") " pod="openshift-network-operator/iptables-alerter-fx5td" Jun 02 01:10:58.285346 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.284608 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-run-ovn\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.285346 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.284631 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-env-overrides\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.285346 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.284729 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-etc-sysconfig\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.285346 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.284767 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzmws\" (UniqueName: \"kubernetes.io/projected/2650d71e-93d2-4e35-930c-aa912e819502-kube-api-access-vzmws\") pod \"iptables-alerter-fx5td\" (UID: \"2650d71e-93d2-4e35-930c-aa912e819502\") " pod="openshift-network-operator/iptables-alerter-fx5td" Jun 02 01:10:58.285346 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.284805 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f2d9cb2f-663e-4816-8cd2-9c197fe85ece-agent-certs\") pod \"konnectivity-agent-k7hnj\" (UID: \"f2d9cb2f-663e-4816-8cd2-9c197fe85ece\") " pod="kube-system/konnectivity-agent-k7hnj" Jun 02 01:10:58.285346 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.284845 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-host-run-netns\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.285346 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.284901 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-run-openvswitch\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.285346 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.284927 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.285922 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.284963 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-system-cni-dir\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.285922 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.284989 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-multus-socket-dir-parent\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.285922 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.285327 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-hostroot\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.285922 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.285388 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0bb6450b-b60a-43ec-882c-bb797f71572f-etc-selinux\") pod \"aws-ebs-csi-driver-node-5l98v\" (UID: \"0bb6450b-b60a-43ec-882c-bb797f71572f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l98v" Jun 02 01:10:58.285922 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.285421 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-host-kubelet\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.285922 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.285453 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-var-lib-openvswitch\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.285922 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.285479 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-host-cni-bin\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.285922 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.285510 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-host-run-multus-certs\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.285922 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.285547 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmwsd\" (UniqueName: \"kubernetes.io/projected/629ae262-2447-41a6-b07c-0dd56b001344-kube-api-access-hmwsd\") pod \"network-check-target-55g5j\" (UID: \"629ae262-2447-41a6-b07c-0dd56b001344\") " pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:10:58.285922 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.285578 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbzpv\" (UniqueName: \"kubernetes.io/projected/0bb6450b-b60a-43ec-882c-bb797f71572f-kube-api-access-mbzpv\") pod \"aws-ebs-csi-driver-node-5l98v\" (UID: \"0bb6450b-b60a-43ec-882c-bb797f71572f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l98v" Jun 02 01:10:58.285922 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.285620 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-etc-sysctl-conf\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.285922 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.285650 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-etc-openvswitch\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.312981 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.312949 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 01:05:57 +0000 UTC" deadline="2028-03-05 04:51:22.125936538 +0000 UTC" Jun 02 01:10:58.312981 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.312981 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15411h40m23.812959276s" Jun 02 01:10:58.375911 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.375878 2576 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 01:10:58.386152 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386120 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-var-lib-openvswitch\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.386304 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386156 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-host-cni-bin\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.386304 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386180 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-host-run-multus-certs\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.386304 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386202 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hmwsd\" (UniqueName: \"kubernetes.io/projected/629ae262-2447-41a6-b07c-0dd56b001344-kube-api-access-hmwsd\") pod \"network-check-target-55g5j\" (UID: \"629ae262-2447-41a6-b07c-0dd56b001344\") " pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:10:58.386304 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386225 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mbzpv\" (UniqueName: \"kubernetes.io/projected/0bb6450b-b60a-43ec-882c-bb797f71572f-kube-api-access-mbzpv\") pod \"aws-ebs-csi-driver-node-5l98v\" (UID: \"0bb6450b-b60a-43ec-882c-bb797f71572f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l98v" Jun 02 01:10:58.386304 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386249 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-etc-sysctl-conf\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.386304 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386252 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-var-lib-openvswitch\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.386304 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386270 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-etc-openvswitch\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.386659 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386312 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c2983f4a-20eb-4157-81bf-6d793bc6038e-multus-daemon-config\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.386659 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386339 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ql2nv\" (UniqueName: \"kubernetes.io/projected/c2983f4a-20eb-4157-81bf-6d793bc6038e-kube-api-access-ql2nv\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.386659 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386389 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0bb6450b-b60a-43ec-882c-bb797f71572f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5l98v\" (UID: \"0bb6450b-b60a-43ec-882c-bb797f71572f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l98v" Jun 02 01:10:58.386659 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386393 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-host-run-multus-certs\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.386659 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386425 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0bb6450b-b60a-43ec-882c-bb797f71572f-sys-fs\") pod \"aws-ebs-csi-driver-node-5l98v\" (UID: \"0bb6450b-b60a-43ec-882c-bb797f71572f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l98v" Jun 02 01:10:58.386659 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386451 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-log-socket\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.386659 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386476 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-host-run-ovn-kubernetes\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.386659 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386514 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0bb6450b-b60a-43ec-882c-bb797f71572f-registration-dir\") pod \"aws-ebs-csi-driver-node-5l98v\" (UID: \"0bb6450b-b60a-43ec-882c-bb797f71572f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l98v" Jun 02 01:10:58.386659 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386572 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c56a8f7e-11e7-4958-9d61-b56975c37dbe-cni-binary-copy\") pod \"multus-additional-cni-plugins-8p5xf\" (UID: \"c56a8f7e-11e7-4958-9d61-b56975c37dbe\") " pod="openshift-multus/multus-additional-cni-plugins-8p5xf" Jun 02 01:10:58.386659 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386599 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gdt2k\" (UniqueName: \"kubernetes.io/projected/c56a8f7e-11e7-4958-9d61-b56975c37dbe-kube-api-access-gdt2k\") pod \"multus-additional-cni-plugins-8p5xf\" (UID: \"c56a8f7e-11e7-4958-9d61-b56975c37dbe\") " pod="openshift-multus/multus-additional-cni-plugins-8p5xf" Jun 02 01:10:58.386659 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386625 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ff5cd010-d35b-4b58-8008-5c3a1f22deec-hosts-file\") pod \"node-resolver-smvzg\" (UID: \"ff5cd010-d35b-4b58-8008-5c3a1f22deec\") " pod="openshift-dns/node-resolver-smvzg" Jun 02 01:10:58.386659 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386636 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0bb6450b-b60a-43ec-882c-bb797f71572f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5l98v\" (UID: \"0bb6450b-b60a-43ec-882c-bb797f71572f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l98v" Jun 02 01:10:58.386659 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386650 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rksvd\" (UniqueName: \"kubernetes.io/projected/2200ba73-d59d-4591-8254-fe06a7ee0bde-kube-api-access-rksvd\") pod \"node-ca-h8fml\" (UID: \"2200ba73-d59d-4591-8254-fe06a7ee0bde\") " pod="openshift-image-registry/node-ca-h8fml" Jun 02 01:10:58.387263 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386694 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-ovnkube-config\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.387263 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386718 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0bb6450b-b60a-43ec-882c-bb797f71572f-sys-fs\") pod \"aws-ebs-csi-driver-node-5l98v\" (UID: \"0bb6450b-b60a-43ec-882c-bb797f71572f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l98v" Jun 02 01:10:58.387263 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386732 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-host-var-lib-cni-bin\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.387263 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386760 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-host-var-lib-cni-multus\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.387263 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386763 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-etc-sysctl-conf\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.387263 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386767 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-log-socket\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.387263 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386787 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-run\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.387263 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386313 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-etc-openvswitch\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.387263 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386802 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-host-run-ovn-kubernetes\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.387263 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386815 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g9kfm\" (UniqueName: \"kubernetes.io/projected/816f36fb-7419-4dcf-950e-4015afa995c2-kube-api-access-g9kfm\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.387263 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386343 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-host-cni-bin\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.387263 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386859 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ff5cd010-d35b-4b58-8008-5c3a1f22deec-hosts-file\") pod \"node-resolver-smvzg\" (UID: \"ff5cd010-d35b-4b58-8008-5c3a1f22deec\") " pod="openshift-dns/node-resolver-smvzg" Jun 02 01:10:58.387263 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386894 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2200ba73-d59d-4591-8254-fe06a7ee0bde-serviceca\") pod \"node-ca-h8fml\" (UID: \"2200ba73-d59d-4591-8254-fe06a7ee0bde\") " pod="openshift-image-registry/node-ca-h8fml" Jun 02 01:10:58.387263 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386919 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-multus-cni-dir\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.387263 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386946 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-cnibin\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.387263 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.386990 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-etc-sysctl-d\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.387263 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387019 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c56a8f7e-11e7-4958-9d61-b56975c37dbe-os-release\") pod \"multus-additional-cni-plugins-8p5xf\" (UID: \"c56a8f7e-11e7-4958-9d61-b56975c37dbe\") " pod="openshift-multus/multus-additional-cni-plugins-8p5xf" Jun 02 01:10:58.387263 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387039 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c56a8f7e-11e7-4958-9d61-b56975c37dbe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8p5xf\" (UID: \"c56a8f7e-11e7-4958-9d61-b56975c37dbe\") " pod="openshift-multus/multus-additional-cni-plugins-8p5xf" Jun 02 01:10:58.388090 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387048 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-host-var-lib-cni-bin\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.388090 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387055 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-systemd-units\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.388090 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387076 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-systemd-units\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.388090 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387096 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-ovn-node-metrics-cert\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.388090 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387126 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-ovnkube-script-lib\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.388090 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387154 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-etc-kubernetes\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.388090 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387179 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-node-log\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.388090 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387206 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xrqw8\" (UniqueName: \"kubernetes.io/projected/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-kube-api-access-xrqw8\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.388090 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387229 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0bb6450b-b60a-43ec-882c-bb797f71572f-device-dir\") pod \"aws-ebs-csi-driver-node-5l98v\" (UID: \"0bb6450b-b60a-43ec-882c-bb797f71572f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l98v" Jun 02 01:10:58.388090 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387277 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0c654e7-08a1-4ca8-81c4-5164c7c30e26-metrics-certs\") pod \"network-metrics-daemon-gntp5\" (UID: \"b0c654e7-08a1-4ca8-81c4-5164c7c30e26\") " pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:10:58.388090 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387303 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-host-cni-netd\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.388090 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387331 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-os-release\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.388090 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387354 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-host-run-k8s-cni-cncf-io\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.388090 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387396 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-lib-modules\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.388090 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387361 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c56a8f7e-11e7-4958-9d61-b56975c37dbe-cni-binary-copy\") pod \"multus-additional-cni-plugins-8p5xf\" (UID: \"c56a8f7e-11e7-4958-9d61-b56975c37dbe\") " pod="openshift-multus/multus-additional-cni-plugins-8p5xf" Jun 02 01:10:58.388090 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387419 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2200ba73-d59d-4591-8254-fe06a7ee0bde-host\") pod \"node-ca-h8fml\" (UID: \"2200ba73-d59d-4591-8254-fe06a7ee0bde\") " pod="openshift-image-registry/node-ca-h8fml" Jun 02 01:10:58.388090 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387429 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c2983f4a-20eb-4157-81bf-6d793bc6038e-multus-daemon-config\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.388090 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387446 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-etc-kubernetes\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.388987 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387361 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-ovnkube-config\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.388987 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387475 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-etc-systemd\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.388987 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387500 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-var-lib-kubelet\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.388987 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387503 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0bb6450b-b60a-43ec-882c-bb797f71572f-device-dir\") pod \"aws-ebs-csi-driver-node-5l98v\" (UID: \"0bb6450b-b60a-43ec-882c-bb797f71572f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l98v" Jun 02 01:10:58.388987 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387506 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2200ba73-d59d-4591-8254-fe06a7ee0bde-serviceca\") pod \"node-ca-h8fml\" (UID: \"2200ba73-d59d-4591-8254-fe06a7ee0bde\") " pod="openshift-image-registry/node-ca-h8fml" Jun 02 01:10:58.388987 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387527 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/816f36fb-7419-4dcf-950e-4015afa995c2-etc-tuned\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.388987 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387553 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2650d71e-93d2-4e35-930c-aa912e819502-iptables-alerter-script\") pod \"iptables-alerter-fx5td\" (UID: \"2650d71e-93d2-4e35-930c-aa912e819502\") " pod="openshift-network-operator/iptables-alerter-fx5td" Jun 02 01:10:58.388987 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387580 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-host-run-netns\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.388987 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387605 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0bb6450b-b60a-43ec-882c-bb797f71572f-socket-dir\") pod \"aws-ebs-csi-driver-node-5l98v\" (UID: \"0bb6450b-b60a-43ec-882c-bb797f71572f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l98v" Jun 02 01:10:58.388987 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387632 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-etc-kubernetes\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.388987 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387635 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-host\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.388987 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387663 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-etc-sysctl-d\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.388987 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387679 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c56a8f7e-11e7-4958-9d61-b56975c37dbe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8p5xf\" (UID: \"c56a8f7e-11e7-4958-9d61-b56975c37dbe\") " pod="openshift-multus/multus-additional-cni-plugins-8p5xf" Jun 02 01:10:58.388987 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387711 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c56a8f7e-11e7-4958-9d61-b56975c37dbe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8p5xf\" (UID: \"c56a8f7e-11e7-4958-9d61-b56975c37dbe\") " pod="openshift-multus/multus-additional-cni-plugins-8p5xf" Jun 02 01:10:58.388987 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387725 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c56a8f7e-11e7-4958-9d61-b56975c37dbe-os-release\") pod \"multus-additional-cni-plugins-8p5xf\" (UID: \"c56a8f7e-11e7-4958-9d61-b56975c37dbe\") " pod="openshift-multus/multus-additional-cni-plugins-8p5xf" Jun 02 01:10:58.388987 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387740 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-host-slash\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.388987 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387766 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-run-systemd\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.389772 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387787 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0bb6450b-b60a-43ec-882c-bb797f71572f-registration-dir\") pod \"aws-ebs-csi-driver-node-5l98v\" (UID: \"0bb6450b-b60a-43ec-882c-bb797f71572f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l98v" Jun 02 01:10:58.389772 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387793 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff5cd010-d35b-4b58-8008-5c3a1f22deec-tmp-dir\") pod \"node-resolver-smvzg\" (UID: \"ff5cd010-d35b-4b58-8008-5c3a1f22deec\") " pod="openshift-dns/node-resolver-smvzg" Jun 02 01:10:58.389772 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387820 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-sys\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.389772 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387833 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c56a8f7e-11e7-4958-9d61-b56975c37dbe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8p5xf\" (UID: \"c56a8f7e-11e7-4958-9d61-b56975c37dbe\") " pod="openshift-multus/multus-additional-cni-plugins-8p5xf" Jun 02 01:10:58.389772 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387835 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 01:10:58.389772 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387847 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c56a8f7e-11e7-4958-9d61-b56975c37dbe-cnibin\") pod \"multus-additional-cni-plugins-8p5xf\" (UID: \"c56a8f7e-11e7-4958-9d61-b56975c37dbe\") " pod="openshift-multus/multus-additional-cni-plugins-8p5xf" Jun 02 01:10:58.389772 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387854 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-var-lib-kubelet\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.389772 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387874 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f2d9cb2f-663e-4816-8cd2-9c197fe85ece-konnectivity-ca\") pod \"konnectivity-agent-k7hnj\" (UID: \"f2d9cb2f-663e-4816-8cd2-9c197fe85ece\") " pod="kube-system/konnectivity-agent-k7hnj" Jun 02 01:10:58.389772 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387881 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-node-log\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.389772 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387911 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-run\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.389772 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387911 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fx7m2\" (UniqueName: \"kubernetes.io/projected/ff5cd010-d35b-4b58-8008-5c3a1f22deec-kube-api-access-fx7m2\") pod \"node-resolver-smvzg\" (UID: \"ff5cd010-d35b-4b58-8008-5c3a1f22deec\") " pod="openshift-dns/node-resolver-smvzg" Jun 02 01:10:58.389772 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388150 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2983f4a-20eb-4157-81bf-6d793bc6038e-cni-binary-copy\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.389772 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388170 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-host-run-netns\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.389772 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388179 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-multus-conf-dir\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.389772 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388211 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-multus-conf-dir\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.389772 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388214 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-etc-modprobe-d\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.389772 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388246 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c56a8f7e-11e7-4958-9d61-b56975c37dbe-system-cni-dir\") pod \"multus-additional-cni-plugins-8p5xf\" (UID: \"c56a8f7e-11e7-4958-9d61-b56975c37dbe\") " pod="openshift-multus/multus-additional-cni-plugins-8p5xf" Jun 02 01:10:58.389772 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388274 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-multus-cni-dir\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.390621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388276 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-host-var-lib-kubelet\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.390621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388305 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/816f36fb-7419-4dcf-950e-4015afa995c2-tmp\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.390621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388332 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qj2p6\" (UniqueName: \"kubernetes.io/projected/b0c654e7-08a1-4ca8-81c4-5164c7c30e26-kube-api-access-qj2p6\") pod \"network-metrics-daemon-gntp5\" (UID: \"b0c654e7-08a1-4ca8-81c4-5164c7c30e26\") " pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:10:58.390621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388359 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2650d71e-93d2-4e35-930c-aa912e819502-host-slash\") pod \"iptables-alerter-fx5td\" (UID: \"2650d71e-93d2-4e35-930c-aa912e819502\") " pod="openshift-network-operator/iptables-alerter-fx5td" Jun 02 01:10:58.390621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388404 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-run-ovn\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.390621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388411 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-ovnkube-script-lib\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.390621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388431 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-env-overrides\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.390621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388456 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-etc-sysconfig\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.390621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388483 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vzmws\" (UniqueName: \"kubernetes.io/projected/2650d71e-93d2-4e35-930c-aa912e819502-kube-api-access-vzmws\") pod \"iptables-alerter-fx5td\" (UID: \"2650d71e-93d2-4e35-930c-aa912e819502\") " pod="openshift-network-operator/iptables-alerter-fx5td" Jun 02 01:10:58.390621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388496 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-etc-kubernetes\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.390621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388547 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f2d9cb2f-663e-4816-8cd2-9c197fe85ece-agent-certs\") pod \"konnectivity-agent-k7hnj\" (UID: \"f2d9cb2f-663e-4816-8cd2-9c197fe85ece\") " pod="kube-system/konnectivity-agent-k7hnj" Jun 02 01:10:58.390621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388577 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-host-run-netns\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.390621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388603 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-run-openvswitch\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.390621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388644 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.390621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388672 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-system-cni-dir\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.390621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388717 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-multus-socket-dir-parent\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.390621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388743 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-hostroot\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.391420 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388768 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0bb6450b-b60a-43ec-882c-bb797f71572f-etc-selinux\") pod \"aws-ebs-csi-driver-node-5l98v\" (UID: \"0bb6450b-b60a-43ec-882c-bb797f71572f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l98v" Jun 02 01:10:58.391420 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388788 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-etc-sysconfig\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.391420 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388801 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-host-kubelet\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.391420 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388822 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2650d71e-93d2-4e35-930c-aa912e819502-iptables-alerter-script\") pod \"iptables-alerter-fx5td\" (UID: \"2650d71e-93d2-4e35-930c-aa912e819502\") " pod="openshift-network-operator/iptables-alerter-fx5td" Jun 02 01:10:58.391420 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388836 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0bb6450b-b60a-43ec-882c-bb797f71572f-socket-dir\") pod \"aws-ebs-csi-driver-node-5l98v\" (UID: \"0bb6450b-b60a-43ec-882c-bb797f71572f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l98v" Jun 02 01:10:58.391420 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388877 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-etc-modprobe-d\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.391420 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388887 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-host-kubelet\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.391420 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388941 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.391420 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388953 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2650d71e-93d2-4e35-930c-aa912e819502-host-slash\") pod \"iptables-alerter-fx5td\" (UID: \"2650d71e-93d2-4e35-930c-aa912e819502\") " pod="openshift-network-operator/iptables-alerter-fx5td" Jun 02 01:10:58.391420 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388988 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-host-var-lib-kubelet\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.391420 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.389034 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-run-ovn\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.391420 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.388889 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-run-openvswitch\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.391420 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.389144 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-multus-socket-dir-parent\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.391420 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.389194 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c56a8f7e-11e7-4958-9d61-b56975c37dbe-system-cni-dir\") pod \"multus-additional-cni-plugins-8p5xf\" (UID: \"c56a8f7e-11e7-4958-9d61-b56975c37dbe\") " pod="openshift-multus/multus-additional-cni-plugins-8p5xf" Jun 02 01:10:58.391420 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.389202 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-hostroot\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.391420 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.387682 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-host\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.391420 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.389267 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c2983f4a-20eb-4157-81bf-6d793bc6038e-cni-binary-copy\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.391420 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:58.389300 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:10:58.392214 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.389320 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-host-run-netns\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.392214 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.389361 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-host-var-lib-cni-multus\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.392214 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:58.389410 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0c654e7-08a1-4ca8-81c4-5164c7c30e26-metrics-certs podName:b0c654e7-08a1-4ca8-81c4-5164c7c30e26 nodeName:}" failed. No retries permitted until 2026-06-02 01:10:58.889347437 +0000 UTC m=+3.059889621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0c654e7-08a1-4ca8-81c4-5164c7c30e26-metrics-certs") pod "network-metrics-daemon-gntp5" (UID: "b0c654e7-08a1-4ca8-81c4-5164c7c30e26") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:10:58.392214 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.389423 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-env-overrides\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.392214 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.389425 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-host-run-k8s-cni-cncf-io\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.392214 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.389453 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0bb6450b-b60a-43ec-882c-bb797f71572f-etc-selinux\") pod \"aws-ebs-csi-driver-node-5l98v\" (UID: \"0bb6450b-b60a-43ec-882c-bb797f71572f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l98v" Jun 02 01:10:58.392214 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.389481 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-host-cni-netd\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.392214 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.389483 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-system-cni-dir\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.392214 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.389510 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-lib-modules\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.392214 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.389532 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-os-release\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.392214 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.389577 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2200ba73-d59d-4591-8254-fe06a7ee0bde-host\") pod \"node-ca-h8fml\" (UID: \"2200ba73-d59d-4591-8254-fe06a7ee0bde\") " pod="openshift-image-registry/node-ca-h8fml" Jun 02 01:10:58.392214 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.389608 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-run-systemd\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.392214 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.389641 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-etc-systemd\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.392214 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.389672 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-host-slash\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.392214 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.389712 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/816f36fb-7419-4dcf-950e-4015afa995c2-sys\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.392214 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.389804 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c56a8f7e-11e7-4958-9d61-b56975c37dbe-cnibin\") pod \"multus-additional-cni-plugins-8p5xf\" (UID: \"c56a8f7e-11e7-4958-9d61-b56975c37dbe\") " pod="openshift-multus/multus-additional-cni-plugins-8p5xf" Jun 02 01:10:58.392214 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.389948 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c2983f4a-20eb-4157-81bf-6d793bc6038e-cnibin\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.392953 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.389952 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c56a8f7e-11e7-4958-9d61-b56975c37dbe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8p5xf\" (UID: \"c56a8f7e-11e7-4958-9d61-b56975c37dbe\") " pod="openshift-multus/multus-additional-cni-plugins-8p5xf" Jun 02 01:10:58.392953 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.389976 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff5cd010-d35b-4b58-8008-5c3a1f22deec-tmp-dir\") pod \"node-resolver-smvzg\" (UID: \"ff5cd010-d35b-4b58-8008-5c3a1f22deec\") " pod="openshift-dns/node-resolver-smvzg" Jun 02 01:10:58.392953 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.390091 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c56a8f7e-11e7-4958-9d61-b56975c37dbe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8p5xf\" (UID: \"c56a8f7e-11e7-4958-9d61-b56975c37dbe\") " pod="openshift-multus/multus-additional-cni-plugins-8p5xf" Jun 02 01:10:58.392953 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.390297 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f2d9cb2f-663e-4816-8cd2-9c197fe85ece-konnectivity-ca\") pod \"konnectivity-agent-k7hnj\" (UID: \"f2d9cb2f-663e-4816-8cd2-9c197fe85ece\") " pod="kube-system/konnectivity-agent-k7hnj" Jun 02 01:10:58.392953 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.392581 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/816f36fb-7419-4dcf-950e-4015afa995c2-tmp\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.392953 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.392702 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-ovn-node-metrics-cert\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.393691 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:58.393668 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:10:58.393805 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:58.393704 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:10:58.393805 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:58.393719 2576 projected.go:194] Error preparing data for projected volume kube-api-access-hmwsd for pod openshift-network-diagnostics/network-check-target-55g5j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:10:58.393921 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:58.393827 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/629ae262-2447-41a6-b07c-0dd56b001344-kube-api-access-hmwsd podName:629ae262-2447-41a6-b07c-0dd56b001344 nodeName:}" failed. No retries permitted until 2026-06-02 01:10:58.893806613 +0000 UTC m=+3.064348795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hmwsd" (UniqueName: "kubernetes.io/projected/629ae262-2447-41a6-b07c-0dd56b001344-kube-api-access-hmwsd") pod "network-check-target-55g5j" (UID: "629ae262-2447-41a6-b07c-0dd56b001344") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:10:58.394612 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.393997 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f2d9cb2f-663e-4816-8cd2-9c197fe85ece-agent-certs\") pod \"konnectivity-agent-k7hnj\" (UID: \"f2d9cb2f-663e-4816-8cd2-9c197fe85ece\") " pod="kube-system/konnectivity-agent-k7hnj" Jun 02 01:10:58.397888 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.397831 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/816f36fb-7419-4dcf-950e-4015afa995c2-etc-tuned\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.403447 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.402269 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rksvd\" (UniqueName: \"kubernetes.io/projected/2200ba73-d59d-4591-8254-fe06a7ee0bde-kube-api-access-rksvd\") pod \"node-ca-h8fml\" (UID: \"2200ba73-d59d-4591-8254-fe06a7ee0bde\") " pod="openshift-image-registry/node-ca-h8fml" Jun 02 01:10:58.403447 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.402761 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdt2k\" (UniqueName: \"kubernetes.io/projected/c56a8f7e-11e7-4958-9d61-b56975c37dbe-kube-api-access-gdt2k\") pod \"multus-additional-cni-plugins-8p5xf\" (UID: \"c56a8f7e-11e7-4958-9d61-b56975c37dbe\") " pod="openshift-multus/multus-additional-cni-plugins-8p5xf" Jun 02 01:10:58.403447 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.403345 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj2p6\" (UniqueName: \"kubernetes.io/projected/b0c654e7-08a1-4ca8-81c4-5164c7c30e26-kube-api-access-qj2p6\") pod \"network-metrics-daemon-gntp5\" (UID: \"b0c654e7-08a1-4ca8-81c4-5164c7c30e26\") " pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:10:58.404395 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.404349 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9kfm\" (UniqueName: \"kubernetes.io/projected/816f36fb-7419-4dcf-950e-4015afa995c2-kube-api-access-g9kfm\") pod \"tuned-7qlgt\" (UID: \"816f36fb-7419-4dcf-950e-4015afa995c2\") " pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.406167 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.406142 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx7m2\" (UniqueName: \"kubernetes.io/projected/ff5cd010-d35b-4b58-8008-5c3a1f22deec-kube-api-access-fx7m2\") pod \"node-resolver-smvzg\" (UID: \"ff5cd010-d35b-4b58-8008-5c3a1f22deec\") " pod="openshift-dns/node-resolver-smvzg" Jun 02 01:10:58.406336 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.406275 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql2nv\" (UniqueName: \"kubernetes.io/projected/c2983f4a-20eb-4157-81bf-6d793bc6038e-kube-api-access-ql2nv\") pod \"multus-svwjt\" (UID: \"c2983f4a-20eb-4157-81bf-6d793bc6038e\") " pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.408021 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.407986 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbzpv\" (UniqueName: \"kubernetes.io/projected/0bb6450b-b60a-43ec-882c-bb797f71572f-kube-api-access-mbzpv\") pod \"aws-ebs-csi-driver-node-5l98v\" (UID: \"0bb6450b-b60a-43ec-882c-bb797f71572f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l98v" Jun 02 01:10:58.408336 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.408294 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrqw8\" (UniqueName: \"kubernetes.io/projected/b6d9386e-1aeb-41d2-8b3d-0a088b8724cb-kube-api-access-xrqw8\") pod \"ovnkube-node-lkf95\" (UID: \"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.408570 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.408550 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzmws\" (UniqueName: \"kubernetes.io/projected/2650d71e-93d2-4e35-930c-aa912e819502-kube-api-access-vzmws\") pod \"iptables-alerter-fx5td\" (UID: \"2650d71e-93d2-4e35-930c-aa912e819502\") " pod="openshift-network-operator/iptables-alerter-fx5td" Jun 02 01:10:58.579705 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.579677 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8p5xf" Jun 02 01:10:58.586288 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.586264 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-k7hnj" Jun 02 01:10:58.586566 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:58.586544 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc56a8f7e_11e7_4958_9d61_b56975c37dbe.slice/crio-6e5f27addcbd5c53b4ce36839ef61e5dea936a0fa8f624f148d9c624fa4d9b98 WatchSource:0}: Error finding container 6e5f27addcbd5c53b4ce36839ef61e5dea936a0fa8f624f148d9c624fa4d9b98: Status 404 returned error can't find the container with id 6e5f27addcbd5c53b4ce36839ef61e5dea936a0fa8f624f148d9c624fa4d9b98 Jun 02 01:10:58.592793 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:58.592761 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2d9cb2f_663e_4816_8cd2_9c197fe85ece.slice/crio-78bcbbac077e3cdef1f4f00ebd94367199c6fcbd515774e4d88e8110ca31cbb9 WatchSource:0}: Error finding container 78bcbbac077e3cdef1f4f00ebd94367199c6fcbd515774e4d88e8110ca31cbb9: Status 404 returned error can't find the container with id 78bcbbac077e3cdef1f4f00ebd94367199c6fcbd515774e4d88e8110ca31cbb9 Jun 02 01:10:58.596194 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.596173 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h8fml" Jun 02 01:10:58.600418 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.600399 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-smvzg" Jun 02 01:10:58.604303 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:58.604249 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2200ba73_d59d_4591_8254_fe06a7ee0bde.slice/crio-3bac616b1ea945dfb86dbf14c529c2837205c80c24c0c0d4295993e99cdb5649 WatchSource:0}: Error finding container 3bac616b1ea945dfb86dbf14c529c2837205c80c24c0c0d4295993e99cdb5649: Status 404 returned error can't find the container with id 3bac616b1ea945dfb86dbf14c529c2837205c80c24c0c0d4295993e99cdb5649 Jun 02 01:10:58.607447 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.607423 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-svwjt" Jun 02 01:10:58.607687 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:58.607655 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff5cd010_d35b_4b58_8008_5c3a1f22deec.slice/crio-5bcff5ca8ab8626ccaac4303609fb6a0ce1602764a58f356f6d916a26d3018ba WatchSource:0}: Error finding container 5bcff5ca8ab8626ccaac4303609fb6a0ce1602764a58f356f6d916a26d3018ba: Status 404 returned error can't find the container with id 5bcff5ca8ab8626ccaac4303609fb6a0ce1602764a58f356f6d916a26d3018ba Jun 02 01:10:58.615473 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.615453 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fx5td" Jun 02 01:10:58.619598 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:58.619571 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2983f4a_20eb_4157_81bf_6d793bc6038e.slice/crio-12166f01b843ae16a84be45903580078020337d312525058e641aba148735ebf WatchSource:0}: Error finding container 12166f01b843ae16a84be45903580078020337d312525058e641aba148735ebf: Status 404 returned error can't find the container with id 12166f01b843ae16a84be45903580078020337d312525058e641aba148735ebf Jun 02 01:10:58.623239 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.623037 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l98v" Jun 02 01:10:58.623342 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:58.623265 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2650d71e_93d2_4e35_930c_aa912e819502.slice/crio-962f944ce421b8b03069aab8887c2cf71be2d3fb29fc31169126a6858fed015f WatchSource:0}: Error finding container 962f944ce421b8b03069aab8887c2cf71be2d3fb29fc31169126a6858fed015f: Status 404 returned error can't find the container with id 962f944ce421b8b03069aab8887c2cf71be2d3fb29fc31169126a6858fed015f Jun 02 01:10:58.629992 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:58.629959 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bb6450b_b60a_43ec_882c_bb797f71572f.slice/crio-d511b8743036b1c6b1d27468373f830299d3aa2235689cc0cf16688a1246ee16 WatchSource:0}: Error finding container d511b8743036b1c6b1d27468373f830299d3aa2235689cc0cf16688a1246ee16: Status 404 returned error can't find the container with id d511b8743036b1c6b1d27468373f830299d3aa2235689cc0cf16688a1246ee16 Jun 02 01:10:58.630984 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.630963 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:10:58.636935 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.636914 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" Jun 02 01:10:58.637483 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:58.637426 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6d9386e_1aeb_41d2_8b3d_0a088b8724cb.slice/crio-102a9748925ac2c01a4da47742a096a3f4c57f4733ee5cd0ab153b80089a45a3 WatchSource:0}: Error finding container 102a9748925ac2c01a4da47742a096a3f4c57f4733ee5cd0ab153b80089a45a3: Status 404 returned error can't find the container with id 102a9748925ac2c01a4da47742a096a3f4c57f4733ee5cd0ab153b80089a45a3 Jun 02 01:10:58.644058 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:10:58.644038 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod816f36fb_7419_4dcf_950e_4015afa995c2.slice/crio-e00eb26ae629edd590c5733e9e5197e54145f31e6b4c9e5d0d2f0d34692772f0 WatchSource:0}: Error finding container e00eb26ae629edd590c5733e9e5197e54145f31e6b4c9e5d0d2f0d34692772f0: Status 404 returned error can't find the container with id e00eb26ae629edd590c5733e9e5197e54145f31e6b4c9e5d0d2f0d34692772f0 Jun 02 01:10:58.646025 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.646010 2576 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:10:58.893233 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.893193 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0c654e7-08a1-4ca8-81c4-5164c7c30e26-metrics-certs\") pod \"network-metrics-daemon-gntp5\" (UID: \"b0c654e7-08a1-4ca8-81c4-5164c7c30e26\") " pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:10:58.893427 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:58.893328 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:10:58.893427 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:58.893416 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0c654e7-08a1-4ca8-81c4-5164c7c30e26-metrics-certs podName:b0c654e7-08a1-4ca8-81c4-5164c7c30e26 nodeName:}" failed. No retries permitted until 2026-06-02 01:10:59.89339701 +0000 UTC m=+4.063939179 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0c654e7-08a1-4ca8-81c4-5164c7c30e26-metrics-certs") pod "network-metrics-daemon-gntp5" (UID: "b0c654e7-08a1-4ca8-81c4-5164c7c30e26") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:10:58.994447 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:58.994404 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hmwsd\" (UniqueName: \"kubernetes.io/projected/629ae262-2447-41a6-b07c-0dd56b001344-kube-api-access-hmwsd\") pod \"network-check-target-55g5j\" (UID: \"629ae262-2447-41a6-b07c-0dd56b001344\") " pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:10:58.994627 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:58.994551 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:10:58.994627 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:58.994576 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:10:58.994627 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:58.994586 2576 projected.go:194] Error preparing data for projected volume kube-api-access-hmwsd for pod openshift-network-diagnostics/network-check-target-55g5j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:10:58.994790 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:58.994636 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/629ae262-2447-41a6-b07c-0dd56b001344-kube-api-access-hmwsd podName:629ae262-2447-41a6-b07c-0dd56b001344 nodeName:}" failed. No retries permitted until 2026-06-02 01:10:59.994622217 +0000 UTC m=+4.165164386 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmwsd" (UniqueName: "kubernetes.io/projected/629ae262-2447-41a6-b07c-0dd56b001344-kube-api-access-hmwsd") pod "network-check-target-55g5j" (UID: "629ae262-2447-41a6-b07c-0dd56b001344") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:10:59.313237 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:59.313168 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 01:05:57 +0000 UTC" deadline="2027-11-19 17:01:01.778094039 +0000 UTC" Jun 02 01:10:59.313237 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:59.313207 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12855h50m2.464890476s" Jun 02 01:10:59.402437 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:59.401907 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:10:59.402437 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:59.402037 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55g5j" podUID="629ae262-2447-41a6-b07c-0dd56b001344" Jun 02 01:10:59.415444 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:59.414764 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-192.ec2.internal" event={"ID":"b03870c6e03d09f5797a675c8ae41336","Type":"ContainerStarted","Data":"3a62c349a8c5af81093bfc3fd07558a06fb67f3a46d255487b6e990f520f4768"} Jun 02 01:10:59.418717 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:59.418232 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" event={"ID":"816f36fb-7419-4dcf-950e-4015afa995c2","Type":"ContainerStarted","Data":"e00eb26ae629edd590c5733e9e5197e54145f31e6b4c9e5d0d2f0d34692772f0"} Jun 02 01:10:59.424237 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:59.424178 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fx5td" event={"ID":"2650d71e-93d2-4e35-930c-aa912e819502","Type":"ContainerStarted","Data":"962f944ce421b8b03069aab8887c2cf71be2d3fb29fc31169126a6858fed015f"} Jun 02 01:10:59.428546 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:59.428505 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-smvzg" event={"ID":"ff5cd010-d35b-4b58-8008-5c3a1f22deec","Type":"ContainerStarted","Data":"5bcff5ca8ab8626ccaac4303609fb6a0ce1602764a58f356f6d916a26d3018ba"} Jun 02 01:10:59.429321 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:59.428927 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-192.ec2.internal" podStartSLOduration=2.4289121160000002 podStartE2EDuration="2.428912116s" podCreationTimestamp="2026-06-02 01:10:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:10:59.428511658 +0000 UTC m=+3.599053847" watchObservedRunningTime="2026-06-02 01:10:59.428912116 +0000 UTC m=+3.599454303" Jun 02 01:10:59.432866 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:59.432839 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h8fml" event={"ID":"2200ba73-d59d-4591-8254-fe06a7ee0bde","Type":"ContainerStarted","Data":"3bac616b1ea945dfb86dbf14c529c2837205c80c24c0c0d4295993e99cdb5649"} Jun 02 01:10:59.436346 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:59.436290 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p5xf" event={"ID":"c56a8f7e-11e7-4958-9d61-b56975c37dbe","Type":"ContainerStarted","Data":"6e5f27addcbd5c53b4ce36839ef61e5dea936a0fa8f624f148d9c624fa4d9b98"} Jun 02 01:10:59.439383 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:59.439347 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" event={"ID":"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb","Type":"ContainerStarted","Data":"102a9748925ac2c01a4da47742a096a3f4c57f4733ee5cd0ab153b80089a45a3"} Jun 02 01:10:59.442668 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:59.442642 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l98v" event={"ID":"0bb6450b-b60a-43ec-882c-bb797f71572f","Type":"ContainerStarted","Data":"d511b8743036b1c6b1d27468373f830299d3aa2235689cc0cf16688a1246ee16"} Jun 02 01:10:59.444217 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:59.444184 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-svwjt" event={"ID":"c2983f4a-20eb-4157-81bf-6d793bc6038e","Type":"ContainerStarted","Data":"12166f01b843ae16a84be45903580078020337d312525058e641aba148735ebf"} Jun 02 01:10:59.448874 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:59.448830 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k7hnj" event={"ID":"f2d9cb2f-663e-4816-8cd2-9c197fe85ece","Type":"ContainerStarted","Data":"78bcbbac077e3cdef1f4f00ebd94367199c6fcbd515774e4d88e8110ca31cbb9"} Jun 02 01:10:59.903931 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:10:59.903323 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0c654e7-08a1-4ca8-81c4-5164c7c30e26-metrics-certs\") pod \"network-metrics-daemon-gntp5\" (UID: \"b0c654e7-08a1-4ca8-81c4-5164c7c30e26\") " pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:10:59.903931 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:59.903492 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:10:59.903931 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:10:59.903559 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0c654e7-08a1-4ca8-81c4-5164c7c30e26-metrics-certs podName:b0c654e7-08a1-4ca8-81c4-5164c7c30e26 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:01.903541163 +0000 UTC m=+6.074083333 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0c654e7-08a1-4ca8-81c4-5164c7c30e26-metrics-certs") pod "network-metrics-daemon-gntp5" (UID: "b0c654e7-08a1-4ca8-81c4-5164c7c30e26") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:11:00.004134 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:00.004092 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hmwsd\" (UniqueName: \"kubernetes.io/projected/629ae262-2447-41a6-b07c-0dd56b001344-kube-api-access-hmwsd\") pod \"network-check-target-55g5j\" (UID: \"629ae262-2447-41a6-b07c-0dd56b001344\") " pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:11:00.004325 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:00.004292 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:11:00.004325 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:00.004310 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:11:00.004325 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:00.004323 2576 projected.go:194] Error preparing data for projected volume kube-api-access-hmwsd for pod openshift-network-diagnostics/network-check-target-55g5j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:11:00.004517 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:00.004406 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/629ae262-2447-41a6-b07c-0dd56b001344-kube-api-access-hmwsd podName:629ae262-2447-41a6-b07c-0dd56b001344 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:02.004386545 +0000 UTC m=+6.174928736 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmwsd" (UniqueName: "kubernetes.io/projected/629ae262-2447-41a6-b07c-0dd56b001344-kube-api-access-hmwsd") pod "network-check-target-55g5j" (UID: "629ae262-2447-41a6-b07c-0dd56b001344") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:11:00.404732 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:00.404186 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:11:00.404732 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:00.404316 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gntp5" podUID="b0c654e7-08a1-4ca8-81c4-5164c7c30e26" Jun 02 01:11:00.468177 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:00.468109 2576 generic.go:358] "Generic (PLEG): container finished" podID="262b761e3be937ee9d90f547e448dd74" containerID="c50227de37ef6eb4231399613d467d8697df69efdadf6750d17178ed47ac584d" exitCode=0 Jun 02 01:11:00.468678 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:00.468652 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal" event={"ID":"262b761e3be937ee9d90f547e448dd74","Type":"ContainerDied","Data":"c50227de37ef6eb4231399613d467d8697df69efdadf6750d17178ed47ac584d"} Jun 02 01:11:01.402001 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:01.401529 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:11:01.402001 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:01.401652 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55g5j" podUID="629ae262-2447-41a6-b07c-0dd56b001344" Jun 02 01:11:01.490602 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:01.489923 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal" event={"ID":"262b761e3be937ee9d90f547e448dd74","Type":"ContainerStarted","Data":"b2fbf2f188d4ffa178300737caa695907ca3e6da99bbbac3e4f462f9ce2a1420"} Jun 02 01:11:01.921822 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:01.921780 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0c654e7-08a1-4ca8-81c4-5164c7c30e26-metrics-certs\") pod \"network-metrics-daemon-gntp5\" (UID: \"b0c654e7-08a1-4ca8-81c4-5164c7c30e26\") " pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:11:01.922016 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:01.921931 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:11:01.922016 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:01.921994 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0c654e7-08a1-4ca8-81c4-5164c7c30e26-metrics-certs podName:b0c654e7-08a1-4ca8-81c4-5164c7c30e26 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:05.921976456 +0000 UTC m=+10.092518624 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0c654e7-08a1-4ca8-81c4-5164c7c30e26-metrics-certs") pod "network-metrics-daemon-gntp5" (UID: "b0c654e7-08a1-4ca8-81c4-5164c7c30e26") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:11:02.022879 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:02.022844 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hmwsd\" (UniqueName: \"kubernetes.io/projected/629ae262-2447-41a6-b07c-0dd56b001344-kube-api-access-hmwsd\") pod \"network-check-target-55g5j\" (UID: \"629ae262-2447-41a6-b07c-0dd56b001344\") " pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:11:02.023095 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:02.022987 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:11:02.023095 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:02.023003 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:11:02.023095 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:02.023016 2576 projected.go:194] Error preparing data for projected volume kube-api-access-hmwsd for pod openshift-network-diagnostics/network-check-target-55g5j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:11:02.023095 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:02.023079 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/629ae262-2447-41a6-b07c-0dd56b001344-kube-api-access-hmwsd podName:629ae262-2447-41a6-b07c-0dd56b001344 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:06.023060656 +0000 UTC m=+10.193602822 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmwsd" (UniqueName: "kubernetes.io/projected/629ae262-2447-41a6-b07c-0dd56b001344-kube-api-access-hmwsd") pod "network-check-target-55g5j" (UID: "629ae262-2447-41a6-b07c-0dd56b001344") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:11:02.402229 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:02.401919 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:11:02.402229 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:02.402057 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gntp5" podUID="b0c654e7-08a1-4ca8-81c4-5164c7c30e26" Jun 02 01:11:03.401612 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:03.401326 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:11:03.401612 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:03.401470 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55g5j" podUID="629ae262-2447-41a6-b07c-0dd56b001344" Jun 02 01:11:04.401758 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:04.401719 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:11:04.402252 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:04.401874 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gntp5" podUID="b0c654e7-08a1-4ca8-81c4-5164c7c30e26" Jun 02 01:11:05.401626 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:05.401588 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:11:05.401822 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:05.401719 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55g5j" podUID="629ae262-2447-41a6-b07c-0dd56b001344" Jun 02 01:11:05.959785 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:05.959735 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0c654e7-08a1-4ca8-81c4-5164c7c30e26-metrics-certs\") pod \"network-metrics-daemon-gntp5\" (UID: \"b0c654e7-08a1-4ca8-81c4-5164c7c30e26\") " pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:11:05.959969 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:05.959872 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:11:05.959969 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:05.959946 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0c654e7-08a1-4ca8-81c4-5164c7c30e26-metrics-certs podName:b0c654e7-08a1-4ca8-81c4-5164c7c30e26 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:13.959925801 +0000 UTC m=+18.130467968 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0c654e7-08a1-4ca8-81c4-5164c7c30e26-metrics-certs") pod "network-metrics-daemon-gntp5" (UID: "b0c654e7-08a1-4ca8-81c4-5164c7c30e26") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:11:06.060095 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:06.060060 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hmwsd\" (UniqueName: \"kubernetes.io/projected/629ae262-2447-41a6-b07c-0dd56b001344-kube-api-access-hmwsd\") pod \"network-check-target-55g5j\" (UID: \"629ae262-2447-41a6-b07c-0dd56b001344\") " pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:11:06.060282 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:06.060218 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:11:06.060282 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:06.060238 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:11:06.060282 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:06.060250 2576 projected.go:194] Error preparing data for projected volume kube-api-access-hmwsd for pod openshift-network-diagnostics/network-check-target-55g5j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:11:06.060457 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:06.060313 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/629ae262-2447-41a6-b07c-0dd56b001344-kube-api-access-hmwsd podName:629ae262-2447-41a6-b07c-0dd56b001344 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:14.060294654 +0000 UTC m=+18.230836836 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmwsd" (UniqueName: "kubernetes.io/projected/629ae262-2447-41a6-b07c-0dd56b001344-kube-api-access-hmwsd") pod "network-check-target-55g5j" (UID: "629ae262-2447-41a6-b07c-0dd56b001344") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:11:06.402426 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:06.402392 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:11:06.402803 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:06.402528 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gntp5" podUID="b0c654e7-08a1-4ca8-81c4-5164c7c30e26" Jun 02 01:11:07.401794 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:07.401752 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:11:07.401984 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:07.401891 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55g5j" podUID="629ae262-2447-41a6-b07c-0dd56b001344" Jun 02 01:11:08.401840 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:08.401800 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:11:08.402316 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:08.401963 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gntp5" podUID="b0c654e7-08a1-4ca8-81c4-5164c7c30e26" Jun 02 01:11:09.402148 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:09.402113 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:11:09.402671 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:09.402236 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55g5j" podUID="629ae262-2447-41a6-b07c-0dd56b001344" Jun 02 01:11:10.402181 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:10.402143 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:11:10.402641 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:10.402286 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gntp5" podUID="b0c654e7-08a1-4ca8-81c4-5164c7c30e26" Jun 02 01:11:11.401353 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:11.401312 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:11:11.401560 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:11.401433 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55g5j" podUID="629ae262-2447-41a6-b07c-0dd56b001344" Jun 02 01:11:12.402313 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:12.402269 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:11:12.402805 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:12.402444 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gntp5" podUID="b0c654e7-08a1-4ca8-81c4-5164c7c30e26" Jun 02 01:11:13.402315 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:13.402281 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:11:13.402771 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:13.402425 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55g5j" podUID="629ae262-2447-41a6-b07c-0dd56b001344" Jun 02 01:11:14.017957 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:14.017920 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0c654e7-08a1-4ca8-81c4-5164c7c30e26-metrics-certs\") pod \"network-metrics-daemon-gntp5\" (UID: \"b0c654e7-08a1-4ca8-81c4-5164c7c30e26\") " pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:11:14.018116 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:14.018062 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:11:14.018177 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:14.018133 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0c654e7-08a1-4ca8-81c4-5164c7c30e26-metrics-certs podName:b0c654e7-08a1-4ca8-81c4-5164c7c30e26 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:30.018117561 +0000 UTC m=+34.188659728 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0c654e7-08a1-4ca8-81c4-5164c7c30e26-metrics-certs") pod "network-metrics-daemon-gntp5" (UID: "b0c654e7-08a1-4ca8-81c4-5164c7c30e26") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:11:14.118755 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:14.118712 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hmwsd\" (UniqueName: \"kubernetes.io/projected/629ae262-2447-41a6-b07c-0dd56b001344-kube-api-access-hmwsd\") pod \"network-check-target-55g5j\" (UID: \"629ae262-2447-41a6-b07c-0dd56b001344\") " pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:11:14.118953 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:14.118909 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:11:14.118953 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:14.118937 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:11:14.118953 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:14.118950 2576 projected.go:194] Error preparing data for projected volume kube-api-access-hmwsd for pod openshift-network-diagnostics/network-check-target-55g5j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:11:14.119083 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:14.119022 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/629ae262-2447-41a6-b07c-0dd56b001344-kube-api-access-hmwsd podName:629ae262-2447-41a6-b07c-0dd56b001344 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:30.119002412 +0000 UTC m=+34.289544591 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmwsd" (UniqueName: "kubernetes.io/projected/629ae262-2447-41a6-b07c-0dd56b001344-kube-api-access-hmwsd") pod "network-check-target-55g5j" (UID: "629ae262-2447-41a6-b07c-0dd56b001344") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:11:14.402132 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:14.402046 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:11:14.402292 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:14.402186 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gntp5" podUID="b0c654e7-08a1-4ca8-81c4-5164c7c30e26" Jun 02 01:11:15.401919 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:15.401879 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:11:15.402310 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:15.402006 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55g5j" podUID="629ae262-2447-41a6-b07c-0dd56b001344" Jun 02 01:11:16.402842 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:16.402805 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:11:16.403206 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:16.402907 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gntp5" podUID="b0c654e7-08a1-4ca8-81c4-5164c7c30e26" Jun 02 01:11:17.401419 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:17.401385 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:11:17.401556 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:17.401500 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55g5j" podUID="629ae262-2447-41a6-b07c-0dd56b001344" Jun 02 01:11:17.520502 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:17.520467 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-svwjt" event={"ID":"c2983f4a-20eb-4157-81bf-6d793bc6038e","Type":"ContainerStarted","Data":"53e025a537354a57e1982afca634ae8b6bb098061bbd329c2967532554a87a6b"} Jun 02 01:11:17.521975 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:17.521948 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-k7hnj" event={"ID":"f2d9cb2f-663e-4816-8cd2-9c197fe85ece","Type":"ContainerStarted","Data":"03529b4ee9572e14cb04107d556ee76af3a2fbad97026953fbc22511144ff920"} Jun 02 01:11:17.523254 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:17.523226 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" event={"ID":"816f36fb-7419-4dcf-950e-4015afa995c2","Type":"ContainerStarted","Data":"0d9da490716c7e05b888fb754766e802a4b6cdbacec904e1635d760bd4293ca1"} Jun 02 01:11:17.525036 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:17.524393 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-smvzg" event={"ID":"ff5cd010-d35b-4b58-8008-5c3a1f22deec","Type":"ContainerStarted","Data":"bd6fd3166b7a6f4ae399153c4eb94171884687afcfc9c349e936bd764132affb"} Jun 02 01:11:17.525738 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:17.525718 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h8fml" event={"ID":"2200ba73-d59d-4591-8254-fe06a7ee0bde","Type":"ContainerStarted","Data":"288dcbef80ec69588674481999b89ad7ea15474cfb8db446a9f0968382431236"} Jun 02 01:11:17.526982 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:17.526962 2576 generic.go:358] "Generic (PLEG): container finished" podID="c56a8f7e-11e7-4958-9d61-b56975c37dbe" containerID="e77e840708d34b9080de4ec35fbdd9c0537faf753a7eb35ae58882d52e8ebb67" exitCode=0 Jun 02 01:11:17.527066 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:17.527024 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p5xf" event={"ID":"c56a8f7e-11e7-4958-9d61-b56975c37dbe","Type":"ContainerDied","Data":"e77e840708d34b9080de4ec35fbdd9c0537faf753a7eb35ae58882d52e8ebb67"} Jun 02 01:11:17.529315 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:17.529297 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lkf95_b6d9386e-1aeb-41d2-8b3d-0a088b8724cb/ovn-acl-logging/0.log" Jun 02 01:11:17.529625 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:17.529603 2576 generic.go:358] "Generic (PLEG): container finished" podID="b6d9386e-1aeb-41d2-8b3d-0a088b8724cb" containerID="04fb9ee46b6adcafe1a50c0c1dd19616321195e248079e1dfbf13f0b8f9b2c54" exitCode=1 Jun 02 01:11:17.529680 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:17.529666 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" event={"ID":"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb","Type":"ContainerStarted","Data":"508d9a3c1b056dc331e84337a31e5d0be893a1dc332f1c434f9d6e08ee1dca03"} Jun 02 01:11:17.529726 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:17.529689 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" event={"ID":"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb","Type":"ContainerStarted","Data":"4b615afc45cdbb3c003dc3254e6dcdb3598797ccdb6d7e566b3bc6e7c02c3002"} Jun 02 01:11:17.529726 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:17.529702 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" event={"ID":"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb","Type":"ContainerStarted","Data":"a749a416fcadd7257bcf55291aa29462a99b336428434e48a60261f4e56dd1d4"} Jun 02 01:11:17.529726 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:17.529715 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" event={"ID":"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb","Type":"ContainerDied","Data":"04fb9ee46b6adcafe1a50c0c1dd19616321195e248079e1dfbf13f0b8f9b2c54"} Jun 02 01:11:17.529823 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:17.529730 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" event={"ID":"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb","Type":"ContainerStarted","Data":"876f63cedfabf4715fa8f142e55b4fa0bc24aaa2ae0b7303d17f8657b7f31e01"} Jun 02 01:11:17.530959 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:17.530939 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l98v" event={"ID":"0bb6450b-b60a-43ec-882c-bb797f71572f","Type":"ContainerStarted","Data":"a2acae4663edb823b81ab0024dc1e22a7a245ecc93aef626446918b8fd03192b"} Jun 02 01:11:17.538146 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:17.538110 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-svwjt" podStartSLOduration=3.299339356 podStartE2EDuration="21.538100391s" podCreationTimestamp="2026-06-02 01:10:56 +0000 UTC" firstStartedPulling="2026-06-02 01:10:58.620985821 +0000 UTC m=+2.791527990" lastFinishedPulling="2026-06-02 01:11:16.859746856 +0000 UTC m=+21.030289025" observedRunningTime="2026-06-02 01:11:17.537877874 +0000 UTC m=+21.708420063" watchObservedRunningTime="2026-06-02 01:11:17.538100391 +0000 UTC m=+21.708642577" Jun 02 01:11:17.538330 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:17.538312 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-192.ec2.internal" podStartSLOduration=20.538309483 podStartE2EDuration="20.538309483s" podCreationTimestamp="2026-06-02 01:10:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:11:01.505772517 +0000 UTC m=+5.676314704" watchObservedRunningTime="2026-06-02 01:11:17.538309483 +0000 UTC m=+21.708851683" Jun 02 01:11:17.550959 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:17.550921 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-h8fml" podStartSLOduration=3.378970925 podStartE2EDuration="21.550909066s" podCreationTimestamp="2026-06-02 01:10:56 +0000 UTC" firstStartedPulling="2026-06-02 01:10:58.606001907 +0000 UTC m=+2.776544071" lastFinishedPulling="2026-06-02 01:11:16.777940044 +0000 UTC m=+20.948482212" observedRunningTime="2026-06-02 01:11:17.550670126 +0000 UTC m=+21.721212312" watchObservedRunningTime="2026-06-02 01:11:17.550909066 +0000 UTC m=+21.721451252" Jun 02 01:11:17.564295 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:17.564248 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-smvzg" podStartSLOduration=3.395870415 podStartE2EDuration="21.564231186s" podCreationTimestamp="2026-06-02 01:10:56 +0000 UTC" firstStartedPulling="2026-06-02 01:10:58.60952182 +0000 UTC m=+2.780063990" lastFinishedPulling="2026-06-02 01:11:16.777882585 +0000 UTC m=+20.948424761" observedRunningTime="2026-06-02 01:11:17.564212369 +0000 UTC m=+21.734754546" watchObservedRunningTime="2026-06-02 01:11:17.564231186 +0000 UTC m=+21.734773368" Jun 02 01:11:17.604888 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:17.604841 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7qlgt" podStartSLOduration=3.441025582 podStartE2EDuration="21.604825962s" podCreationTimestamp="2026-06-02 01:10:56 +0000 UTC" firstStartedPulling="2026-06-02 01:10:58.645419415 +0000 UTC m=+2.815961579" lastFinishedPulling="2026-06-02 01:11:16.809219788 +0000 UTC m=+20.979761959" observedRunningTime="2026-06-02 01:11:17.604676685 +0000 UTC m=+21.775218883" watchObservedRunningTime="2026-06-02 01:11:17.604825962 +0000 UTC m=+21.775368147" Jun 02 01:11:17.605042 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:17.605011 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-k7hnj" podStartSLOduration=11.469878123 podStartE2EDuration="21.605006309s" podCreationTimestamp="2026-06-02 01:10:56 +0000 UTC" firstStartedPulling="2026-06-02 01:10:58.594445818 +0000 UTC m=+2.764987996" lastFinishedPulling="2026-06-02 01:11:08.729574005 +0000 UTC m=+12.900116182" observedRunningTime="2026-06-02 01:11:17.587213073 +0000 UTC m=+21.757755258" watchObservedRunningTime="2026-06-02 01:11:17.605006309 +0000 UTC m=+21.775548494" Jun 02 01:11:18.401920 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:18.401897 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:11:18.402062 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:18.402033 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gntp5" podUID="b0c654e7-08a1-4ca8-81c4-5164c7c30e26" Jun 02 01:11:18.524686 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:18.524654 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 01:11:18.534680 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:18.534661 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lkf95_b6d9386e-1aeb-41d2-8b3d-0a088b8724cb/ovn-acl-logging/0.log" Jun 02 01:11:18.535007 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:18.534983 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" event={"ID":"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb","Type":"ContainerStarted","Data":"8cf673efa429ae1b7ce8eb58cf684e34fcad843e6646ad9a33b241754931d0a7"} Jun 02 01:11:18.539143 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:18.539116 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l98v" event={"ID":"0bb6450b-b60a-43ec-882c-bb797f71572f","Type":"ContainerStarted","Data":"3ff97c95e5fb02ebe0277391ab66136a0b8cb4646207c6329ebe48dced75a4f1"} Jun 02 01:11:18.540354 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:18.540283 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fx5td" event={"ID":"2650d71e-93d2-4e35-930c-aa912e819502","Type":"ContainerStarted","Data":"b95308f7a60a056ce410f94d7922af5129a614415f9139df8170052e078531d4"} Jun 02 01:11:18.553968 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:18.553929 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fx5td" podStartSLOduration=4.42364608 podStartE2EDuration="22.553915905s" podCreationTimestamp="2026-06-02 01:10:56 +0000 UTC" firstStartedPulling="2026-06-02 01:10:58.625144185 +0000 UTC m=+2.795686352" lastFinishedPulling="2026-06-02 01:11:16.75541401 +0000 UTC m=+20.925956177" observedRunningTime="2026-06-02 01:11:18.553699193 +0000 UTC m=+22.724241378" watchObservedRunningTime="2026-06-02 01:11:18.553915905 +0000 UTC m=+22.724458092" Jun 02 01:11:19.344289 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:19.344151 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T01:11:18.52467834Z","UUID":"1603c63c-ed22-4c51-80ed-4da5e04908d6","Handler":null,"Name":"","Endpoint":""} Jun 02 01:11:19.346234 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:19.346205 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 01:11:19.346409 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:19.346250 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 01:11:19.401426 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:19.401395 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:11:19.401599 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:19.401522 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55g5j" podUID="629ae262-2447-41a6-b07c-0dd56b001344" Jun 02 01:11:19.824748 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:19.824521 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-k7hnj" Jun 02 01:11:19.825504 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:19.825484 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-k7hnj" Jun 02 01:11:20.401943 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:20.401743 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:11:20.402131 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:20.402042 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gntp5" podUID="b0c654e7-08a1-4ca8-81c4-5164c7c30e26" Jun 02 01:11:20.547296 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:20.547270 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lkf95_b6d9386e-1aeb-41d2-8b3d-0a088b8724cb/ovn-acl-logging/0.log" Jun 02 01:11:20.547687 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:20.547654 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" event={"ID":"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb","Type":"ContainerStarted","Data":"a24f48a7ef3de91add8b2bee1f5100be61cb5cd0d8697435b4d39d948093c15f"} Jun 02 01:11:20.549755 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:20.549729 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l98v" event={"ID":"0bb6450b-b60a-43ec-882c-bb797f71572f","Type":"ContainerStarted","Data":"6e1c51191312d2c3ebd8f760b94455ddd0aef4e0fd319ad8517ffda902317798"} Jun 02 01:11:21.401603 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:21.401570 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:11:21.402079 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:21.401699 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55g5j" podUID="629ae262-2447-41a6-b07c-0dd56b001344" Jun 02 01:11:22.402169 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:22.402093 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:11:22.402651 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:22.402219 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gntp5" podUID="b0c654e7-08a1-4ca8-81c4-5164c7c30e26" Jun 02 01:11:23.401549 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:23.401350 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:11:23.401757 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:23.401618 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55g5j" podUID="629ae262-2447-41a6-b07c-0dd56b001344" Jun 02 01:11:23.556307 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:23.556269 2576 generic.go:358] "Generic (PLEG): container finished" podID="c56a8f7e-11e7-4958-9d61-b56975c37dbe" containerID="af2b64030f7fe6506060c931a6d63ee9081f13035d18e3ba35c7498319854267" exitCode=0 Jun 02 01:11:23.556963 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:23.556356 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p5xf" event={"ID":"c56a8f7e-11e7-4958-9d61-b56975c37dbe","Type":"ContainerDied","Data":"af2b64030f7fe6506060c931a6d63ee9081f13035d18e3ba35c7498319854267"} Jun 02 01:11:23.559304 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:23.559279 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lkf95_b6d9386e-1aeb-41d2-8b3d-0a088b8724cb/ovn-acl-logging/0.log" Jun 02 01:11:23.559646 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:23.559622 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" event={"ID":"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb","Type":"ContainerStarted","Data":"e160d74b07248f1490a52700de2b1defd872fc084080c611fc8aa70386263963"} Jun 02 01:11:23.559862 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:23.559845 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:11:23.559920 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:23.559874 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:11:23.560123 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:23.560078 2576 scope.go:117] "RemoveContainer" containerID="04fb9ee46b6adcafe1a50c0c1dd19616321195e248079e1dfbf13f0b8f9b2c54" Jun 02 01:11:23.577503 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:23.577478 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:11:23.578196 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:23.578150 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5l98v" podStartSLOduration=6.366099253 podStartE2EDuration="27.578135707s" podCreationTimestamp="2026-06-02 01:10:56 +0000 UTC" firstStartedPulling="2026-06-02 01:10:58.631859651 +0000 UTC m=+2.802401815" lastFinishedPulling="2026-06-02 01:11:19.843896102 +0000 UTC m=+24.014438269" observedRunningTime="2026-06-02 01:11:20.566730187 +0000 UTC m=+24.737272374" watchObservedRunningTime="2026-06-02 01:11:23.578135707 +0000 UTC m=+27.748677893" Jun 02 01:11:24.402295 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:24.402264 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:11:24.402464 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:24.402432 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gntp5" podUID="b0c654e7-08a1-4ca8-81c4-5164c7c30e26" Jun 02 01:11:24.563246 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:24.563076 2576 generic.go:358] "Generic (PLEG): container finished" podID="c56a8f7e-11e7-4958-9d61-b56975c37dbe" containerID="30e443e196dab882f50f3f08df990edc516342b56771650d0d15e87bb90295ff" exitCode=0 Jun 02 01:11:24.563731 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:24.563164 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p5xf" event={"ID":"c56a8f7e-11e7-4958-9d61-b56975c37dbe","Type":"ContainerDied","Data":"30e443e196dab882f50f3f08df990edc516342b56771650d0d15e87bb90295ff"} Jun 02 01:11:24.566123 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:24.566043 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-k7hnj" Jun 02 01:11:24.566196 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:24.566155 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 01:11:24.566723 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:24.566703 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-k7hnj" Jun 02 01:11:24.566821 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:24.566784 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lkf95_b6d9386e-1aeb-41d2-8b3d-0a088b8724cb/ovn-acl-logging/0.log" Jun 02 01:11:24.567141 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:24.567121 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" event={"ID":"b6d9386e-1aeb-41d2-8b3d-0a088b8724cb","Type":"ContainerStarted","Data":"c5938500cc034cef7bee871b28cb344020f9d7ab750c2b1db43c2af290788132"} Jun 02 01:11:24.567405 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:24.567358 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:11:24.582232 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:24.582179 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:11:24.622266 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:24.622216 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" podStartSLOduration=10.434857275 podStartE2EDuration="28.622201467s" podCreationTimestamp="2026-06-02 01:10:56 +0000 UTC" firstStartedPulling="2026-06-02 01:10:58.640561624 +0000 UTC m=+2.811103792" lastFinishedPulling="2026-06-02 01:11:16.827905802 +0000 UTC m=+20.998447984" observedRunningTime="2026-06-02 01:11:24.620807398 +0000 UTC m=+28.791349583" watchObservedRunningTime="2026-06-02 01:11:24.622201467 +0000 UTC m=+28.792743652" Jun 02 01:11:24.636357 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:24.636329 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gntp5"] Jun 02 01:11:24.636510 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:24.636437 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:11:24.636549 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:24.636519 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gntp5" podUID="b0c654e7-08a1-4ca8-81c4-5164c7c30e26" Jun 02 01:11:24.638993 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:24.638973 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-55g5j"] Jun 02 01:11:24.639098 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:24.639066 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:11:24.639154 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:24.639137 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55g5j" podUID="629ae262-2447-41a6-b07c-0dd56b001344" Jun 02 01:11:25.570961 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:25.570867 2576 generic.go:358] "Generic (PLEG): container finished" podID="c56a8f7e-11e7-4958-9d61-b56975c37dbe" containerID="05026f2193a96dbc496d5f32b686ab7351d14a1fba7c7680d7b088fa5cd1c141" exitCode=0 Jun 02 01:11:25.571342 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:25.570955 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p5xf" event={"ID":"c56a8f7e-11e7-4958-9d61-b56975c37dbe","Type":"ContainerDied","Data":"05026f2193a96dbc496d5f32b686ab7351d14a1fba7c7680d7b088fa5cd1c141"} Jun 02 01:11:26.402990 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:26.402958 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:11:26.403164 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:26.403072 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gntp5" podUID="b0c654e7-08a1-4ca8-81c4-5164c7c30e26" Jun 02 01:11:26.403164 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:26.403120 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:11:26.403276 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:26.403215 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55g5j" podUID="629ae262-2447-41a6-b07c-0dd56b001344" Jun 02 01:11:28.401736 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:28.401704 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:11:28.402411 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:28.401841 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gntp5" podUID="b0c654e7-08a1-4ca8-81c4-5164c7c30e26" Jun 02 01:11:28.402411 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:28.401902 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:11:28.402411 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:28.402011 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-55g5j" podUID="629ae262-2447-41a6-b07c-0dd56b001344" Jun 02 01:11:29.633314 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.633279 2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-192.ec2.internal" event="NodeReady" Jun 02 01:11:29.633828 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.633428 2576 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 01:11:29.673791 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.673749 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z6c7d"] Jun 02 01:11:29.675635 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.675610 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z6c7d" Jun 02 01:11:29.677386 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.677348 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-864j4"] Jun 02 01:11:29.678294 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.678215 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 01:11:29.678294 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.678245 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 01:11:29.678294 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.678259 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n98qz\"" Jun 02 01:11:29.679110 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.679093 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-864j4" Jun 02 01:11:29.681298 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.681279 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 01:11:29.681418 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.681278 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 01:11:29.681418 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.681358 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 01:11:29.681537 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.681450 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9tnxm\"" Jun 02 01:11:29.686264 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.686214 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z6c7d"] Jun 02 01:11:29.689269 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.689251 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-864j4"] Jun 02 01:11:29.833150 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.833066 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6dbdb36-49f7-4e85-90d1-72f90db62f96-cert\") pod \"ingress-canary-864j4\" (UID: \"b6dbdb36-49f7-4e85-90d1-72f90db62f96\") " pod="openshift-ingress-canary/ingress-canary-864j4" Jun 02 01:11:29.833150 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.833106 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b33e89ef-ae01-478f-b2ca-383234e07be1-config-volume\") pod \"dns-default-z6c7d\" (UID: \"b33e89ef-ae01-478f-b2ca-383234e07be1\") " pod="openshift-dns/dns-default-z6c7d" Jun 02 01:11:29.833150 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.833123 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b33e89ef-ae01-478f-b2ca-383234e07be1-tmp-dir\") pod \"dns-default-z6c7d\" (UID: \"b33e89ef-ae01-478f-b2ca-383234e07be1\") " pod="openshift-dns/dns-default-z6c7d" Jun 02 01:11:29.833419 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.833170 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h45b\" (UniqueName: \"kubernetes.io/projected/b6dbdb36-49f7-4e85-90d1-72f90db62f96-kube-api-access-5h45b\") pod \"ingress-canary-864j4\" (UID: \"b6dbdb36-49f7-4e85-90d1-72f90db62f96\") " pod="openshift-ingress-canary/ingress-canary-864j4" Jun 02 01:11:29.833419 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.833216 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn4f8\" (UniqueName: \"kubernetes.io/projected/b33e89ef-ae01-478f-b2ca-383234e07be1-kube-api-access-dn4f8\") pod \"dns-default-z6c7d\" (UID: \"b33e89ef-ae01-478f-b2ca-383234e07be1\") " pod="openshift-dns/dns-default-z6c7d" Jun 02 01:11:29.833419 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.833262 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b33e89ef-ae01-478f-b2ca-383234e07be1-metrics-tls\") pod \"dns-default-z6c7d\" (UID: \"b33e89ef-ae01-478f-b2ca-383234e07be1\") " pod="openshift-dns/dns-default-z6c7d" Jun 02 01:11:29.934659 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.934621 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dn4f8\" (UniqueName: \"kubernetes.io/projected/b33e89ef-ae01-478f-b2ca-383234e07be1-kube-api-access-dn4f8\") pod \"dns-default-z6c7d\" (UID: \"b33e89ef-ae01-478f-b2ca-383234e07be1\") " pod="openshift-dns/dns-default-z6c7d" Jun 02 01:11:29.934862 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.934670 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b33e89ef-ae01-478f-b2ca-383234e07be1-metrics-tls\") pod \"dns-default-z6c7d\" (UID: \"b33e89ef-ae01-478f-b2ca-383234e07be1\") " pod="openshift-dns/dns-default-z6c7d" Jun 02 01:11:29.934862 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.934723 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6dbdb36-49f7-4e85-90d1-72f90db62f96-cert\") pod \"ingress-canary-864j4\" (UID: \"b6dbdb36-49f7-4e85-90d1-72f90db62f96\") " pod="openshift-ingress-canary/ingress-canary-864j4" Jun 02 01:11:29.934862 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.934743 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b33e89ef-ae01-478f-b2ca-383234e07be1-config-volume\") pod \"dns-default-z6c7d\" (UID: \"b33e89ef-ae01-478f-b2ca-383234e07be1\") " pod="openshift-dns/dns-default-z6c7d" Jun 02 01:11:29.934862 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.934763 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b33e89ef-ae01-478f-b2ca-383234e07be1-tmp-dir\") pod \"dns-default-z6c7d\" (UID: \"b33e89ef-ae01-478f-b2ca-383234e07be1\") " pod="openshift-dns/dns-default-z6c7d" Jun 02 01:11:29.934862 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.934787 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5h45b\" (UniqueName: \"kubernetes.io/projected/b6dbdb36-49f7-4e85-90d1-72f90db62f96-kube-api-access-5h45b\") pod \"ingress-canary-864j4\" (UID: \"b6dbdb36-49f7-4e85-90d1-72f90db62f96\") " pod="openshift-ingress-canary/ingress-canary-864j4" Jun 02 01:11:29.934862 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:29.934824 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:11:29.935172 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:29.934872 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:11:29.935172 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:29.934901 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33e89ef-ae01-478f-b2ca-383234e07be1-metrics-tls podName:b33e89ef-ae01-478f-b2ca-383234e07be1 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:30.434879778 +0000 UTC m=+34.605421947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b33e89ef-ae01-478f-b2ca-383234e07be1-metrics-tls") pod "dns-default-z6c7d" (UID: "b33e89ef-ae01-478f-b2ca-383234e07be1") : secret "dns-default-metrics-tls" not found Jun 02 01:11:29.935172 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:29.934927 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6dbdb36-49f7-4e85-90d1-72f90db62f96-cert podName:b6dbdb36-49f7-4e85-90d1-72f90db62f96 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:30.434909805 +0000 UTC m=+34.605451979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b6dbdb36-49f7-4e85-90d1-72f90db62f96-cert") pod "ingress-canary-864j4" (UID: "b6dbdb36-49f7-4e85-90d1-72f90db62f96") : secret "canary-serving-cert" not found Jun 02 01:11:29.935172 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.935122 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b33e89ef-ae01-478f-b2ca-383234e07be1-tmp-dir\") pod \"dns-default-z6c7d\" (UID: \"b33e89ef-ae01-478f-b2ca-383234e07be1\") " pod="openshift-dns/dns-default-z6c7d" Jun 02 01:11:29.935412 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.935394 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b33e89ef-ae01-478f-b2ca-383234e07be1-config-volume\") pod \"dns-default-z6c7d\" (UID: \"b33e89ef-ae01-478f-b2ca-383234e07be1\") " pod="openshift-dns/dns-default-z6c7d" Jun 02 01:11:29.945701 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.945671 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn4f8\" (UniqueName: \"kubernetes.io/projected/b33e89ef-ae01-478f-b2ca-383234e07be1-kube-api-access-dn4f8\") pod \"dns-default-z6c7d\" (UID: \"b33e89ef-ae01-478f-b2ca-383234e07be1\") " pod="openshift-dns/dns-default-z6c7d" Jun 02 01:11:29.945846 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:29.945774 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h45b\" (UniqueName: \"kubernetes.io/projected/b6dbdb36-49f7-4e85-90d1-72f90db62f96-kube-api-access-5h45b\") pod \"ingress-canary-864j4\" (UID: \"b6dbdb36-49f7-4e85-90d1-72f90db62f96\") " pod="openshift-ingress-canary/ingress-canary-864j4" Jun 02 01:11:30.035970 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:30.035929 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0c654e7-08a1-4ca8-81c4-5164c7c30e26-metrics-certs\") pod \"network-metrics-daemon-gntp5\" (UID: \"b0c654e7-08a1-4ca8-81c4-5164c7c30e26\") " pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:11:30.036145 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:30.036055 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:11:30.036145 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:30.036111 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0c654e7-08a1-4ca8-81c4-5164c7c30e26-metrics-certs podName:b0c654e7-08a1-4ca8-81c4-5164c7c30e26 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:02.036097024 +0000 UTC m=+66.206639200 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0c654e7-08a1-4ca8-81c4-5164c7c30e26-metrics-certs") pod "network-metrics-daemon-gntp5" (UID: "b0c654e7-08a1-4ca8-81c4-5164c7c30e26") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:11:30.136557 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:30.136472 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hmwsd\" (UniqueName: \"kubernetes.io/projected/629ae262-2447-41a6-b07c-0dd56b001344-kube-api-access-hmwsd\") pod \"network-check-target-55g5j\" (UID: \"629ae262-2447-41a6-b07c-0dd56b001344\") " pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:11:30.136704 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:30.136642 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:11:30.136704 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:30.136660 2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:11:30.136704 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:30.136671 2576 projected.go:194] Error preparing data for projected volume kube-api-access-hmwsd for pod openshift-network-diagnostics/network-check-target-55g5j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:11:30.136827 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:30.136723 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/629ae262-2447-41a6-b07c-0dd56b001344-kube-api-access-hmwsd podName:629ae262-2447-41a6-b07c-0dd56b001344 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:02.13670704 +0000 UTC m=+66.307249217 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmwsd" (UniqueName: "kubernetes.io/projected/629ae262-2447-41a6-b07c-0dd56b001344-kube-api-access-hmwsd") pod "network-check-target-55g5j" (UID: "629ae262-2447-41a6-b07c-0dd56b001344") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:11:30.402022 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:30.401937 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:11:30.402022 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:30.401988 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:11:30.405789 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:30.405764 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 01:11:30.405789 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:30.405774 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 01:11:30.405789 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:30.405776 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r5956\"" Jun 02 01:11:30.405789 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:30.405781 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 01:11:30.406086 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:30.405785 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dfq6c\"" Jun 02 01:11:30.439073 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:30.439041 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6dbdb36-49f7-4e85-90d1-72f90db62f96-cert\") pod \"ingress-canary-864j4\" (UID: \"b6dbdb36-49f7-4e85-90d1-72f90db62f96\") " pod="openshift-ingress-canary/ingress-canary-864j4" Jun 02 01:11:30.439258 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:30.439133 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b33e89ef-ae01-478f-b2ca-383234e07be1-metrics-tls\") pod \"dns-default-z6c7d\" (UID: \"b33e89ef-ae01-478f-b2ca-383234e07be1\") " pod="openshift-dns/dns-default-z6c7d" Jun 02 01:11:30.439258 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:30.439203 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:11:30.439258 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:30.439247 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:11:30.439422 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:30.439279 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6dbdb36-49f7-4e85-90d1-72f90db62f96-cert podName:b6dbdb36-49f7-4e85-90d1-72f90db62f96 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:31.439259481 +0000 UTC m=+35.609801661 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b6dbdb36-49f7-4e85-90d1-72f90db62f96-cert") pod "ingress-canary-864j4" (UID: "b6dbdb36-49f7-4e85-90d1-72f90db62f96") : secret "canary-serving-cert" not found Jun 02 01:11:30.439422 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:30.439295 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33e89ef-ae01-478f-b2ca-383234e07be1-metrics-tls podName:b33e89ef-ae01-478f-b2ca-383234e07be1 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:31.439288995 +0000 UTC m=+35.609831160 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b33e89ef-ae01-478f-b2ca-383234e07be1-metrics-tls") pod "dns-default-z6c7d" (UID: "b33e89ef-ae01-478f-b2ca-383234e07be1") : secret "dns-default-metrics-tls" not found Jun 02 01:11:31.446571 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:31.446526 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6dbdb36-49f7-4e85-90d1-72f90db62f96-cert\") pod \"ingress-canary-864j4\" (UID: \"b6dbdb36-49f7-4e85-90d1-72f90db62f96\") " pod="openshift-ingress-canary/ingress-canary-864j4" Jun 02 01:11:31.447013 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:31.446636 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b33e89ef-ae01-478f-b2ca-383234e07be1-metrics-tls\") pod \"dns-default-z6c7d\" (UID: \"b33e89ef-ae01-478f-b2ca-383234e07be1\") " pod="openshift-dns/dns-default-z6c7d" Jun 02 01:11:31.447013 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:31.446731 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:11:31.447013 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:31.446776 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:11:31.447013 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:31.446814 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6dbdb36-49f7-4e85-90d1-72f90db62f96-cert podName:b6dbdb36-49f7-4e85-90d1-72f90db62f96 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:33.446792026 +0000 UTC m=+37.617334193 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b6dbdb36-49f7-4e85-90d1-72f90db62f96-cert") pod "ingress-canary-864j4" (UID: "b6dbdb36-49f7-4e85-90d1-72f90db62f96") : secret "canary-serving-cert" not found Jun 02 01:11:31.447013 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:31.446834 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33e89ef-ae01-478f-b2ca-383234e07be1-metrics-tls podName:b33e89ef-ae01-478f-b2ca-383234e07be1 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:33.446824183 +0000 UTC m=+37.617366349 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b33e89ef-ae01-478f-b2ca-383234e07be1-metrics-tls") pod "dns-default-z6c7d" (UID: "b33e89ef-ae01-478f-b2ca-383234e07be1") : secret "dns-default-metrics-tls" not found Jun 02 01:11:32.587260 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:32.587066 2576 generic.go:358] "Generic (PLEG): container finished" podID="c56a8f7e-11e7-4958-9d61-b56975c37dbe" containerID="a7f78fe0eab07d8586832f8cb7eff42bc78660de58ecdf64358bc6d6d8144e4b" exitCode=0 Jun 02 01:11:32.587749 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:32.587142 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p5xf" event={"ID":"c56a8f7e-11e7-4958-9d61-b56975c37dbe","Type":"ContainerDied","Data":"a7f78fe0eab07d8586832f8cb7eff42bc78660de58ecdf64358bc6d6d8144e4b"} Jun 02 01:11:33.461640 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:33.461587 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b33e89ef-ae01-478f-b2ca-383234e07be1-metrics-tls\") pod \"dns-default-z6c7d\" (UID: \"b33e89ef-ae01-478f-b2ca-383234e07be1\") " pod="openshift-dns/dns-default-z6c7d" Jun 02 01:11:33.461640 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:33.461640 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6dbdb36-49f7-4e85-90d1-72f90db62f96-cert\") pod \"ingress-canary-864j4\" (UID: \"b6dbdb36-49f7-4e85-90d1-72f90db62f96\") " pod="openshift-ingress-canary/ingress-canary-864j4" Jun 02 01:11:33.461848 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:33.461732 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:11:33.461848 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:33.461737 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:11:33.461848 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:33.461782 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6dbdb36-49f7-4e85-90d1-72f90db62f96-cert podName:b6dbdb36-49f7-4e85-90d1-72f90db62f96 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:37.461768827 +0000 UTC m=+41.632310990 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b6dbdb36-49f7-4e85-90d1-72f90db62f96-cert") pod "ingress-canary-864j4" (UID: "b6dbdb36-49f7-4e85-90d1-72f90db62f96") : secret "canary-serving-cert" not found Jun 02 01:11:33.461848 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:33.461794 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33e89ef-ae01-478f-b2ca-383234e07be1-metrics-tls podName:b33e89ef-ae01-478f-b2ca-383234e07be1 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:37.461788634 +0000 UTC m=+41.632330798 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b33e89ef-ae01-478f-b2ca-383234e07be1-metrics-tls") pod "dns-default-z6c7d" (UID: "b33e89ef-ae01-478f-b2ca-383234e07be1") : secret "dns-default-metrics-tls" not found Jun 02 01:11:33.591313 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:33.591281 2576 generic.go:358] "Generic (PLEG): container finished" podID="c56a8f7e-11e7-4958-9d61-b56975c37dbe" containerID="cf14157049066b3a832ccdf5cd4fc9d781ffc940030d98520e7967bbd175e23f" exitCode=0 Jun 02 01:11:33.591692 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:33.591339 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p5xf" event={"ID":"c56a8f7e-11e7-4958-9d61-b56975c37dbe","Type":"ContainerDied","Data":"cf14157049066b3a832ccdf5cd4fc9d781ffc940030d98520e7967bbd175e23f"} Jun 02 01:11:34.596146 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:34.596067 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8p5xf" event={"ID":"c56a8f7e-11e7-4958-9d61-b56975c37dbe","Type":"ContainerStarted","Data":"5b58bceec42d6c833255d3ef4f967cb2eedc343c97fca64e1cbd9ec5c2d42dfe"} Jun 02 01:11:34.622723 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:34.622669 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8p5xf" podStartSLOduration=5.105475448 podStartE2EDuration="38.622655766s" podCreationTimestamp="2026-06-02 01:10:56 +0000 UTC" firstStartedPulling="2026-06-02 01:10:58.589282249 +0000 UTC m=+2.759824414" lastFinishedPulling="2026-06-02 01:11:32.106462555 +0000 UTC m=+36.277004732" observedRunningTime="2026-06-02 01:11:34.621573619 +0000 UTC m=+38.792115816" watchObservedRunningTime="2026-06-02 01:11:34.622655766 +0000 UTC m=+38.793197951" Jun 02 01:11:37.492589 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:37.492543 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6dbdb36-49f7-4e85-90d1-72f90db62f96-cert\") pod \"ingress-canary-864j4\" (UID: \"b6dbdb36-49f7-4e85-90d1-72f90db62f96\") " pod="openshift-ingress-canary/ingress-canary-864j4" Jun 02 01:11:37.493034 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:37.492627 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b33e89ef-ae01-478f-b2ca-383234e07be1-metrics-tls\") pod \"dns-default-z6c7d\" (UID: \"b33e89ef-ae01-478f-b2ca-383234e07be1\") " pod="openshift-dns/dns-default-z6c7d" Jun 02 01:11:37.493034 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:37.492710 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:11:37.493034 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:37.492766 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6dbdb36-49f7-4e85-90d1-72f90db62f96-cert podName:b6dbdb36-49f7-4e85-90d1-72f90db62f96 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:45.49275168 +0000 UTC m=+49.663293857 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b6dbdb36-49f7-4e85-90d1-72f90db62f96-cert") pod "ingress-canary-864j4" (UID: "b6dbdb36-49f7-4e85-90d1-72f90db62f96") : secret "canary-serving-cert" not found Jun 02 01:11:37.493034 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:37.492716 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:11:37.493034 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:37.492804 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33e89ef-ae01-478f-b2ca-383234e07be1-metrics-tls podName:b33e89ef-ae01-478f-b2ca-383234e07be1 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:45.492795075 +0000 UTC m=+49.663337253 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b33e89ef-ae01-478f-b2ca-383234e07be1-metrics-tls") pod "dns-default-z6c7d" (UID: "b33e89ef-ae01-478f-b2ca-383234e07be1") : secret "dns-default-metrics-tls" not found Jun 02 01:11:38.103735 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.103699 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8f56f6bd-p99tt"] Jun 02 01:11:38.168234 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.168190 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26"] Jun 02 01:11:38.168417 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.168339 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8f56f6bd-p99tt" Jun 02 01:11:38.171074 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.171050 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 02 01:11:38.171222 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.171088 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 02 01:11:38.171222 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.171150 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-f4dxs\"" Jun 02 01:11:38.171353 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.171337 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 02 01:11:38.172225 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.172207 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 02 01:11:38.214649 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.214618 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8f56f6bd-p99tt"] Jun 02 01:11:38.214649 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.214648 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26"] Jun 02 01:11:38.214829 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.214747 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" Jun 02 01:11:38.217427 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.217398 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 02 01:11:38.217564 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.217434 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 02 01:11:38.217564 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.217451 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 02 01:11:38.217564 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.217491 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 02 01:11:38.298094 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.298053 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6nm4\" (UniqueName: \"kubernetes.io/projected/b745b19c-0c6c-426b-99b6-2da2911d9769-kube-api-access-w6nm4\") pod \"managed-serviceaccount-addon-agent-7c8f56f6bd-p99tt\" (UID: \"b745b19c-0c6c-426b-99b6-2da2911d9769\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8f56f6bd-p99tt" Jun 02 01:11:38.298272 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.298139 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b745b19c-0c6c-426b-99b6-2da2911d9769-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c8f56f6bd-p99tt\" (UID: \"b745b19c-0c6c-426b-99b6-2da2911d9769\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8f56f6bd-p99tt" Jun 02 01:11:38.398490 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.398406 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/22ce3f8b-a213-430b-a910-d10e62010e53-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c8dc78b6b-hmc26\" (UID: \"22ce3f8b-a213-430b-a910-d10e62010e53\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" Jun 02 01:11:38.398490 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.398456 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v9nx\" (UniqueName: \"kubernetes.io/projected/22ce3f8b-a213-430b-a910-d10e62010e53-kube-api-access-7v9nx\") pod \"cluster-proxy-proxy-agent-c8dc78b6b-hmc26\" (UID: \"22ce3f8b-a213-430b-a910-d10e62010e53\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" Jun 02 01:11:38.398490 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.398484 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b745b19c-0c6c-426b-99b6-2da2911d9769-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c8f56f6bd-p99tt\" (UID: \"b745b19c-0c6c-426b-99b6-2da2911d9769\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8f56f6bd-p99tt" Jun 02 01:11:38.398748 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.398515 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/22ce3f8b-a213-430b-a910-d10e62010e53-hub\") pod \"cluster-proxy-proxy-agent-c8dc78b6b-hmc26\" (UID: \"22ce3f8b-a213-430b-a910-d10e62010e53\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" Jun 02 01:11:38.398748 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.398532 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/22ce3f8b-a213-430b-a910-d10e62010e53-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-c8dc78b6b-hmc26\" (UID: \"22ce3f8b-a213-430b-a910-d10e62010e53\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" Jun 02 01:11:38.398748 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.398555 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w6nm4\" (UniqueName: \"kubernetes.io/projected/b745b19c-0c6c-426b-99b6-2da2911d9769-kube-api-access-w6nm4\") pod \"managed-serviceaccount-addon-agent-7c8f56f6bd-p99tt\" (UID: \"b745b19c-0c6c-426b-99b6-2da2911d9769\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8f56f6bd-p99tt" Jun 02 01:11:38.398748 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.398571 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/22ce3f8b-a213-430b-a910-d10e62010e53-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c8dc78b6b-hmc26\" (UID: \"22ce3f8b-a213-430b-a910-d10e62010e53\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" Jun 02 01:11:38.398748 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.398607 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/22ce3f8b-a213-430b-a910-d10e62010e53-ca\") pod \"cluster-proxy-proxy-agent-c8dc78b6b-hmc26\" (UID: \"22ce3f8b-a213-430b-a910-d10e62010e53\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" Jun 02 01:11:38.402115 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.402084 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b745b19c-0c6c-426b-99b6-2da2911d9769-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c8f56f6bd-p99tt\" (UID: \"b745b19c-0c6c-426b-99b6-2da2911d9769\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8f56f6bd-p99tt" Jun 02 01:11:38.406307 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.406287 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6nm4\" (UniqueName: \"kubernetes.io/projected/b745b19c-0c6c-426b-99b6-2da2911d9769-kube-api-access-w6nm4\") pod \"managed-serviceaccount-addon-agent-7c8f56f6bd-p99tt\" (UID: \"b745b19c-0c6c-426b-99b6-2da2911d9769\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8f56f6bd-p99tt" Jun 02 01:11:38.489239 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.489203 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8f56f6bd-p99tt" Jun 02 01:11:38.499975 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.499947 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/22ce3f8b-a213-430b-a910-d10e62010e53-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c8dc78b6b-hmc26\" (UID: \"22ce3f8b-a213-430b-a910-d10e62010e53\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" Jun 02 01:11:38.500316 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.500010 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7v9nx\" (UniqueName: \"kubernetes.io/projected/22ce3f8b-a213-430b-a910-d10e62010e53-kube-api-access-7v9nx\") pod \"cluster-proxy-proxy-agent-c8dc78b6b-hmc26\" (UID: \"22ce3f8b-a213-430b-a910-d10e62010e53\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" Jun 02 01:11:38.500316 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.500076 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/22ce3f8b-a213-430b-a910-d10e62010e53-hub\") pod \"cluster-proxy-proxy-agent-c8dc78b6b-hmc26\" (UID: \"22ce3f8b-a213-430b-a910-d10e62010e53\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" Jun 02 01:11:38.500316 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.500109 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/22ce3f8b-a213-430b-a910-d10e62010e53-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-c8dc78b6b-hmc26\" (UID: \"22ce3f8b-a213-430b-a910-d10e62010e53\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" Jun 02 01:11:38.500316 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.500155 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/22ce3f8b-a213-430b-a910-d10e62010e53-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c8dc78b6b-hmc26\" (UID: \"22ce3f8b-a213-430b-a910-d10e62010e53\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" Jun 02 01:11:38.500316 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.500206 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/22ce3f8b-a213-430b-a910-d10e62010e53-ca\") pod \"cluster-proxy-proxy-agent-c8dc78b6b-hmc26\" (UID: \"22ce3f8b-a213-430b-a910-d10e62010e53\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" Jun 02 01:11:38.501270 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.501242 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/22ce3f8b-a213-430b-a910-d10e62010e53-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-c8dc78b6b-hmc26\" (UID: \"22ce3f8b-a213-430b-a910-d10e62010e53\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" Jun 02 01:11:38.502599 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.502573 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/22ce3f8b-a213-430b-a910-d10e62010e53-hub\") pod \"cluster-proxy-proxy-agent-c8dc78b6b-hmc26\" (UID: \"22ce3f8b-a213-430b-a910-d10e62010e53\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" Jun 02 01:11:38.502811 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.502777 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/22ce3f8b-a213-430b-a910-d10e62010e53-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c8dc78b6b-hmc26\" (UID: \"22ce3f8b-a213-430b-a910-d10e62010e53\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" Jun 02 01:11:38.502811 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.502801 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/22ce3f8b-a213-430b-a910-d10e62010e53-ca\") pod \"cluster-proxy-proxy-agent-c8dc78b6b-hmc26\" (UID: \"22ce3f8b-a213-430b-a910-d10e62010e53\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" Jun 02 01:11:38.503188 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.503161 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/22ce3f8b-a213-430b-a910-d10e62010e53-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c8dc78b6b-hmc26\" (UID: \"22ce3f8b-a213-430b-a910-d10e62010e53\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" Jun 02 01:11:38.508581 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.508557 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v9nx\" (UniqueName: \"kubernetes.io/projected/22ce3f8b-a213-430b-a910-d10e62010e53-kube-api-access-7v9nx\") pod \"cluster-proxy-proxy-agent-c8dc78b6b-hmc26\" (UID: \"22ce3f8b-a213-430b-a910-d10e62010e53\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" Jun 02 01:11:38.522863 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.522837 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" Jun 02 01:11:38.702492 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.702462 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8f56f6bd-p99tt"] Jun 02 01:11:38.705525 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:38.705500 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26"] Jun 02 01:11:38.711570 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:11:38.711545 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb745b19c_0c6c_426b_99b6_2da2911d9769.slice/crio-e840919d6169d642dc5459395fb8e3590223640aa3188016bf98cadd17197839 WatchSource:0}: Error finding container e840919d6169d642dc5459395fb8e3590223640aa3188016bf98cadd17197839: Status 404 returned error can't find the container with id e840919d6169d642dc5459395fb8e3590223640aa3188016bf98cadd17197839 Jun 02 01:11:38.712119 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:11:38.712099 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22ce3f8b_a213_430b_a910_d10e62010e53.slice/crio-2689ca761899ea546e295c72a9bc2c2dc6588fbc1d674b1bd10e1df128314d1c WatchSource:0}: Error finding container 2689ca761899ea546e295c72a9bc2c2dc6588fbc1d674b1bd10e1df128314d1c: Status 404 returned error can't find the container with id 2689ca761899ea546e295c72a9bc2c2dc6588fbc1d674b1bd10e1df128314d1c Jun 02 01:11:39.607448 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:39.607407 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" event={"ID":"22ce3f8b-a213-430b-a910-d10e62010e53","Type":"ContainerStarted","Data":"2689ca761899ea546e295c72a9bc2c2dc6588fbc1d674b1bd10e1df128314d1c"} Jun 02 01:11:39.608301 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:39.608280 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8f56f6bd-p99tt" event={"ID":"b745b19c-0c6c-426b-99b6-2da2911d9769","Type":"ContainerStarted","Data":"e840919d6169d642dc5459395fb8e3590223640aa3188016bf98cadd17197839"} Jun 02 01:11:44.620214 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:44.620129 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" event={"ID":"22ce3f8b-a213-430b-a910-d10e62010e53","Type":"ContainerStarted","Data":"7657b51e2f8a02db36db22c786ddf514726ea50a5a3646b35c4f1803a025eb15"} Jun 02 01:11:44.621416 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:44.621388 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8f56f6bd-p99tt" event={"ID":"b745b19c-0c6c-426b-99b6-2da2911d9769","Type":"ContainerStarted","Data":"ac5b78641af232fa0f7d14f61bcf26c5b626881c210691ed3fa1cb03c133b2bb"} Jun 02 01:11:44.636333 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:44.636292 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c8f56f6bd-p99tt" podStartSLOduration=1.004250108 podStartE2EDuration="6.636279399s" podCreationTimestamp="2026-06-02 01:11:38 +0000 UTC" firstStartedPulling="2026-06-02 01:11:38.713478547 +0000 UTC m=+42.884020710" lastFinishedPulling="2026-06-02 01:11:44.345507833 +0000 UTC m=+48.516050001" observedRunningTime="2026-06-02 01:11:44.636074243 +0000 UTC m=+48.806616441" watchObservedRunningTime="2026-06-02 01:11:44.636279399 +0000 UTC m=+48.806821582" Jun 02 01:11:45.557886 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:45.557816 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6dbdb36-49f7-4e85-90d1-72f90db62f96-cert\") pod \"ingress-canary-864j4\" (UID: \"b6dbdb36-49f7-4e85-90d1-72f90db62f96\") " pod="openshift-ingress-canary/ingress-canary-864j4" Jun 02 01:11:45.558164 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:45.557939 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b33e89ef-ae01-478f-b2ca-383234e07be1-metrics-tls\") pod \"dns-default-z6c7d\" (UID: \"b33e89ef-ae01-478f-b2ca-383234e07be1\") " pod="openshift-dns/dns-default-z6c7d" Jun 02 01:11:45.558164 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:45.558075 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:11:45.558164 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:45.558099 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:11:45.558164 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:45.558136 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33e89ef-ae01-478f-b2ca-383234e07be1-metrics-tls podName:b33e89ef-ae01-478f-b2ca-383234e07be1 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:01.558121699 +0000 UTC m=+65.728663862 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b33e89ef-ae01-478f-b2ca-383234e07be1-metrics-tls") pod "dns-default-z6c7d" (UID: "b33e89ef-ae01-478f-b2ca-383234e07be1") : secret "dns-default-metrics-tls" not found Jun 02 01:11:45.558164 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:11:45.558164 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6dbdb36-49f7-4e85-90d1-72f90db62f96-cert podName:b6dbdb36-49f7-4e85-90d1-72f90db62f96 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:01.558146345 +0000 UTC m=+65.728688523 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b6dbdb36-49f7-4e85-90d1-72f90db62f96-cert") pod "ingress-canary-864j4" (UID: "b6dbdb36-49f7-4e85-90d1-72f90db62f96") : secret "canary-serving-cert" not found Jun 02 01:11:48.632056 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:48.632016 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" event={"ID":"22ce3f8b-a213-430b-a910-d10e62010e53","Type":"ContainerStarted","Data":"33a1506eb21de87a3f3d84ad98c556eac3c762865fc7572d41f80153446ad77d"} Jun 02 01:11:48.632056 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:48.632060 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" event={"ID":"22ce3f8b-a213-430b-a910-d10e62010e53","Type":"ContainerStarted","Data":"e50e648f94c8c019e1dfc3a54d20888b31e3a8fa8fa9270df9f6043eaced298a"} Jun 02 01:11:48.650903 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:48.650851 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" podStartSLOduration=1.4916795569999999 podStartE2EDuration="10.650836792s" podCreationTimestamp="2026-06-02 01:11:38 +0000 UTC" firstStartedPulling="2026-06-02 01:11:38.713841579 +0000 UTC m=+42.884383746" lastFinishedPulling="2026-06-02 01:11:47.872998798 +0000 UTC m=+52.043540981" observedRunningTime="2026-06-02 01:11:48.649235503 +0000 UTC m=+52.819777690" watchObservedRunningTime="2026-06-02 01:11:48.650836792 +0000 UTC m=+52.821378978" Jun 02 01:11:56.583248 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:11:56.583213 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lkf95" Jun 02 01:12:01.658079 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:01.658046 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b33e89ef-ae01-478f-b2ca-383234e07be1-metrics-tls\") pod \"dns-default-z6c7d\" (UID: \"b33e89ef-ae01-478f-b2ca-383234e07be1\") " pod="openshift-dns/dns-default-z6c7d" Jun 02 01:12:01.658501 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:01.658093 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6dbdb36-49f7-4e85-90d1-72f90db62f96-cert\") pod \"ingress-canary-864j4\" (UID: \"b6dbdb36-49f7-4e85-90d1-72f90db62f96\") " pod="openshift-ingress-canary/ingress-canary-864j4" Jun 02 01:12:01.658501 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:12:01.658205 2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:12:01.658501 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:12:01.658206 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:12:01.658501 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:12:01.658263 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6dbdb36-49f7-4e85-90d1-72f90db62f96-cert podName:b6dbdb36-49f7-4e85-90d1-72f90db62f96 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:33.658249264 +0000 UTC m=+97.828791427 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b6dbdb36-49f7-4e85-90d1-72f90db62f96-cert") pod "ingress-canary-864j4" (UID: "b6dbdb36-49f7-4e85-90d1-72f90db62f96") : secret "canary-serving-cert" not found Jun 02 01:12:01.658501 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:12:01.658275 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b33e89ef-ae01-478f-b2ca-383234e07be1-metrics-tls podName:b33e89ef-ae01-478f-b2ca-383234e07be1 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:33.658269935 +0000 UTC m=+97.828812098 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b33e89ef-ae01-478f-b2ca-383234e07be1-metrics-tls") pod "dns-default-z6c7d" (UID: "b33e89ef-ae01-478f-b2ca-383234e07be1") : secret "dns-default-metrics-tls" not found Jun 02 01:12:02.060951 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:02.060865 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0c654e7-08a1-4ca8-81c4-5164c7c30e26-metrics-certs\") pod \"network-metrics-daemon-gntp5\" (UID: \"b0c654e7-08a1-4ca8-81c4-5164c7c30e26\") " pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:12:02.063654 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:02.063635 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 01:12:02.071585 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:12:02.071571 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 01:12:02.071644 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:12:02.071627 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0c654e7-08a1-4ca8-81c4-5164c7c30e26-metrics-certs podName:b0c654e7-08a1-4ca8-81c4-5164c7c30e26 nodeName:}" failed. No retries permitted until 2026-06-02 01:13:06.071611111 +0000 UTC m=+130.242153275 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b0c654e7-08a1-4ca8-81c4-5164c7c30e26-metrics-certs") pod "network-metrics-daemon-gntp5" (UID: "b0c654e7-08a1-4ca8-81c4-5164c7c30e26") : secret "metrics-daemon-secret" not found Jun 02 01:12:02.161387 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:02.161329 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hmwsd\" (UniqueName: \"kubernetes.io/projected/629ae262-2447-41a6-b07c-0dd56b001344-kube-api-access-hmwsd\") pod \"network-check-target-55g5j\" (UID: \"629ae262-2447-41a6-b07c-0dd56b001344\") " pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:12:02.163958 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:02.163939 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 01:12:02.174092 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:02.174072 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 01:12:02.184808 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:02.184784 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmwsd\" (UniqueName: \"kubernetes.io/projected/629ae262-2447-41a6-b07c-0dd56b001344-kube-api-access-hmwsd\") pod \"network-check-target-55g5j\" (UID: \"629ae262-2447-41a6-b07c-0dd56b001344\") " pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:12:02.216979 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:02.216949 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dfq6c\"" Jun 02 01:12:02.224964 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:02.224932 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:12:02.362245 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:02.362212 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-55g5j"] Jun 02 01:12:02.365787 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:12:02.365761 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod629ae262_2447_41a6_b07c_0dd56b001344.slice/crio-c9f3246bdec3b4c393cff6ddcd84d0ecdefb35a2a925b3336d12aaf46b69614d WatchSource:0}: Error finding container c9f3246bdec3b4c393cff6ddcd84d0ecdefb35a2a925b3336d12aaf46b69614d: Status 404 returned error can't find the container with id c9f3246bdec3b4c393cff6ddcd84d0ecdefb35a2a925b3336d12aaf46b69614d Jun 02 01:12:02.658114 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:02.658083 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-55g5j" event={"ID":"629ae262-2447-41a6-b07c-0dd56b001344","Type":"ContainerStarted","Data":"c9f3246bdec3b4c393cff6ddcd84d0ecdefb35a2a925b3336d12aaf46b69614d"} Jun 02 01:12:06.644605 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:06.644575 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-smvzg_ff5cd010-d35b-4b58-8008-5c3a1f22deec/dns-node-resolver/0.log" Jun 02 01:12:06.668626 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:06.668588 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-55g5j" event={"ID":"629ae262-2447-41a6-b07c-0dd56b001344","Type":"ContainerStarted","Data":"a9059c430a9a331e9cffa60935f27f5bca7e3ce086d6c68ba3d5f5f6416cb7f4"} Jun 02 01:12:06.668794 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:06.668726 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:12:07.644859 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:07.644833 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h8fml_2200ba73-d59d-4591-8254-fe06a7ee0bde/node-ca/0.log" Jun 02 01:12:33.031756 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.031685 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-55g5j" podStartSLOduration=93.751209463 podStartE2EDuration="1m37.031663766s" podCreationTimestamp="2026-06-02 01:10:56 +0000 UTC" firstStartedPulling="2026-06-02 01:12:02.367761023 +0000 UTC m=+66.538303195" lastFinishedPulling="2026-06-02 01:12:05.648215329 +0000 UTC m=+69.818757498" observedRunningTime="2026-06-02 01:12:06.682603066 +0000 UTC m=+70.853145263" watchObservedRunningTime="2026-06-02 01:12:33.031663766 +0000 UTC m=+97.202205953" Jun 02 01:12:33.032297 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.031956 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-f8p5c"] Jun 02 01:12:33.033813 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.033796 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f8p5c" Jun 02 01:12:33.038276 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.038245 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 01:12:33.038891 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.038869 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7cfzm\"" Jun 02 01:12:33.039008 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.038888 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 01:12:33.039008 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.038870 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 01:12:33.039569 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.039549 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 01:12:33.044281 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.044258 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f8p5c"] Jun 02 01:12:33.081167 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.081127 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e78609df-27c6-49d6-a2f8-c1636aae8674-crio-socket\") pod \"insights-runtime-extractor-f8p5c\" (UID: \"e78609df-27c6-49d6-a2f8-c1636aae8674\") " pod="openshift-insights/insights-runtime-extractor-f8p5c" Jun 02 01:12:33.081332 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.081194 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e78609df-27c6-49d6-a2f8-c1636aae8674-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f8p5c\" (UID: \"e78609df-27c6-49d6-a2f8-c1636aae8674\") " pod="openshift-insights/insights-runtime-extractor-f8p5c" Jun 02 01:12:33.081332 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.081244 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e78609df-27c6-49d6-a2f8-c1636aae8674-data-volume\") pod \"insights-runtime-extractor-f8p5c\" (UID: \"e78609df-27c6-49d6-a2f8-c1636aae8674\") " pod="openshift-insights/insights-runtime-extractor-f8p5c" Jun 02 01:12:33.081332 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.081308 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e78609df-27c6-49d6-a2f8-c1636aae8674-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f8p5c\" (UID: \"e78609df-27c6-49d6-a2f8-c1636aae8674\") " pod="openshift-insights/insights-runtime-extractor-f8p5c" Jun 02 01:12:33.081462 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.081345 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmf45\" (UniqueName: \"kubernetes.io/projected/e78609df-27c6-49d6-a2f8-c1636aae8674-kube-api-access-cmf45\") pod \"insights-runtime-extractor-f8p5c\" (UID: \"e78609df-27c6-49d6-a2f8-c1636aae8674\") " pod="openshift-insights/insights-runtime-extractor-f8p5c" Jun 02 01:12:33.182474 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.182435 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cmf45\" (UniqueName: \"kubernetes.io/projected/e78609df-27c6-49d6-a2f8-c1636aae8674-kube-api-access-cmf45\") pod \"insights-runtime-extractor-f8p5c\" (UID: \"e78609df-27c6-49d6-a2f8-c1636aae8674\") " pod="openshift-insights/insights-runtime-extractor-f8p5c" Jun 02 01:12:33.182753 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.182488 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e78609df-27c6-49d6-a2f8-c1636aae8674-crio-socket\") pod \"insights-runtime-extractor-f8p5c\" (UID: \"e78609df-27c6-49d6-a2f8-c1636aae8674\") " pod="openshift-insights/insights-runtime-extractor-f8p5c" Jun 02 01:12:33.182753 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.182549 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e78609df-27c6-49d6-a2f8-c1636aae8674-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f8p5c\" (UID: \"e78609df-27c6-49d6-a2f8-c1636aae8674\") " pod="openshift-insights/insights-runtime-extractor-f8p5c" Jun 02 01:12:33.182753 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.182576 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e78609df-27c6-49d6-a2f8-c1636aae8674-data-volume\") pod \"insights-runtime-extractor-f8p5c\" (UID: \"e78609df-27c6-49d6-a2f8-c1636aae8674\") " pod="openshift-insights/insights-runtime-extractor-f8p5c" Jun 02 01:12:33.182753 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.182632 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e78609df-27c6-49d6-a2f8-c1636aae8674-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f8p5c\" (UID: \"e78609df-27c6-49d6-a2f8-c1636aae8674\") " pod="openshift-insights/insights-runtime-extractor-f8p5c" Jun 02 01:12:33.182753 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.182569 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e78609df-27c6-49d6-a2f8-c1636aae8674-crio-socket\") pod \"insights-runtime-extractor-f8p5c\" (UID: \"e78609df-27c6-49d6-a2f8-c1636aae8674\") " pod="openshift-insights/insights-runtime-extractor-f8p5c" Jun 02 01:12:33.183087 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.182939 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e78609df-27c6-49d6-a2f8-c1636aae8674-data-volume\") pod \"insights-runtime-extractor-f8p5c\" (UID: \"e78609df-27c6-49d6-a2f8-c1636aae8674\") " pod="openshift-insights/insights-runtime-extractor-f8p5c" Jun 02 01:12:33.183087 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.183080 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e78609df-27c6-49d6-a2f8-c1636aae8674-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f8p5c\" (UID: \"e78609df-27c6-49d6-a2f8-c1636aae8674\") " pod="openshift-insights/insights-runtime-extractor-f8p5c" Jun 02 01:12:33.184992 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.184969 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e78609df-27c6-49d6-a2f8-c1636aae8674-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f8p5c\" (UID: \"e78609df-27c6-49d6-a2f8-c1636aae8674\") " pod="openshift-insights/insights-runtime-extractor-f8p5c" Jun 02 01:12:33.192383 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.192349 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmf45\" (UniqueName: \"kubernetes.io/projected/e78609df-27c6-49d6-a2f8-c1636aae8674-kube-api-access-cmf45\") pod \"insights-runtime-extractor-f8p5c\" (UID: \"e78609df-27c6-49d6-a2f8-c1636aae8674\") " pod="openshift-insights/insights-runtime-extractor-f8p5c" Jun 02 01:12:33.342226 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.342133 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f8p5c" Jun 02 01:12:33.464620 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.464587 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f8p5c"] Jun 02 01:12:33.468056 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:12:33.468026 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode78609df_27c6_49d6_a2f8_c1636aae8674.slice/crio-89517309c8d32900b88c0ce5df927f1730853761fc7859a46173f0811586897b WatchSource:0}: Error finding container 89517309c8d32900b88c0ce5df927f1730853761fc7859a46173f0811586897b: Status 404 returned error can't find the container with id 89517309c8d32900b88c0ce5df927f1730853761fc7859a46173f0811586897b Jun 02 01:12:33.686764 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.686724 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b33e89ef-ae01-478f-b2ca-383234e07be1-metrics-tls\") pod \"dns-default-z6c7d\" (UID: \"b33e89ef-ae01-478f-b2ca-383234e07be1\") " pod="openshift-dns/dns-default-z6c7d" Jun 02 01:12:33.686958 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.686790 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6dbdb36-49f7-4e85-90d1-72f90db62f96-cert\") pod \"ingress-canary-864j4\" (UID: \"b6dbdb36-49f7-4e85-90d1-72f90db62f96\") " pod="openshift-ingress-canary/ingress-canary-864j4" Jun 02 01:12:33.689116 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.689087 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6dbdb36-49f7-4e85-90d1-72f90db62f96-cert\") pod \"ingress-canary-864j4\" (UID: \"b6dbdb36-49f7-4e85-90d1-72f90db62f96\") " pod="openshift-ingress-canary/ingress-canary-864j4" Jun 02 01:12:33.689217 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.689152 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b33e89ef-ae01-478f-b2ca-383234e07be1-metrics-tls\") pod \"dns-default-z6c7d\" (UID: \"b33e89ef-ae01-478f-b2ca-383234e07be1\") " pod="openshift-dns/dns-default-z6c7d" Jun 02 01:12:33.731269 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.731235 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f8p5c" event={"ID":"e78609df-27c6-49d6-a2f8-c1636aae8674","Type":"ContainerStarted","Data":"7899a4de55c450c54925342145dbb21911395ae5929a0fc16d94ee9a168c7a44"} Jun 02 01:12:33.731422 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.731273 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f8p5c" event={"ID":"e78609df-27c6-49d6-a2f8-c1636aae8674","Type":"ContainerStarted","Data":"89517309c8d32900b88c0ce5df927f1730853761fc7859a46173f0811586897b"} Jun 02 01:12:33.889957 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.889926 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n98qz\"" Jun 02 01:12:33.895891 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.895869 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9tnxm\"" Jun 02 01:12:33.898640 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.898625 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z6c7d" Jun 02 01:12:33.904269 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:33.904249 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-864j4" Jun 02 01:12:34.034782 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:34.034747 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z6c7d"] Jun 02 01:12:34.037831 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:12:34.037800 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb33e89ef_ae01_478f_b2ca_383234e07be1.slice/crio-5299ca0cc20d719486b7d1f11468b329133996454e9144058eb6fed7a4aed5b0 WatchSource:0}: Error finding container 5299ca0cc20d719486b7d1f11468b329133996454e9144058eb6fed7a4aed5b0: Status 404 returned error can't find the container with id 5299ca0cc20d719486b7d1f11468b329133996454e9144058eb6fed7a4aed5b0 Jun 02 01:12:34.052291 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:34.052259 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-864j4"] Jun 02 01:12:34.117227 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:12:34.117191 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6dbdb36_49f7_4e85_90d1_72f90db62f96.slice/crio-fef9afe0ea151dcbe66d712a0dab2cd5b48198dc7fcc158db5688ff4efa566c2 WatchSource:0}: Error finding container fef9afe0ea151dcbe66d712a0dab2cd5b48198dc7fcc158db5688ff4efa566c2: Status 404 returned error can't find the container with id fef9afe0ea151dcbe66d712a0dab2cd5b48198dc7fcc158db5688ff4efa566c2 Jun 02 01:12:34.735450 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:34.735407 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-864j4" event={"ID":"b6dbdb36-49f7-4e85-90d1-72f90db62f96","Type":"ContainerStarted","Data":"fef9afe0ea151dcbe66d712a0dab2cd5b48198dc7fcc158db5688ff4efa566c2"} Jun 02 01:12:34.737593 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:34.737551 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f8p5c" event={"ID":"e78609df-27c6-49d6-a2f8-c1636aae8674","Type":"ContainerStarted","Data":"9637c1fb562841d0c3b631751b01007bd94bb8caf3a96bf99ed3b59518977c79"} Jun 02 01:12:34.738836 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:34.738794 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z6c7d" event={"ID":"b33e89ef-ae01-478f-b2ca-383234e07be1","Type":"ContainerStarted","Data":"5299ca0cc20d719486b7d1f11468b329133996454e9144058eb6fed7a4aed5b0"} Jun 02 01:12:35.722673 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:35.722641 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-f67sq"] Jun 02 01:12:35.724694 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:35.724664 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-f67sq" Jun 02 01:12:35.727228 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:35.727203 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 02 01:12:35.727228 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:35.727208 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6vjxx\"" Jun 02 01:12:35.735265 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:35.735234 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-f67sq"] Jun 02 01:12:35.801790 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:35.801755 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/304f31db-e595-4938-9f6b-38430c39e135-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-f67sq\" (UID: \"304f31db-e595-4938-9f6b-38430c39e135\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-f67sq" Jun 02 01:12:35.902356 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:35.902319 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/304f31db-e595-4938-9f6b-38430c39e135-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-f67sq\" (UID: \"304f31db-e595-4938-9f6b-38430c39e135\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-f67sq" Jun 02 01:12:35.902565 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:12:35.902498 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 02 01:12:35.902626 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:12:35.902570 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/304f31db-e595-4938-9f6b-38430c39e135-tls-certificates podName:304f31db-e595-4938-9f6b-38430c39e135 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:36.402551041 +0000 UTC m=+100.573093205 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/304f31db-e595-4938-9f6b-38430c39e135-tls-certificates") pod "prometheus-operator-admission-webhook-59b7f8756b-f67sq" (UID: "304f31db-e595-4938-9f6b-38430c39e135") : secret "prometheus-operator-admission-webhook-tls" not found Jun 02 01:12:36.406925 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:36.406897 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/304f31db-e595-4938-9f6b-38430c39e135-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-f67sq\" (UID: \"304f31db-e595-4938-9f6b-38430c39e135\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-f67sq" Jun 02 01:12:36.407110 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:12:36.407042 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 02 01:12:36.407176 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:12:36.407108 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/304f31db-e595-4938-9f6b-38430c39e135-tls-certificates podName:304f31db-e595-4938-9f6b-38430c39e135 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:37.407091543 +0000 UTC m=+101.577633706 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/304f31db-e595-4938-9f6b-38430c39e135-tls-certificates") pod "prometheus-operator-admission-webhook-59b7f8756b-f67sq" (UID: "304f31db-e595-4938-9f6b-38430c39e135") : secret "prometheus-operator-admission-webhook-tls" not found Jun 02 01:12:37.414267 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:37.414222 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/304f31db-e595-4938-9f6b-38430c39e135-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-f67sq\" (UID: \"304f31db-e595-4938-9f6b-38430c39e135\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-f67sq" Jun 02 01:12:37.416660 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:37.416633 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/304f31db-e595-4938-9f6b-38430c39e135-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-f67sq\" (UID: \"304f31db-e595-4938-9f6b-38430c39e135\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-f67sq" Jun 02 01:12:37.536570 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:37.536528 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-f67sq" Jun 02 01:12:37.662853 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:37.662821 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-f67sq"] Jun 02 01:12:37.666032 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:12:37.665965 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod304f31db_e595_4938_9f6b_38430c39e135.slice/crio-56b0fcd850577d7649c32df55b96090625ea5519ff0486d9dedd1866e32ff58a WatchSource:0}: Error finding container 56b0fcd850577d7649c32df55b96090625ea5519ff0486d9dedd1866e32ff58a: Status 404 returned error can't find the container with id 56b0fcd850577d7649c32df55b96090625ea5519ff0486d9dedd1866e32ff58a Jun 02 01:12:37.674041 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:37.674020 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-55g5j" Jun 02 01:12:37.747318 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:37.747284 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-f67sq" event={"ID":"304f31db-e595-4938-9f6b-38430c39e135","Type":"ContainerStarted","Data":"56b0fcd850577d7649c32df55b96090625ea5519ff0486d9dedd1866e32ff58a"} Jun 02 01:12:37.748494 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:37.748467 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-864j4" event={"ID":"b6dbdb36-49f7-4e85-90d1-72f90db62f96","Type":"ContainerStarted","Data":"9e42067b7579379c81b299d908e44e41e72555b5f16f7acb29da8c01de146a2c"} Jun 02 01:12:37.750140 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:37.750115 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f8p5c" event={"ID":"e78609df-27c6-49d6-a2f8-c1636aae8674","Type":"ContainerStarted","Data":"f3eed70f9ff828e3de54d0a4addcacd4be8b81fdac4d58a20dcfe11f84f34667"} Jun 02 01:12:37.751491 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:37.751473 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z6c7d" event={"ID":"b33e89ef-ae01-478f-b2ca-383234e07be1","Type":"ContainerStarted","Data":"090e232f230632290895359a7e79a844769242dcb4592f5166b0856a817383c1"} Jun 02 01:12:37.751558 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:37.751495 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z6c7d" event={"ID":"b33e89ef-ae01-478f-b2ca-383234e07be1","Type":"ContainerStarted","Data":"150ce44d6be40da065f6ba850439b7c83f4b799fdfdb25533c5956ea94afbee0"} Jun 02 01:12:37.751621 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:37.751611 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z6c7d" Jun 02 01:12:37.766230 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:37.766188 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-864j4" podStartSLOduration=66.122583388 podStartE2EDuration="1m8.76617668s" podCreationTimestamp="2026-06-02 01:11:29 +0000 UTC" firstStartedPulling="2026-06-02 01:12:34.118943086 +0000 UTC m=+98.289485254" lastFinishedPulling="2026-06-02 01:12:36.762536368 +0000 UTC m=+100.933078546" observedRunningTime="2026-06-02 01:12:37.765768146 +0000 UTC m=+101.936310331" watchObservedRunningTime="2026-06-02 01:12:37.76617668 +0000 UTC m=+101.936718866" Jun 02 01:12:37.781886 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:37.781845 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-f8p5c" podStartSLOduration=1.539563843 podStartE2EDuration="4.781832796s" podCreationTimestamp="2026-06-02 01:12:33 +0000 UTC" firstStartedPulling="2026-06-02 01:12:33.52393056 +0000 UTC m=+97.694472727" lastFinishedPulling="2026-06-02 01:12:36.766199515 +0000 UTC m=+100.936741680" observedRunningTime="2026-06-02 01:12:37.781244327 +0000 UTC m=+101.951786513" watchObservedRunningTime="2026-06-02 01:12:37.781832796 +0000 UTC m=+101.952374981" Jun 02 01:12:37.796440 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:37.796359 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-z6c7d" podStartSLOduration=66.07350282 podStartE2EDuration="1m8.796339565s" podCreationTimestamp="2026-06-02 01:11:29 +0000 UTC" firstStartedPulling="2026-06-02 01:12:34.039695947 +0000 UTC m=+98.210238110" lastFinishedPulling="2026-06-02 01:12:36.762532688 +0000 UTC m=+100.933074855" observedRunningTime="2026-06-02 01:12:37.795775356 +0000 UTC m=+101.966317555" watchObservedRunningTime="2026-06-02 01:12:37.796339565 +0000 UTC m=+101.966881751" Jun 02 01:12:39.758892 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:39.758852 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-f67sq" event={"ID":"304f31db-e595-4938-9f6b-38430c39e135","Type":"ContainerStarted","Data":"606468167bfdb6f5e59acc969847f30c3ff0f020a3c844167546abd614e8435b"} Jun 02 01:12:39.759409 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:39.759037 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-f67sq" Jun 02 01:12:39.763774 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:39.763749 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-f67sq" Jun 02 01:12:39.774023 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:39.773977 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-f67sq" podStartSLOduration=3.686468625 podStartE2EDuration="4.773965155s" podCreationTimestamp="2026-06-02 01:12:35 +0000 UTC" firstStartedPulling="2026-06-02 01:12:37.66782396 +0000 UTC m=+101.838366127" lastFinishedPulling="2026-06-02 01:12:38.755320476 +0000 UTC m=+102.925862657" observedRunningTime="2026-06-02 01:12:39.772675106 +0000 UTC m=+103.943217289" watchObservedRunningTime="2026-06-02 01:12:39.773965155 +0000 UTC m=+103.944507340" Jun 02 01:12:43.065749 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.065715 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cd547c8d6-wwrl2"] Jun 02 01:12:43.068642 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.068623 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cd547c8d6-wwrl2" Jun 02 01:12:43.071256 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.071237 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 01:12:43.071404 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.071237 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 01:12:43.071404 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.071299 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 01:12:43.072400 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.072361 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 01:12:43.072502 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.072418 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 01:12:43.072502 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.072445 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 01:12:43.072502 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.072444 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-45c4f\"" Jun 02 01:12:43.072769 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.072748 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 01:12:43.076898 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.076882 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 01:12:43.079934 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.079909 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cd547c8d6-wwrl2"] Jun 02 01:12:43.153883 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.153846 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a3da997-2320-46b3-8356-6430f1e28e6a-trusted-ca-bundle\") pod \"console-7cd547c8d6-wwrl2\" (UID: \"8a3da997-2320-46b3-8356-6430f1e28e6a\") " pod="openshift-console/console-7cd547c8d6-wwrl2" Jun 02 01:12:43.154057 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.153901 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phzt5\" (UniqueName: \"kubernetes.io/projected/8a3da997-2320-46b3-8356-6430f1e28e6a-kube-api-access-phzt5\") pod \"console-7cd547c8d6-wwrl2\" (UID: \"8a3da997-2320-46b3-8356-6430f1e28e6a\") " pod="openshift-console/console-7cd547c8d6-wwrl2" Jun 02 01:12:43.154057 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.153960 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a3da997-2320-46b3-8356-6430f1e28e6a-console-oauth-config\") pod \"console-7cd547c8d6-wwrl2\" (UID: \"8a3da997-2320-46b3-8356-6430f1e28e6a\") " pod="openshift-console/console-7cd547c8d6-wwrl2" Jun 02 01:12:43.154057 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.153995 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a3da997-2320-46b3-8356-6430f1e28e6a-console-serving-cert\") pod \"console-7cd547c8d6-wwrl2\" (UID: \"8a3da997-2320-46b3-8356-6430f1e28e6a\") " pod="openshift-console/console-7cd547c8d6-wwrl2" Jun 02 01:12:43.154057 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.154012 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a3da997-2320-46b3-8356-6430f1e28e6a-console-config\") pod \"console-7cd547c8d6-wwrl2\" (UID: \"8a3da997-2320-46b3-8356-6430f1e28e6a\") " pod="openshift-console/console-7cd547c8d6-wwrl2" Jun 02 01:12:43.154057 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.154028 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a3da997-2320-46b3-8356-6430f1e28e6a-service-ca\") pod \"console-7cd547c8d6-wwrl2\" (UID: \"8a3da997-2320-46b3-8356-6430f1e28e6a\") " pod="openshift-console/console-7cd547c8d6-wwrl2" Jun 02 01:12:43.154217 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.154061 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a3da997-2320-46b3-8356-6430f1e28e6a-oauth-serving-cert\") pod \"console-7cd547c8d6-wwrl2\" (UID: \"8a3da997-2320-46b3-8356-6430f1e28e6a\") " pod="openshift-console/console-7cd547c8d6-wwrl2" Jun 02 01:12:43.254988 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.254949 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-phzt5\" (UniqueName: \"kubernetes.io/projected/8a3da997-2320-46b3-8356-6430f1e28e6a-kube-api-access-phzt5\") pod \"console-7cd547c8d6-wwrl2\" (UID: \"8a3da997-2320-46b3-8356-6430f1e28e6a\") " pod="openshift-console/console-7cd547c8d6-wwrl2" Jun 02 01:12:43.254988 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.254993 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a3da997-2320-46b3-8356-6430f1e28e6a-console-oauth-config\") pod \"console-7cd547c8d6-wwrl2\" (UID: \"8a3da997-2320-46b3-8356-6430f1e28e6a\") " pod="openshift-console/console-7cd547c8d6-wwrl2" Jun 02 01:12:43.255179 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.255029 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a3da997-2320-46b3-8356-6430f1e28e6a-console-serving-cert\") pod \"console-7cd547c8d6-wwrl2\" (UID: \"8a3da997-2320-46b3-8356-6430f1e28e6a\") " pod="openshift-console/console-7cd547c8d6-wwrl2" Jun 02 01:12:43.255179 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.255045 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a3da997-2320-46b3-8356-6430f1e28e6a-console-config\") pod \"console-7cd547c8d6-wwrl2\" (UID: \"8a3da997-2320-46b3-8356-6430f1e28e6a\") " pod="openshift-console/console-7cd547c8d6-wwrl2" Jun 02 01:12:43.255179 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.255061 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a3da997-2320-46b3-8356-6430f1e28e6a-service-ca\") pod \"console-7cd547c8d6-wwrl2\" (UID: \"8a3da997-2320-46b3-8356-6430f1e28e6a\") " pod="openshift-console/console-7cd547c8d6-wwrl2" Jun 02 01:12:43.255179 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.255088 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a3da997-2320-46b3-8356-6430f1e28e6a-oauth-serving-cert\") pod \"console-7cd547c8d6-wwrl2\" (UID: \"8a3da997-2320-46b3-8356-6430f1e28e6a\") " pod="openshift-console/console-7cd547c8d6-wwrl2" Jun 02 01:12:43.255179 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.255146 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a3da997-2320-46b3-8356-6430f1e28e6a-trusted-ca-bundle\") pod \"console-7cd547c8d6-wwrl2\" (UID: \"8a3da997-2320-46b3-8356-6430f1e28e6a\") " pod="openshift-console/console-7cd547c8d6-wwrl2" Jun 02 01:12:43.255890 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.255865 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a3da997-2320-46b3-8356-6430f1e28e6a-oauth-serving-cert\") pod \"console-7cd547c8d6-wwrl2\" (UID: \"8a3da997-2320-46b3-8356-6430f1e28e6a\") " pod="openshift-console/console-7cd547c8d6-wwrl2" Jun 02 01:12:43.256000 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.255886 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a3da997-2320-46b3-8356-6430f1e28e6a-service-ca\") pod \"console-7cd547c8d6-wwrl2\" (UID: \"8a3da997-2320-46b3-8356-6430f1e28e6a\") " pod="openshift-console/console-7cd547c8d6-wwrl2" Jun 02 01:12:43.256000 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.255910 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a3da997-2320-46b3-8356-6430f1e28e6a-console-config\") pod \"console-7cd547c8d6-wwrl2\" (UID: \"8a3da997-2320-46b3-8356-6430f1e28e6a\") " pod="openshift-console/console-7cd547c8d6-wwrl2" Jun 02 01:12:43.256108 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.256091 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a3da997-2320-46b3-8356-6430f1e28e6a-trusted-ca-bundle\") pod \"console-7cd547c8d6-wwrl2\" (UID: \"8a3da997-2320-46b3-8356-6430f1e28e6a\") " pod="openshift-console/console-7cd547c8d6-wwrl2" Jun 02 01:12:43.258084 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.258059 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a3da997-2320-46b3-8356-6430f1e28e6a-console-serving-cert\") pod \"console-7cd547c8d6-wwrl2\" (UID: \"8a3da997-2320-46b3-8356-6430f1e28e6a\") " pod="openshift-console/console-7cd547c8d6-wwrl2" Jun 02 01:12:43.258202 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.258182 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a3da997-2320-46b3-8356-6430f1e28e6a-console-oauth-config\") pod \"console-7cd547c8d6-wwrl2\" (UID: \"8a3da997-2320-46b3-8356-6430f1e28e6a\") " pod="openshift-console/console-7cd547c8d6-wwrl2" Jun 02 01:12:43.262721 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.262700 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phzt5\" (UniqueName: \"kubernetes.io/projected/8a3da997-2320-46b3-8356-6430f1e28e6a-kube-api-access-phzt5\") pod \"console-7cd547c8d6-wwrl2\" (UID: \"8a3da997-2320-46b3-8356-6430f1e28e6a\") " pod="openshift-console/console-7cd547c8d6-wwrl2" Jun 02 01:12:43.378303 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.378206 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cd547c8d6-wwrl2" Jun 02 01:12:43.504536 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.504502 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cd547c8d6-wwrl2"] Jun 02 01:12:43.507868 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:12:43.507836 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3da997_2320_46b3_8356_6430f1e28e6a.slice/crio-ba2869133db3ff3d086bfe0ff593a05089c06eba0be276290df7b79a9fdcd133 WatchSource:0}: Error finding container ba2869133db3ff3d086bfe0ff593a05089c06eba0be276290df7b79a9fdcd133: Status 404 returned error can't find the container with id ba2869133db3ff3d086bfe0ff593a05089c06eba0be276290df7b79a9fdcd133 Jun 02 01:12:43.769979 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:43.769943 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cd547c8d6-wwrl2" event={"ID":"8a3da997-2320-46b3-8356-6430f1e28e6a","Type":"ContainerStarted","Data":"ba2869133db3ff3d086bfe0ff593a05089c06eba0be276290df7b79a9fdcd133"} Jun 02 01:12:45.134050 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.134017 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qkfx5"] Jun 02 01:12:45.137341 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.137311 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qkfx5" Jun 02 01:12:45.140040 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.140013 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 01:12:45.140184 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.140072 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 01:12:45.140285 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.140258 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mpn8j\"" Jun 02 01:12:45.140635 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.140614 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 01:12:45.141383 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.141347 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 01:12:45.141492 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.141352 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 01:12:45.141492 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.141404 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 01:12:45.270733 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.270692 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8ffd1ed4-f142-48a7-9362-86673790ae37-root\") pod \"node-exporter-qkfx5\" (UID: \"8ffd1ed4-f142-48a7-9362-86673790ae37\") " pod="openshift-monitoring/node-exporter-qkfx5" Jun 02 01:12:45.270922 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.270751 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ffd1ed4-f142-48a7-9362-86673790ae37-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qkfx5\" (UID: \"8ffd1ed4-f142-48a7-9362-86673790ae37\") " pod="openshift-monitoring/node-exporter-qkfx5" Jun 02 01:12:45.270922 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.270776 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ffd1ed4-f142-48a7-9362-86673790ae37-sys\") pod \"node-exporter-qkfx5\" (UID: \"8ffd1ed4-f142-48a7-9362-86673790ae37\") " pod="openshift-monitoring/node-exporter-qkfx5" Jun 02 01:12:45.270922 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.270835 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8ffd1ed4-f142-48a7-9362-86673790ae37-node-exporter-textfile\") pod \"node-exporter-qkfx5\" (UID: \"8ffd1ed4-f142-48a7-9362-86673790ae37\") " pod="openshift-monitoring/node-exporter-qkfx5" Jun 02 01:12:45.270922 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.270897 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ffd1ed4-f142-48a7-9362-86673790ae37-metrics-client-ca\") pod \"node-exporter-qkfx5\" (UID: \"8ffd1ed4-f142-48a7-9362-86673790ae37\") " pod="openshift-monitoring/node-exporter-qkfx5" Jun 02 01:12:45.271133 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.270929 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8ffd1ed4-f142-48a7-9362-86673790ae37-node-exporter-tls\") pod \"node-exporter-qkfx5\" (UID: \"8ffd1ed4-f142-48a7-9362-86673790ae37\") " pod="openshift-monitoring/node-exporter-qkfx5" Jun 02 01:12:45.271133 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.271007 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8ffd1ed4-f142-48a7-9362-86673790ae37-node-exporter-accelerators-collector-config\") pod \"node-exporter-qkfx5\" (UID: \"8ffd1ed4-f142-48a7-9362-86673790ae37\") " pod="openshift-monitoring/node-exporter-qkfx5" Jun 02 01:12:45.271133 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.271051 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnwcz\" (UniqueName: \"kubernetes.io/projected/8ffd1ed4-f142-48a7-9362-86673790ae37-kube-api-access-wnwcz\") pod \"node-exporter-qkfx5\" (UID: \"8ffd1ed4-f142-48a7-9362-86673790ae37\") " pod="openshift-monitoring/node-exporter-qkfx5" Jun 02 01:12:45.271133 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.271093 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8ffd1ed4-f142-48a7-9362-86673790ae37-node-exporter-wtmp\") pod \"node-exporter-qkfx5\" (UID: \"8ffd1ed4-f142-48a7-9362-86673790ae37\") " pod="openshift-monitoring/node-exporter-qkfx5" Jun 02 01:12:45.372248 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.372207 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8ffd1ed4-f142-48a7-9362-86673790ae37-node-exporter-textfile\") pod \"node-exporter-qkfx5\" (UID: \"8ffd1ed4-f142-48a7-9362-86673790ae37\") " pod="openshift-monitoring/node-exporter-qkfx5" Jun 02 01:12:45.372474 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.372270 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ffd1ed4-f142-48a7-9362-86673790ae37-metrics-client-ca\") pod \"node-exporter-qkfx5\" (UID: \"8ffd1ed4-f142-48a7-9362-86673790ae37\") " pod="openshift-monitoring/node-exporter-qkfx5" Jun 02 01:12:45.372474 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.372301 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8ffd1ed4-f142-48a7-9362-86673790ae37-node-exporter-tls\") pod \"node-exporter-qkfx5\" (UID: \"8ffd1ed4-f142-48a7-9362-86673790ae37\") " pod="openshift-monitoring/node-exporter-qkfx5" Jun 02 01:12:45.372474 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.372330 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8ffd1ed4-f142-48a7-9362-86673790ae37-node-exporter-accelerators-collector-config\") pod \"node-exporter-qkfx5\" (UID: \"8ffd1ed4-f142-48a7-9362-86673790ae37\") " pod="openshift-monitoring/node-exporter-qkfx5" Jun 02 01:12:45.372474 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.372350 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wnwcz\" (UniqueName: \"kubernetes.io/projected/8ffd1ed4-f142-48a7-9362-86673790ae37-kube-api-access-wnwcz\") pod \"node-exporter-qkfx5\" (UID: \"8ffd1ed4-f142-48a7-9362-86673790ae37\") " pod="openshift-monitoring/node-exporter-qkfx5" Jun 02 01:12:45.372474 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.372383 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8ffd1ed4-f142-48a7-9362-86673790ae37-node-exporter-wtmp\") pod \"node-exporter-qkfx5\" (UID: \"8ffd1ed4-f142-48a7-9362-86673790ae37\") " pod="openshift-monitoring/node-exporter-qkfx5" Jun 02 01:12:45.372474 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.372416 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8ffd1ed4-f142-48a7-9362-86673790ae37-root\") pod \"node-exporter-qkfx5\" (UID: \"8ffd1ed4-f142-48a7-9362-86673790ae37\") " pod="openshift-monitoring/node-exporter-qkfx5" Jun 02 01:12:45.372474 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.372457 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ffd1ed4-f142-48a7-9362-86673790ae37-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qkfx5\" (UID: \"8ffd1ed4-f142-48a7-9362-86673790ae37\") " pod="openshift-monitoring/node-exporter-qkfx5" Jun 02 01:12:45.372782 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.372487 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ffd1ed4-f142-48a7-9362-86673790ae37-sys\") pod \"node-exporter-qkfx5\" (UID: \"8ffd1ed4-f142-48a7-9362-86673790ae37\") " pod="openshift-monitoring/node-exporter-qkfx5" Jun 02 01:12:45.372782 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.372558 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ffd1ed4-f142-48a7-9362-86673790ae37-sys\") pod \"node-exporter-qkfx5\" (UID: \"8ffd1ed4-f142-48a7-9362-86673790ae37\") " pod="openshift-monitoring/node-exporter-qkfx5" Jun 02 01:12:45.372782 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.372639 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8ffd1ed4-f142-48a7-9362-86673790ae37-node-exporter-textfile\") pod \"node-exporter-qkfx5\" (UID: \"8ffd1ed4-f142-48a7-9362-86673790ae37\") " pod="openshift-monitoring/node-exporter-qkfx5" Jun 02 01:12:45.372782 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.372685 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8ffd1ed4-f142-48a7-9362-86673790ae37-node-exporter-wtmp\") pod \"node-exporter-qkfx5\" (UID: \"8ffd1ed4-f142-48a7-9362-86673790ae37\") " pod="openshift-monitoring/node-exporter-qkfx5" Jun 02 01:12:45.372782 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.372704 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8ffd1ed4-f142-48a7-9362-86673790ae37-root\") pod \"node-exporter-qkfx5\" (UID: \"8ffd1ed4-f142-48a7-9362-86673790ae37\") " pod="openshift-monitoring/node-exporter-qkfx5" Jun 02 01:12:45.373040 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.373005 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ffd1ed4-f142-48a7-9362-86673790ae37-metrics-client-ca\") pod \"node-exporter-qkfx5\" (UID: \"8ffd1ed4-f142-48a7-9362-86673790ae37\") " pod="openshift-monitoring/node-exporter-qkfx5" Jun 02 01:12:45.373094 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.373040 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8ffd1ed4-f142-48a7-9362-86673790ae37-node-exporter-accelerators-collector-config\") pod \"node-exporter-qkfx5\" (UID: \"8ffd1ed4-f142-48a7-9362-86673790ae37\") " pod="openshift-monitoring/node-exporter-qkfx5" Jun 02 01:12:45.374960 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.374944 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ffd1ed4-f142-48a7-9362-86673790ae37-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qkfx5\" (UID: \"8ffd1ed4-f142-48a7-9362-86673790ae37\") " pod="openshift-monitoring/node-exporter-qkfx5" Jun 02 01:12:45.375097 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.375041 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8ffd1ed4-f142-48a7-9362-86673790ae37-node-exporter-tls\") pod \"node-exporter-qkfx5\" (UID: \"8ffd1ed4-f142-48a7-9362-86673790ae37\") " pod="openshift-monitoring/node-exporter-qkfx5" Jun 02 01:12:45.382198 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.382167 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnwcz\" (UniqueName: \"kubernetes.io/projected/8ffd1ed4-f142-48a7-9362-86673790ae37-kube-api-access-wnwcz\") pod \"node-exporter-qkfx5\" (UID: \"8ffd1ed4-f142-48a7-9362-86673790ae37\") " pod="openshift-monitoring/node-exporter-qkfx5" Jun 02 01:12:45.448747 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:45.448706 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qkfx5" Jun 02 01:12:45.987104 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:12:45.987076 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ffd1ed4_f142_48a7_9362_86673790ae37.slice/crio-35fbc0864981d80331eaa4d02d9d8615b5530ec0387e6c23dddee1e146a3e9ed WatchSource:0}: Error finding container 35fbc0864981d80331eaa4d02d9d8615b5530ec0387e6c23dddee1e146a3e9ed: Status 404 returned error can't find the container with id 35fbc0864981d80331eaa4d02d9d8615b5530ec0387e6c23dddee1e146a3e9ed Jun 02 01:12:46.203337 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.203300 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 01:12:46.209042 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.209025 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.211740 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.211647 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 01:12:46.211740 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.211647 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dg642\"" Jun 02 01:12:46.211740 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.211647 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 01:12:46.211740 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.211725 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 01:12:46.212012 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.211655 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 01:12:46.212059 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.212036 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 01:12:46.212265 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.212103 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 01:12:46.212265 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.212160 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 01:12:46.212265 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.212173 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 01:12:46.212265 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.212221 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 01:12:46.219454 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.219432 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 01:12:46.279802 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.279702 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.279802 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.279753 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.280025 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.279815 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.280025 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.279846 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.280025 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.279870 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-config-volume\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.280025 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.279892 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-config-out\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.280025 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.279912 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.280025 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.279934 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-web-config\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.280025 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.279992 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.280320 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.280049 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.280320 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.280084 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p9cp\" (UniqueName: \"kubernetes.io/projected/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-kube-api-access-2p9cp\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.280320 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.280117 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.280320 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.280164 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.381153 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.381118 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.381153 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.381154 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-config-volume\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.381354 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.381172 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-config-out\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.381354 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.381226 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.381354 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.381243 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-web-config\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.381354 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.381265 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.381354 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.381302 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.381354 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.381331 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2p9cp\" (UniqueName: \"kubernetes.io/projected/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-kube-api-access-2p9cp\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.381671 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.381364 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.381671 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:12:46.381383 2576 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 02 01:12:46.381671 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.381422 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.381671 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:12:46.381451 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-secret-alertmanager-main-tls podName:4cdc0ac8-5fdf-4523-adb2-a473f1efedd1 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:46.881429945 +0000 UTC m=+111.051972127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "4cdc0ac8-5fdf-4523-adb2-a473f1efedd1") : secret "alertmanager-main-tls" not found Jun 02 01:12:46.381671 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.381503 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.381671 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.381527 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.381671 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.381576 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.382028 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.381736 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.382359 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.382329 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.382557 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:12:46.382508 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-alertmanager-trusted-ca-bundle podName:4cdc0ac8-5fdf-4523-adb2-a473f1efedd1 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:46.882489751 +0000 UTC m=+111.053031932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "4cdc0ac8-5fdf-4523-adb2-a473f1efedd1") : configmap references non-existent config key: ca-bundle.crt Jun 02 01:12:46.384492 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.384460 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.384604 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.384460 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.384873 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.384854 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-config-out\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.384937 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.384906 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-web-config\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.384973 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.384958 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.385015 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.384964 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-config-volume\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.385160 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.385140 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.385200 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.385140 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.392253 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.392234 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p9cp\" (UniqueName: \"kubernetes.io/projected/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-kube-api-access-2p9cp\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.783638 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.783595 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cd547c8d6-wwrl2" event={"ID":"8a3da997-2320-46b3-8356-6430f1e28e6a","Type":"ContainerStarted","Data":"5d92adcda6db48ded6193bf4c53204024308fd93b357080b6d7c048fce3952f3"} Jun 02 01:12:46.784849 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.784809 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qkfx5" event={"ID":"8ffd1ed4-f142-48a7-9362-86673790ae37","Type":"ContainerStarted","Data":"35fbc0864981d80331eaa4d02d9d8615b5530ec0387e6c23dddee1e146a3e9ed"} Jun 02 01:12:46.800313 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.800253 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7cd547c8d6-wwrl2" podStartSLOduration=1.279167929 podStartE2EDuration="3.800236812s" podCreationTimestamp="2026-06-02 01:12:43 +0000 UTC" firstStartedPulling="2026-06-02 01:12:43.509731333 +0000 UTC m=+107.680273497" lastFinishedPulling="2026-06-02 01:12:46.03080021 +0000 UTC m=+110.201342380" observedRunningTime="2026-06-02 01:12:46.799533411 +0000 UTC m=+110.970075598" watchObservedRunningTime="2026-06-02 01:12:46.800236812 +0000 UTC m=+110.970778998" Jun 02 01:12:46.886332 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.886290 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.886530 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.886487 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.887538 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.887505 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:46.889853 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:46.889823 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4cdc0ac8-5fdf-4523-adb2-a473f1efedd1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:47.118270 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:47.118234 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:12:47.254704 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:47.254653 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 01:12:47.257460 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:12:47.257425 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cdc0ac8_5fdf_4523_adb2_a473f1efedd1.slice/crio-0d402ce0ebabd405083beff73fb595e381d3dcb2c621fb900277a16cd1bc4d6e WatchSource:0}: Error finding container 0d402ce0ebabd405083beff73fb595e381d3dcb2c621fb900277a16cd1bc4d6e: Status 404 returned error can't find the container with id 0d402ce0ebabd405083beff73fb595e381d3dcb2c621fb900277a16cd1bc4d6e Jun 02 01:12:47.757001 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:47.756969 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z6c7d" Jun 02 01:12:47.789065 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:47.789027 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1","Type":"ContainerStarted","Data":"0d402ce0ebabd405083beff73fb595e381d3dcb2c621fb900277a16cd1bc4d6e"} Jun 02 01:12:47.790748 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:47.790716 2576 generic.go:358] "Generic (PLEG): container finished" podID="8ffd1ed4-f142-48a7-9362-86673790ae37" containerID="ec37a1d03873fbe1c4fa0853d2b8a0e70a191e179c47812091e554052b6248e3" exitCode=0 Jun 02 01:12:47.790875 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:47.790806 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qkfx5" event={"ID":"8ffd1ed4-f142-48a7-9362-86673790ae37","Type":"ContainerDied","Data":"ec37a1d03873fbe1c4fa0853d2b8a0e70a191e179c47812091e554052b6248e3"} Jun 02 01:12:48.794675 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:48.794635 2576 generic.go:358] "Generic (PLEG): container finished" podID="4cdc0ac8-5fdf-4523-adb2-a473f1efedd1" containerID="2f414f02ff8d945af70b4f147b006c361b60fb49b0e82538028178bc65bd6c57" exitCode=0 Jun 02 01:12:48.795163 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:48.794725 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1","Type":"ContainerDied","Data":"2f414f02ff8d945af70b4f147b006c361b60fb49b0e82538028178bc65bd6c57"} Jun 02 01:12:48.796690 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:48.796670 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qkfx5" event={"ID":"8ffd1ed4-f142-48a7-9362-86673790ae37","Type":"ContainerStarted","Data":"a7716a818808279235d04213ce4dbac487fd2079f0e41f56c90e04e9368505d7"} Jun 02 01:12:48.796749 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:48.796696 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qkfx5" event={"ID":"8ffd1ed4-f142-48a7-9362-86673790ae37","Type":"ContainerStarted","Data":"4de4b3b951040a5986cc101dbfa85c183eeadd869cbb772c1ef468ec1d74813f"} Jun 02 01:12:48.834843 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:48.834791 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qkfx5" podStartSLOduration=2.868692747 podStartE2EDuration="3.834778193s" podCreationTimestamp="2026-06-02 01:12:45 +0000 UTC" firstStartedPulling="2026-06-02 01:12:45.988928144 +0000 UTC m=+110.159470308" lastFinishedPulling="2026-06-02 01:12:46.955013588 +0000 UTC m=+111.125555754" observedRunningTime="2026-06-02 01:12:48.834102443 +0000 UTC m=+113.004644639" watchObservedRunningTime="2026-06-02 01:12:48.834778193 +0000 UTC m=+113.005320380" Jun 02 01:12:49.927281 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:49.925133 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-q2ccq"] Jun 02 01:12:49.929576 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:49.929548 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-q2ccq" Jun 02 01:12:49.932212 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:49.932187 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 02 01:12:49.932330 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:49.932214 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-ffxrn\"" Jun 02 01:12:49.937356 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:49.937327 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-q2ccq"] Jun 02 01:12:50.015648 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:50.015616 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3e5324fd-cac0-4080-b8b0-57c22ef157d3-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-q2ccq\" (UID: \"3e5324fd-cac0-4080-b8b0-57c22ef157d3\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-q2ccq" Jun 02 01:12:50.116023 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:50.115984 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3e5324fd-cac0-4080-b8b0-57c22ef157d3-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-q2ccq\" (UID: \"3e5324fd-cac0-4080-b8b0-57c22ef157d3\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-q2ccq" Jun 02 01:12:50.116216 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:12:50.116085 2576 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 02 01:12:50.116216 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:12:50.116140 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e5324fd-cac0-4080-b8b0-57c22ef157d3-monitoring-plugin-cert podName:3e5324fd-cac0-4080-b8b0-57c22ef157d3 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:50.616125586 +0000 UTC m=+114.786667750 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/3e5324fd-cac0-4080-b8b0-57c22ef157d3-monitoring-plugin-cert") pod "monitoring-plugin-5768fcc9dd-q2ccq" (UID: "3e5324fd-cac0-4080-b8b0-57c22ef157d3") : secret "monitoring-plugin-cert" not found Jun 02 01:12:50.620169 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:50.620144 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3e5324fd-cac0-4080-b8b0-57c22ef157d3-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-q2ccq\" (UID: \"3e5324fd-cac0-4080-b8b0-57c22ef157d3\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-q2ccq" Jun 02 01:12:50.620267 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:12:50.620256 2576 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 02 01:12:50.620315 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:12:50.620305 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e5324fd-cac0-4080-b8b0-57c22ef157d3-monitoring-plugin-cert podName:3e5324fd-cac0-4080-b8b0-57c22ef157d3 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:51.620291306 +0000 UTC m=+115.790833469 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/3e5324fd-cac0-4080-b8b0-57c22ef157d3-monitoring-plugin-cert") pod "monitoring-plugin-5768fcc9dd-q2ccq" (UID: "3e5324fd-cac0-4080-b8b0-57c22ef157d3") : secret "monitoring-plugin-cert" not found Jun 02 01:12:50.804358 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:50.804323 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1","Type":"ContainerStarted","Data":"aea16f50d1c1057d627a6e160cf5fb616560e983e2edfe005e8e2f11561d771c"} Jun 02 01:12:50.804513 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:50.804389 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1","Type":"ContainerStarted","Data":"b4715e397b607fbbf0e4f5a58a4841067f3269a3194fae9a6b0de93b6dc6f6cb"} Jun 02 01:12:50.804513 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:50.804402 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1","Type":"ContainerStarted","Data":"5b7a96bd5099d74215fa25728fe43f66eba62f68f1c498bf4de5328763323689"} Jun 02 01:12:50.804513 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:50.804410 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1","Type":"ContainerStarted","Data":"2209c5b152768ba8bee71c83c29be9fc3166d2147b0de9d319aed00e613f442b"} Jun 02 01:12:50.804513 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:50.804418 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1","Type":"ContainerStarted","Data":"cbc9053a2766540c7c0090a15e3d96b21e5b96ccb9e3db3c549731436854dcf1"} Jun 02 01:12:51.629420 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:51.629299 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3e5324fd-cac0-4080-b8b0-57c22ef157d3-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-q2ccq\" (UID: \"3e5324fd-cac0-4080-b8b0-57c22ef157d3\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-q2ccq" Jun 02 01:12:51.631849 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:51.631822 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3e5324fd-cac0-4080-b8b0-57c22ef157d3-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-q2ccq\" (UID: \"3e5324fd-cac0-4080-b8b0-57c22ef157d3\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-q2ccq" Jun 02 01:12:51.741009 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:51.740957 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-q2ccq" Jun 02 01:12:51.810181 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:51.810131 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4cdc0ac8-5fdf-4523-adb2-a473f1efedd1","Type":"ContainerStarted","Data":"aab49f0235e1324c95be426b64f8a0cf06d2f6dec1dcc7c570af0fc9991bf229"} Jun 02 01:12:51.839985 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:51.839925 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.7605301249999998 podStartE2EDuration="5.839904875s" podCreationTimestamp="2026-06-02 01:12:46 +0000 UTC" firstStartedPulling="2026-06-02 01:12:47.259288954 +0000 UTC m=+111.429831118" lastFinishedPulling="2026-06-02 01:12:51.338663696 +0000 UTC m=+115.509205868" observedRunningTime="2026-06-02 01:12:51.838613344 +0000 UTC m=+116.009155530" watchObservedRunningTime="2026-06-02 01:12:51.839904875 +0000 UTC m=+116.010447062" Jun 02 01:12:51.881315 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:51.881235 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-q2ccq"] Jun 02 01:12:51.884284 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:12:51.884256 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e5324fd_cac0_4080_b8b0_57c22ef157d3.slice/crio-672f0866cfda8253518a7e3b54c40fae93431bbe478a92d90bd583d182dec4f0 WatchSource:0}: Error finding container 672f0866cfda8253518a7e3b54c40fae93431bbe478a92d90bd583d182dec4f0: Status 404 returned error can't find the container with id 672f0866cfda8253518a7e3b54c40fae93431bbe478a92d90bd583d182dec4f0 Jun 02 01:12:52.815245 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:52.815207 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-q2ccq" event={"ID":"3e5324fd-cac0-4080-b8b0-57c22ef157d3","Type":"ContainerStarted","Data":"672f0866cfda8253518a7e3b54c40fae93431bbe478a92d90bd583d182dec4f0"} Jun 02 01:12:53.378645 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:53.378613 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7cd547c8d6-wwrl2" Jun 02 01:12:53.378786 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:53.378696 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cd547c8d6-wwrl2" Jun 02 01:12:53.383871 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:53.383849 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7cd547c8d6-wwrl2" Jun 02 01:12:53.819592 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:53.819548 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-q2ccq" event={"ID":"3e5324fd-cac0-4080-b8b0-57c22ef157d3","Type":"ContainerStarted","Data":"fd748d1399c9e124bdcf055359fa369de2659ad83e503103757fa9e799c74a89"} Jun 02 01:12:53.823579 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:53.823553 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7cd547c8d6-wwrl2" Jun 02 01:12:53.837580 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:53.837535 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-q2ccq" podStartSLOduration=3.585270062 podStartE2EDuration="4.837518349s" podCreationTimestamp="2026-06-02 01:12:49 +0000 UTC" firstStartedPulling="2026-06-02 01:12:51.886399261 +0000 UTC m=+116.056941428" lastFinishedPulling="2026-06-02 01:12:53.138647546 +0000 UTC m=+117.309189715" observedRunningTime="2026-06-02 01:12:53.836465585 +0000 UTC m=+118.007007772" watchObservedRunningTime="2026-06-02 01:12:53.837518349 +0000 UTC m=+118.008060535" Jun 02 01:12:54.822427 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:54.822365 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-q2ccq" Jun 02 01:12:54.827040 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:12:54.827014 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-q2ccq" Jun 02 01:13:06.154635 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:06.154595 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0c654e7-08a1-4ca8-81c4-5164c7c30e26-metrics-certs\") pod \"network-metrics-daemon-gntp5\" (UID: \"b0c654e7-08a1-4ca8-81c4-5164c7c30e26\") " pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:13:06.156930 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:06.156906 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0c654e7-08a1-4ca8-81c4-5164c7c30e26-metrics-certs\") pod \"network-metrics-daemon-gntp5\" (UID: \"b0c654e7-08a1-4ca8-81c4-5164c7c30e26\") " pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:13:06.421915 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:06.421837 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r5956\"" Jun 02 01:13:06.429976 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:06.429958 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gntp5" Jun 02 01:13:06.553359 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:06.553324 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gntp5"] Jun 02 01:13:06.556300 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:13:06.556270 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0c654e7_08a1_4ca8_81c4_5164c7c30e26.slice/crio-f515a2c15ff93ca4886194b7512ba8d573b3ccb2be829c269b838990348b0b18 WatchSource:0}: Error finding container f515a2c15ff93ca4886194b7512ba8d573b3ccb2be829c269b838990348b0b18: Status 404 returned error can't find the container with id f515a2c15ff93ca4886194b7512ba8d573b3ccb2be829c269b838990348b0b18 Jun 02 01:13:06.858215 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:06.858120 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gntp5" event={"ID":"b0c654e7-08a1-4ca8-81c4-5164c7c30e26","Type":"ContainerStarted","Data":"f515a2c15ff93ca4886194b7512ba8d573b3ccb2be829c269b838990348b0b18"} Jun 02 01:13:07.255299 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:07.255260 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cd547c8d6-wwrl2"] Jun 02 01:13:08.865457 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:08.865417 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gntp5" event={"ID":"b0c654e7-08a1-4ca8-81c4-5164c7c30e26","Type":"ContainerStarted","Data":"b802f0e3bcc3db9baa41b7717e75706b6689d1cd8b44f00879e69c68b6cf862c"} Jun 02 01:13:08.865457 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:08.865455 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gntp5" event={"ID":"b0c654e7-08a1-4ca8-81c4-5164c7c30e26","Type":"ContainerStarted","Data":"7270144523f60ec5ba07eac1581f996d57c3857e76a4af63192ffbcd1f41f58b"} Jun 02 01:13:08.884244 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:08.884192 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gntp5" podStartSLOduration=131.57640545 podStartE2EDuration="2m12.884178178s" podCreationTimestamp="2026-06-02 01:10:56 +0000 UTC" firstStartedPulling="2026-06-02 01:13:06.558190082 +0000 UTC m=+130.728732247" lastFinishedPulling="2026-06-02 01:13:07.865962801 +0000 UTC m=+132.036504975" observedRunningTime="2026-06-02 01:13:08.883592138 +0000 UTC m=+133.054134323" watchObservedRunningTime="2026-06-02 01:13:08.884178178 +0000 UTC m=+133.054720364" Jun 02 01:13:18.524225 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:18.524179 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" podUID="22ce3f8b-a213-430b-a910-d10e62010e53" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 01:13:25.404084 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:25.404051 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z6c7d_b33e89ef-ae01-478f-b2ca-383234e07be1/dns/0.log" Jun 02 01:13:25.409459 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:25.409436 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z6c7d_b33e89ef-ae01-478f-b2ca-383234e07be1/kube-rbac-proxy/0.log" Jun 02 01:13:25.875876 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:25.875796 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-smvzg_ff5cd010-d35b-4b58-8008-5c3a1f22deec/dns-node-resolver/0.log" Jun 02 01:13:28.523918 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:28.523876 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" podUID="22ce3f8b-a213-430b-a910-d10e62010e53" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 01:13:32.278985 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.278920 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7cd547c8d6-wwrl2" podUID="8a3da997-2320-46b3-8356-6430f1e28e6a" containerName="console" containerID="cri-o://5d92adcda6db48ded6193bf4c53204024308fd93b357080b6d7c048fce3952f3" gracePeriod=15 Jun 02 01:13:32.523065 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.523041 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7cd547c8d6-wwrl2_8a3da997-2320-46b3-8356-6430f1e28e6a/console/0.log" Jun 02 01:13:32.523186 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.523121 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cd547c8d6-wwrl2" Jun 02 01:13:32.634816 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.634714 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a3da997-2320-46b3-8356-6430f1e28e6a-console-serving-cert\") pod \"8a3da997-2320-46b3-8356-6430f1e28e6a\" (UID: \"8a3da997-2320-46b3-8356-6430f1e28e6a\") " Jun 02 01:13:32.634816 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.634769 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a3da997-2320-46b3-8356-6430f1e28e6a-trusted-ca-bundle\") pod \"8a3da997-2320-46b3-8356-6430f1e28e6a\" (UID: \"8a3da997-2320-46b3-8356-6430f1e28e6a\") " Jun 02 01:13:32.634816 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.634806 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a3da997-2320-46b3-8356-6430f1e28e6a-console-oauth-config\") pod \"8a3da997-2320-46b3-8356-6430f1e28e6a\" (UID: \"8a3da997-2320-46b3-8356-6430f1e28e6a\") " Jun 02 01:13:32.635095 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.634850 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a3da997-2320-46b3-8356-6430f1e28e6a-console-config\") pod \"8a3da997-2320-46b3-8356-6430f1e28e6a\" (UID: \"8a3da997-2320-46b3-8356-6430f1e28e6a\") " Jun 02 01:13:32.635095 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.634875 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a3da997-2320-46b3-8356-6430f1e28e6a-oauth-serving-cert\") pod \"8a3da997-2320-46b3-8356-6430f1e28e6a\" (UID: \"8a3da997-2320-46b3-8356-6430f1e28e6a\") " Jun 02 01:13:32.635095 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.634904 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phzt5\" (UniqueName: \"kubernetes.io/projected/8a3da997-2320-46b3-8356-6430f1e28e6a-kube-api-access-phzt5\") pod \"8a3da997-2320-46b3-8356-6430f1e28e6a\" (UID: \"8a3da997-2320-46b3-8356-6430f1e28e6a\") " Jun 02 01:13:32.635095 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.634928 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a3da997-2320-46b3-8356-6430f1e28e6a-service-ca\") pod \"8a3da997-2320-46b3-8356-6430f1e28e6a\" (UID: \"8a3da997-2320-46b3-8356-6430f1e28e6a\") " Jun 02 01:13:32.635329 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.635298 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a3da997-2320-46b3-8356-6430f1e28e6a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8a3da997-2320-46b3-8356-6430f1e28e6a" (UID: "8a3da997-2320-46b3-8356-6430f1e28e6a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:13:32.635421 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.635325 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a3da997-2320-46b3-8356-6430f1e28e6a-console-config" (OuterVolumeSpecName: "console-config") pod "8a3da997-2320-46b3-8356-6430f1e28e6a" (UID: "8a3da997-2320-46b3-8356-6430f1e28e6a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:13:32.635421 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.635356 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a3da997-2320-46b3-8356-6430f1e28e6a-service-ca" (OuterVolumeSpecName: "service-ca") pod "8a3da997-2320-46b3-8356-6430f1e28e6a" (UID: "8a3da997-2320-46b3-8356-6430f1e28e6a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:13:32.635590 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.635563 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a3da997-2320-46b3-8356-6430f1e28e6a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8a3da997-2320-46b3-8356-6430f1e28e6a" (UID: "8a3da997-2320-46b3-8356-6430f1e28e6a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:13:32.637078 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.637050 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a3da997-2320-46b3-8356-6430f1e28e6a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8a3da997-2320-46b3-8356-6430f1e28e6a" (UID: "8a3da997-2320-46b3-8356-6430f1e28e6a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:13:32.637334 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.637315 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a3da997-2320-46b3-8356-6430f1e28e6a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8a3da997-2320-46b3-8356-6430f1e28e6a" (UID: "8a3da997-2320-46b3-8356-6430f1e28e6a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:13:32.637410 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.637328 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a3da997-2320-46b3-8356-6430f1e28e6a-kube-api-access-phzt5" (OuterVolumeSpecName: "kube-api-access-phzt5") pod "8a3da997-2320-46b3-8356-6430f1e28e6a" (UID: "8a3da997-2320-46b3-8356-6430f1e28e6a"). InnerVolumeSpecName "kube-api-access-phzt5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:13:32.736025 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.735986 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phzt5\" (UniqueName: \"kubernetes.io/projected/8a3da997-2320-46b3-8356-6430f1e28e6a-kube-api-access-phzt5\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\"" Jun 02 01:13:32.736025 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.736019 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a3da997-2320-46b3-8356-6430f1e28e6a-service-ca\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\"" Jun 02 01:13:32.736025 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.736029 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a3da997-2320-46b3-8356-6430f1e28e6a-console-serving-cert\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\"" Jun 02 01:13:32.736253 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.736039 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a3da997-2320-46b3-8356-6430f1e28e6a-trusted-ca-bundle\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\"" Jun 02 01:13:32.736253 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.736050 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a3da997-2320-46b3-8356-6430f1e28e6a-console-oauth-config\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\"" Jun 02 01:13:32.736253 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.736058 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a3da997-2320-46b3-8356-6430f1e28e6a-console-config\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\"" Jun 02 01:13:32.736253 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.736067 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a3da997-2320-46b3-8356-6430f1e28e6a-oauth-serving-cert\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\"" Jun 02 01:13:32.929924 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.929894 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7cd547c8d6-wwrl2_8a3da997-2320-46b3-8356-6430f1e28e6a/console/0.log" Jun 02 01:13:32.930102 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.929933 2576 generic.go:358] "Generic (PLEG): container finished" podID="8a3da997-2320-46b3-8356-6430f1e28e6a" containerID="5d92adcda6db48ded6193bf4c53204024308fd93b357080b6d7c048fce3952f3" exitCode=2 Jun 02 01:13:32.930102 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.929997 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cd547c8d6-wwrl2" Jun 02 01:13:32.930102 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.930021 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cd547c8d6-wwrl2" event={"ID":"8a3da997-2320-46b3-8356-6430f1e28e6a","Type":"ContainerDied","Data":"5d92adcda6db48ded6193bf4c53204024308fd93b357080b6d7c048fce3952f3"} Jun 02 01:13:32.930102 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.930061 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cd547c8d6-wwrl2" event={"ID":"8a3da997-2320-46b3-8356-6430f1e28e6a","Type":"ContainerDied","Data":"ba2869133db3ff3d086bfe0ff593a05089c06eba0be276290df7b79a9fdcd133"} Jun 02 01:13:32.930102 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.930087 2576 scope.go:117] "RemoveContainer" containerID="5d92adcda6db48ded6193bf4c53204024308fd93b357080b6d7c048fce3952f3" Jun 02 01:13:32.938052 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.938032 2576 scope.go:117] "RemoveContainer" containerID="5d92adcda6db48ded6193bf4c53204024308fd93b357080b6d7c048fce3952f3" Jun 02 01:13:32.938362 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:13:32.938340 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d92adcda6db48ded6193bf4c53204024308fd93b357080b6d7c048fce3952f3\": container with ID starting with 5d92adcda6db48ded6193bf4c53204024308fd93b357080b6d7c048fce3952f3 not found: ID does not exist" containerID="5d92adcda6db48ded6193bf4c53204024308fd93b357080b6d7c048fce3952f3" Jun 02 01:13:32.938431 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.938383 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d92adcda6db48ded6193bf4c53204024308fd93b357080b6d7c048fce3952f3"} err="failed to get container status \"5d92adcda6db48ded6193bf4c53204024308fd93b357080b6d7c048fce3952f3\": rpc error: code = NotFound desc = could not find container \"5d92adcda6db48ded6193bf4c53204024308fd93b357080b6d7c048fce3952f3\": container with ID starting with 5d92adcda6db48ded6193bf4c53204024308fd93b357080b6d7c048fce3952f3 not found: ID does not exist" Jun 02 01:13:32.950132 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.950106 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cd547c8d6-wwrl2"] Jun 02 01:13:32.957276 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:32.957243 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cd547c8d6-wwrl2"] Jun 02 01:13:34.406151 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:34.406114 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a3da997-2320-46b3-8356-6430f1e28e6a" path="/var/lib/kubelet/pods/8a3da997-2320-46b3-8356-6430f1e28e6a/volumes" Jun 02 01:13:38.524545 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:38.524504 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" podUID="22ce3f8b-a213-430b-a910-d10e62010e53" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 01:13:38.525028 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:38.524583 2576 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" Jun 02 01:13:38.525075 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:38.525059 2576 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"33a1506eb21de87a3f3d84ad98c556eac3c762865fc7572d41f80153446ad77d"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 02 01:13:38.525125 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:38.525094 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" podUID="22ce3f8b-a213-430b-a910-d10e62010e53" containerName="service-proxy" containerID="cri-o://33a1506eb21de87a3f3d84ad98c556eac3c762865fc7572d41f80153446ad77d" gracePeriod=30 Jun 02 01:13:38.952514 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:38.952477 2576 generic.go:358] "Generic (PLEG): container finished" podID="22ce3f8b-a213-430b-a910-d10e62010e53" containerID="33a1506eb21de87a3f3d84ad98c556eac3c762865fc7572d41f80153446ad77d" exitCode=2 Jun 02 01:13:38.952692 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:38.952551 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" event={"ID":"22ce3f8b-a213-430b-a910-d10e62010e53","Type":"ContainerDied","Data":"33a1506eb21de87a3f3d84ad98c556eac3c762865fc7572d41f80153446ad77d"} Jun 02 01:13:38.952692 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:13:38.952597 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c8dc78b6b-hmc26" event={"ID":"22ce3f8b-a213-430b-a910-d10e62010e53","Type":"ContainerStarted","Data":"0998e5a5c9dfe3cc16b2b6c4da56ad686ca8667533159cdeb428d76eb5705005"} Jun 02 01:14:01.244943 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.244908 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-8697886764-5xvbv"] Jun 02 01:14:01.245362 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.245166 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a3da997-2320-46b3-8356-6430f1e28e6a" containerName="console" Jun 02 01:14:01.245362 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.245179 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a3da997-2320-46b3-8356-6430f1e28e6a" containerName="console" Jun 02 01:14:01.245362 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.245230 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="8a3da997-2320-46b3-8356-6430f1e28e6a" containerName="console" Jun 02 01:14:01.247356 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.247339 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8697886764-5xvbv" Jun 02 01:14:01.250159 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.250133 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 01:14:01.250285 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.250133 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 01:14:01.251058 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.251037 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-45c4f\"" Jun 02 01:14:01.251117 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.251037 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 01:14:01.251117 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.251089 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 01:14:01.251335 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.251320 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 01:14:01.251417 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.251333 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 01:14:01.251483 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.251420 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 01:14:01.256479 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.256456 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 01:14:01.257849 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.257828 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8697886764-5xvbv"] Jun 02 01:14:01.353221 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.353176 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc26m\" (UniqueName: \"kubernetes.io/projected/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-kube-api-access-tc26m\") pod \"console-8697886764-5xvbv\" (UID: \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\") " pod="openshift-console/console-8697886764-5xvbv" Jun 02 01:14:01.353221 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.353226 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-trusted-ca-bundle\") pod \"console-8697886764-5xvbv\" (UID: \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\") " pod="openshift-console/console-8697886764-5xvbv" Jun 02 01:14:01.353467 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.353259 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-console-config\") pod \"console-8697886764-5xvbv\" (UID: \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\") " pod="openshift-console/console-8697886764-5xvbv" Jun 02 01:14:01.353467 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.353301 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-console-oauth-config\") pod \"console-8697886764-5xvbv\" (UID: \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\") " pod="openshift-console/console-8697886764-5xvbv" Jun 02 01:14:01.353467 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.353322 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-service-ca\") pod \"console-8697886764-5xvbv\" (UID: \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\") " pod="openshift-console/console-8697886764-5xvbv" Jun 02 01:14:01.353467 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.353342 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-console-serving-cert\") pod \"console-8697886764-5xvbv\" (UID: \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\") " pod="openshift-console/console-8697886764-5xvbv" Jun 02 01:14:01.353467 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.353399 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-oauth-serving-cert\") pod \"console-8697886764-5xvbv\" (UID: \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\") " pod="openshift-console/console-8697886764-5xvbv" Jun 02 01:14:01.454683 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.454626 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-service-ca\") pod \"console-8697886764-5xvbv\" (UID: \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\") " pod="openshift-console/console-8697886764-5xvbv" Jun 02 01:14:01.454683 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.454688 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-console-serving-cert\") pod \"console-8697886764-5xvbv\" (UID: \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\") " pod="openshift-console/console-8697886764-5xvbv" Jun 02 01:14:01.454882 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.454729 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-oauth-serving-cert\") pod \"console-8697886764-5xvbv\" (UID: \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\") " pod="openshift-console/console-8697886764-5xvbv" Jun 02 01:14:01.454882 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.454752 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tc26m\" (UniqueName: \"kubernetes.io/projected/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-kube-api-access-tc26m\") pod \"console-8697886764-5xvbv\" (UID: \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\") " pod="openshift-console/console-8697886764-5xvbv" Jun 02 01:14:01.454882 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.454784 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-trusted-ca-bundle\") pod \"console-8697886764-5xvbv\" (UID: \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\") " pod="openshift-console/console-8697886764-5xvbv" Jun 02 01:14:01.454882 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.454819 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-console-config\") pod \"console-8697886764-5xvbv\" (UID: \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\") " pod="openshift-console/console-8697886764-5xvbv" Jun 02 01:14:01.454882 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.454861 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-console-oauth-config\") pod \"console-8697886764-5xvbv\" (UID: \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\") " pod="openshift-console/console-8697886764-5xvbv" Jun 02 01:14:01.455645 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.455612 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-oauth-serving-cert\") pod \"console-8697886764-5xvbv\" (UID: \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\") " pod="openshift-console/console-8697886764-5xvbv" Jun 02 01:14:01.455746 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.455624 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-console-config\") pod \"console-8697886764-5xvbv\" (UID: \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\") " pod="openshift-console/console-8697886764-5xvbv" Jun 02 01:14:01.455746 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.455624 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-service-ca\") pod \"console-8697886764-5xvbv\" (UID: \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\") " pod="openshift-console/console-8697886764-5xvbv" Jun 02 01:14:01.456031 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.456013 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-trusted-ca-bundle\") pod \"console-8697886764-5xvbv\" (UID: \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\") " pod="openshift-console/console-8697886764-5xvbv" Jun 02 01:14:01.457342 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.457320 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-console-oauth-config\") pod \"console-8697886764-5xvbv\" (UID: \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\") " pod="openshift-console/console-8697886764-5xvbv" Jun 02 01:14:01.457342 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.457335 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-console-serving-cert\") pod \"console-8697886764-5xvbv\" (UID: \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\") " pod="openshift-console/console-8697886764-5xvbv" Jun 02 01:14:01.463402 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.463352 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc26m\" (UniqueName: \"kubernetes.io/projected/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-kube-api-access-tc26m\") pod \"console-8697886764-5xvbv\" (UID: \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\") " pod="openshift-console/console-8697886764-5xvbv" Jun 02 01:14:01.558109 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.558010 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8697886764-5xvbv" Jun 02 01:14:01.689734 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:01.689637 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8697886764-5xvbv"] Jun 02 01:14:01.692210 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:14:01.692179 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19c50191_fc35_413d_a3d1_bd7ce1a0ef69.slice/crio-377a00e33b0b576ad9f238a8421c6998c2fa96589571f970560ece9e6a904370 WatchSource:0}: Error finding container 377a00e33b0b576ad9f238a8421c6998c2fa96589571f970560ece9e6a904370: Status 404 returned error can't find the container with id 377a00e33b0b576ad9f238a8421c6998c2fa96589571f970560ece9e6a904370 Jun 02 01:14:02.019708 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:02.019674 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8697886764-5xvbv" event={"ID":"19c50191-fc35-413d-a3d1-bd7ce1a0ef69","Type":"ContainerStarted","Data":"237f0803b35ad6631de58b6b7c2555b76da842f99883d55397f82f54dbe3f5fc"} Jun 02 01:14:02.019708 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:02.019710 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8697886764-5xvbv" event={"ID":"19c50191-fc35-413d-a3d1-bd7ce1a0ef69","Type":"ContainerStarted","Data":"377a00e33b0b576ad9f238a8421c6998c2fa96589571f970560ece9e6a904370"} Jun 02 01:14:11.558887 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:11.558838 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8697886764-5xvbv" Jun 02 01:14:11.559359 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:11.558914 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8697886764-5xvbv" Jun 02 01:14:11.563831 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:11.563808 2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8697886764-5xvbv" Jun 02 01:14:11.582858 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:11.582809 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-8697886764-5xvbv" podStartSLOduration=10.582795567 podStartE2EDuration="10.582795567s" podCreationTimestamp="2026-06-02 01:14:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:14:02.038332748 +0000 UTC m=+186.208874935" watchObservedRunningTime="2026-06-02 01:14:11.582795567 +0000 UTC m=+195.753337752" Jun 02 01:14:12.048170 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:12.048138 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8697886764-5xvbv" Jun 02 01:14:45.746953 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:45.746916 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-9vgbz"] Jun 02 01:14:45.748904 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:45.748888 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vgbz" Jun 02 01:14:45.751506 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:45.751490 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 01:14:45.756033 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:45.756012 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9vgbz"] Jun 02 01:14:45.782313 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:45.782279 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c1c5551b-2582-4854-a096-4f09a7acaf9b-kubelet-config\") pod \"global-pull-secret-syncer-9vgbz\" (UID: \"c1c5551b-2582-4854-a096-4f09a7acaf9b\") " pod="kube-system/global-pull-secret-syncer-9vgbz" Jun 02 01:14:45.782483 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:45.782326 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c1c5551b-2582-4854-a096-4f09a7acaf9b-dbus\") pod \"global-pull-secret-syncer-9vgbz\" (UID: \"c1c5551b-2582-4854-a096-4f09a7acaf9b\") " pod="kube-system/global-pull-secret-syncer-9vgbz" Jun 02 01:14:45.782483 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:45.782432 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1c5551b-2582-4854-a096-4f09a7acaf9b-original-pull-secret\") pod \"global-pull-secret-syncer-9vgbz\" (UID: \"c1c5551b-2582-4854-a096-4f09a7acaf9b\") " pod="kube-system/global-pull-secret-syncer-9vgbz" Jun 02 01:14:45.883358 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:45.883316 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c1c5551b-2582-4854-a096-4f09a7acaf9b-dbus\") pod \"global-pull-secret-syncer-9vgbz\" (UID: \"c1c5551b-2582-4854-a096-4f09a7acaf9b\") " pod="kube-system/global-pull-secret-syncer-9vgbz" Jun 02 01:14:45.883542 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:45.883417 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1c5551b-2582-4854-a096-4f09a7acaf9b-original-pull-secret\") pod \"global-pull-secret-syncer-9vgbz\" (UID: \"c1c5551b-2582-4854-a096-4f09a7acaf9b\") " pod="kube-system/global-pull-secret-syncer-9vgbz" Jun 02 01:14:45.883542 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:45.883445 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c1c5551b-2582-4854-a096-4f09a7acaf9b-kubelet-config\") pod \"global-pull-secret-syncer-9vgbz\" (UID: \"c1c5551b-2582-4854-a096-4f09a7acaf9b\") " pod="kube-system/global-pull-secret-syncer-9vgbz" Jun 02 01:14:45.883542 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:45.883530 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c1c5551b-2582-4854-a096-4f09a7acaf9b-dbus\") pod \"global-pull-secret-syncer-9vgbz\" (UID: \"c1c5551b-2582-4854-a096-4f09a7acaf9b\") " pod="kube-system/global-pull-secret-syncer-9vgbz" Jun 02 01:14:45.883669 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:45.883533 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c1c5551b-2582-4854-a096-4f09a7acaf9b-kubelet-config\") pod \"global-pull-secret-syncer-9vgbz\" (UID: \"c1c5551b-2582-4854-a096-4f09a7acaf9b\") " pod="kube-system/global-pull-secret-syncer-9vgbz" Jun 02 01:14:45.885789 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:45.885764 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1c5551b-2582-4854-a096-4f09a7acaf9b-original-pull-secret\") pod \"global-pull-secret-syncer-9vgbz\" (UID: \"c1c5551b-2582-4854-a096-4f09a7acaf9b\") " pod="kube-system/global-pull-secret-syncer-9vgbz" Jun 02 01:14:46.058818 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:46.058714 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9vgbz" Jun 02 01:14:46.183689 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:46.183652 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9vgbz"] Jun 02 01:14:46.186561 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:14:46.186533 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1c5551b_2582_4854_a096_4f09a7acaf9b.slice/crio-a50f88cdc0560ce73a7e3b648b9d1bd35a60e54905ed7443df8e46e0f657c6c7 WatchSource:0}: Error finding container a50f88cdc0560ce73a7e3b648b9d1bd35a60e54905ed7443df8e46e0f657c6c7: Status 404 returned error can't find the container with id a50f88cdc0560ce73a7e3b648b9d1bd35a60e54905ed7443df8e46e0f657c6c7 Jun 02 01:14:47.143662 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:47.143616 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9vgbz" event={"ID":"c1c5551b-2582-4854-a096-4f09a7acaf9b","Type":"ContainerStarted","Data":"a50f88cdc0560ce73a7e3b648b9d1bd35a60e54905ed7443df8e46e0f657c6c7"} Jun 02 01:14:51.156305 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:51.156262 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9vgbz" event={"ID":"c1c5551b-2582-4854-a096-4f09a7acaf9b","Type":"ContainerStarted","Data":"3a0b92357063cbe67c05c486b4e0ee6a79ea28038a460e20cbebbbfd226e5d19"} Jun 02 01:14:51.172978 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:14:51.172922 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9vgbz" podStartSLOduration=1.755503284 podStartE2EDuration="6.172907309s" podCreationTimestamp="2026-06-02 01:14:45 +0000 UTC" firstStartedPulling="2026-06-02 01:14:46.188108726 +0000 UTC m=+230.358650889" lastFinishedPulling="2026-06-02 01:14:50.605512738 +0000 UTC m=+234.776054914" observedRunningTime="2026-06-02 01:14:51.171463236 +0000 UTC m=+235.342005445" watchObservedRunningTime="2026-06-02 01:14:51.172907309 +0000 UTC m=+235.343449494" Jun 02 01:15:54.716647 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:15:54.716608 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-lxpjm"] Jun 02 01:15:54.718617 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:15:54.718601 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-lxpjm" Jun 02 01:15:54.721267 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:15:54.721241 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:15:54.721407 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:15:54.721353 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 02 01:15:54.721504 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:15:54.721490 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-hs8pf\"" Jun 02 01:15:54.729704 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:15:54.729678 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-lxpjm"] Jun 02 01:15:54.909245 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:15:54.909208 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d96cc01b-68e1-4207-a7c6-9d5ec06269b7-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-lxpjm\" (UID: \"d96cc01b-68e1-4207-a7c6-9d5ec06269b7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-lxpjm" Jun 02 01:15:54.909453 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:15:54.909286 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbk6l\" (UniqueName: \"kubernetes.io/projected/d96cc01b-68e1-4207-a7c6-9d5ec06269b7-kube-api-access-xbk6l\") pod \"cert-manager-operator-controller-manager-54b9655956-lxpjm\" (UID: \"d96cc01b-68e1-4207-a7c6-9d5ec06269b7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-lxpjm" Jun 02 01:15:55.010659 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:15:55.010572 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d96cc01b-68e1-4207-a7c6-9d5ec06269b7-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-lxpjm\" (UID: \"d96cc01b-68e1-4207-a7c6-9d5ec06269b7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-lxpjm" Jun 02 01:15:55.010659 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:15:55.010653 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xbk6l\" (UniqueName: \"kubernetes.io/projected/d96cc01b-68e1-4207-a7c6-9d5ec06269b7-kube-api-access-xbk6l\") pod \"cert-manager-operator-controller-manager-54b9655956-lxpjm\" (UID: \"d96cc01b-68e1-4207-a7c6-9d5ec06269b7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-lxpjm" Jun 02 01:15:55.010965 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:15:55.010944 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d96cc01b-68e1-4207-a7c6-9d5ec06269b7-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-lxpjm\" (UID: \"d96cc01b-68e1-4207-a7c6-9d5ec06269b7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-lxpjm" Jun 02 01:15:55.018625 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:15:55.018590 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbk6l\" (UniqueName: \"kubernetes.io/projected/d96cc01b-68e1-4207-a7c6-9d5ec06269b7-kube-api-access-xbk6l\") pod \"cert-manager-operator-controller-manager-54b9655956-lxpjm\" (UID: \"d96cc01b-68e1-4207-a7c6-9d5ec06269b7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-lxpjm" Jun 02 01:15:55.027433 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:15:55.027414 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-lxpjm" Jun 02 01:15:55.162404 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:15:55.162352 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-lxpjm"] Jun 02 01:15:55.166280 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:15:55.166246 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd96cc01b_68e1_4207_a7c6_9d5ec06269b7.slice/crio-cb2e67f6f9475d9166cfa198920dbb430016ad213e153c4f26e1154408a82866 WatchSource:0}: Error finding container cb2e67f6f9475d9166cfa198920dbb430016ad213e153c4f26e1154408a82866: Status 404 returned error can't find the container with id cb2e67f6f9475d9166cfa198920dbb430016ad213e153c4f26e1154408a82866 Jun 02 01:15:55.329236 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:15:55.329146 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-lxpjm" event={"ID":"d96cc01b-68e1-4207-a7c6-9d5ec06269b7","Type":"ContainerStarted","Data":"cb2e67f6f9475d9166cfa198920dbb430016ad213e153c4f26e1154408a82866"} Jun 02 01:15:56.288119 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:15:56.288086 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lkf95_b6d9386e-1aeb-41d2-8b3d-0a088b8724cb/ovn-acl-logging/0.log" Jun 02 01:15:56.288119 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:15:56.288109 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lkf95_b6d9386e-1aeb-41d2-8b3d-0a088b8724cb/ovn-acl-logging/0.log" Jun 02 01:15:56.296245 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:15:56.296219 2576 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 01:15:57.337283 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:15:57.337190 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-lxpjm" event={"ID":"d96cc01b-68e1-4207-a7c6-9d5ec06269b7","Type":"ContainerStarted","Data":"149d849b2734890a036bbc84442e5b1d23135064bbff9143b772c1bac6d0b257"} Jun 02 01:15:57.357655 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:15:57.357607 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-lxpjm" podStartSLOduration=1.515988025 podStartE2EDuration="3.357593909s" podCreationTimestamp="2026-06-02 01:15:54 +0000 UTC" firstStartedPulling="2026-06-02 01:15:55.168602265 +0000 UTC m=+299.339144428" lastFinishedPulling="2026-06-02 01:15:57.010208139 +0000 UTC m=+301.180750312" observedRunningTime="2026-06-02 01:15:57.356490558 +0000 UTC m=+301.527032756" watchObservedRunningTime="2026-06-02 01:15:57.357593909 +0000 UTC m=+301.528136094" Jun 02 01:16:06.007259 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:06.007209 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-jfp5q"] Jun 02 01:16:06.009353 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:06.009334 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-jfp5q" Jun 02 01:16:06.011834 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:06.011809 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 02 01:16:06.012683 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:06.012666 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 02 01:16:06.012736 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:06.012666 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-cz72c\"" Jun 02 01:16:06.016729 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:06.016709 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-jfp5q"] Jun 02 01:16:06.098408 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:06.098354 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rvpv\" (UniqueName: \"kubernetes.io/projected/08933133-43c3-463b-a9f6-06d5ff10aac0-kube-api-access-4rvpv\") pod \"cert-manager-cainjector-68b757865b-jfp5q\" (UID: \"08933133-43c3-463b-a9f6-06d5ff10aac0\") " pod="cert-manager/cert-manager-cainjector-68b757865b-jfp5q" Jun 02 01:16:06.098408 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:06.098412 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/08933133-43c3-463b-a9f6-06d5ff10aac0-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-jfp5q\" (UID: \"08933133-43c3-463b-a9f6-06d5ff10aac0\") " pod="cert-manager/cert-manager-cainjector-68b757865b-jfp5q" Jun 02 01:16:06.198908 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:06.198864 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4rvpv\" (UniqueName: \"kubernetes.io/projected/08933133-43c3-463b-a9f6-06d5ff10aac0-kube-api-access-4rvpv\") pod \"cert-manager-cainjector-68b757865b-jfp5q\" (UID: \"08933133-43c3-463b-a9f6-06d5ff10aac0\") " pod="cert-manager/cert-manager-cainjector-68b757865b-jfp5q" Jun 02 01:16:06.199081 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:06.198916 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/08933133-43c3-463b-a9f6-06d5ff10aac0-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-jfp5q\" (UID: \"08933133-43c3-463b-a9f6-06d5ff10aac0\") " pod="cert-manager/cert-manager-cainjector-68b757865b-jfp5q" Jun 02 01:16:06.206308 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:06.206284 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/08933133-43c3-463b-a9f6-06d5ff10aac0-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-jfp5q\" (UID: \"08933133-43c3-463b-a9f6-06d5ff10aac0\") " pod="cert-manager/cert-manager-cainjector-68b757865b-jfp5q" Jun 02 01:16:06.206536 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:06.206504 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rvpv\" (UniqueName: \"kubernetes.io/projected/08933133-43c3-463b-a9f6-06d5ff10aac0-kube-api-access-4rvpv\") pod \"cert-manager-cainjector-68b757865b-jfp5q\" (UID: \"08933133-43c3-463b-a9f6-06d5ff10aac0\") " pod="cert-manager/cert-manager-cainjector-68b757865b-jfp5q" Jun 02 01:16:06.319521 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:06.319422 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-jfp5q" Jun 02 01:16:06.449732 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:06.449698 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-jfp5q"] Jun 02 01:16:06.453141 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:16:06.453115 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08933133_43c3_463b_a9f6_06d5ff10aac0.slice/crio-ba8124779bccc93247686dbc25d29d8c0bc989b1c55a9d90f77e9e5a5ba72b58 WatchSource:0}: Error finding container ba8124779bccc93247686dbc25d29d8c0bc989b1c55a9d90f77e9e5a5ba72b58: Status 404 returned error can't find the container with id ba8124779bccc93247686dbc25d29d8c0bc989b1c55a9d90f77e9e5a5ba72b58 Jun 02 01:16:06.454845 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:06.454829 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 01:16:07.368861 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:07.368824 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-jfp5q" event={"ID":"08933133-43c3-463b-a9f6-06d5ff10aac0","Type":"ContainerStarted","Data":"ba8124779bccc93247686dbc25d29d8c0bc989b1c55a9d90f77e9e5a5ba72b58"} Jun 02 01:16:09.376054 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:09.376018 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-jfp5q" event={"ID":"08933133-43c3-463b-a9f6-06d5ff10aac0","Type":"ContainerStarted","Data":"4d1154f1117db55f78d58ba3ee5504c74104acbcbb76320eeabc88854a86be4b"} Jun 02 01:16:09.391807 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:09.391749 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-jfp5q" podStartSLOduration=1.641183112 podStartE2EDuration="4.391734488s" podCreationTimestamp="2026-06-02 01:16:05 +0000 UTC" firstStartedPulling="2026-06-02 01:16:06.454955712 +0000 UTC m=+310.625497876" lastFinishedPulling="2026-06-02 01:16:09.205506804 +0000 UTC m=+313.376049252" observedRunningTime="2026-06-02 01:16:09.389702796 +0000 UTC m=+313.560245024" watchObservedRunningTime="2026-06-02 01:16:09.391734488 +0000 UTC m=+313.562276674" Jun 02 01:16:31.159070 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:31.159030 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vrxh5"] Jun 02 01:16:31.168004 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:31.167980 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vrxh5" Jun 02 01:16:31.171005 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:31.170984 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 01:16:31.171206 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:31.171185 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 01:16:31.171789 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:31.171773 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 01:16:31.171840 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:31.171791 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 01:16:31.179494 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:31.179471 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cgjh5\"" Jun 02 01:16:31.209550 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:31.209522 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vrxh5"] Jun 02 01:16:31.299578 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:31.299534 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2df97e6c-d5b2-4a64-9499-f2eeb25c397c-tmp\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-vrxh5\" (UID: \"2df97e6c-d5b2-4a64-9499-f2eeb25c397c\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vrxh5" Jun 02 01:16:31.299780 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:31.299587 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2df97e6c-d5b2-4a64-9499-f2eeb25c397c-manifests\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-vrxh5\" (UID: \"2df97e6c-d5b2-4a64-9499-f2eeb25c397c\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vrxh5" Jun 02 01:16:31.299780 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:31.299660 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2df97e6c-d5b2-4a64-9499-f2eeb25c397c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-vrxh5\" (UID: \"2df97e6c-d5b2-4a64-9499-f2eeb25c397c\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vrxh5" Jun 02 01:16:31.299780 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:31.299717 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ztmm\" (UniqueName: \"kubernetes.io/projected/2df97e6c-d5b2-4a64-9499-f2eeb25c397c-kube-api-access-7ztmm\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-vrxh5\" (UID: \"2df97e6c-d5b2-4a64-9499-f2eeb25c397c\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vrxh5" Jun 02 01:16:31.299780 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:31.299766 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2df97e6c-d5b2-4a64-9499-f2eeb25c397c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-vrxh5\" (UID: \"2df97e6c-d5b2-4a64-9499-f2eeb25c397c\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vrxh5" Jun 02 01:16:31.400493 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:31.400454 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2df97e6c-d5b2-4a64-9499-f2eeb25c397c-manifests\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-vrxh5\" (UID: \"2df97e6c-d5b2-4a64-9499-f2eeb25c397c\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vrxh5" Jun 02 01:16:31.400701 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:31.400522 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2df97e6c-d5b2-4a64-9499-f2eeb25c397c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-vrxh5\" (UID: \"2df97e6c-d5b2-4a64-9499-f2eeb25c397c\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vrxh5" Jun 02 01:16:31.400701 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:31.400563 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7ztmm\" (UniqueName: \"kubernetes.io/projected/2df97e6c-d5b2-4a64-9499-f2eeb25c397c-kube-api-access-7ztmm\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-vrxh5\" (UID: \"2df97e6c-d5b2-4a64-9499-f2eeb25c397c\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vrxh5" Jun 02 01:16:31.400701 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:31.400608 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2df97e6c-d5b2-4a64-9499-f2eeb25c397c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-vrxh5\" (UID: \"2df97e6c-d5b2-4a64-9499-f2eeb25c397c\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vrxh5" Jun 02 01:16:31.400701 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:31.400638 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2df97e6c-d5b2-4a64-9499-f2eeb25c397c-tmp\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-vrxh5\" (UID: \"2df97e6c-d5b2-4a64-9499-f2eeb25c397c\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vrxh5" Jun 02 01:16:31.400918 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:31.400875 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2df97e6c-d5b2-4a64-9499-f2eeb25c397c-manifests\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-vrxh5\" (UID: \"2df97e6c-d5b2-4a64-9499-f2eeb25c397c\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vrxh5" Jun 02 01:16:31.402932 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:31.402901 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2df97e6c-d5b2-4a64-9499-f2eeb25c397c-tmp\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-vrxh5\" (UID: \"2df97e6c-d5b2-4a64-9499-f2eeb25c397c\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vrxh5" Jun 02 01:16:31.403181 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:31.403163 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2df97e6c-d5b2-4a64-9499-f2eeb25c397c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-vrxh5\" (UID: \"2df97e6c-d5b2-4a64-9499-f2eeb25c397c\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vrxh5" Jun 02 01:16:31.403181 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:31.403173 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2df97e6c-d5b2-4a64-9499-f2eeb25c397c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-vrxh5\" (UID: \"2df97e6c-d5b2-4a64-9499-f2eeb25c397c\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vrxh5" Jun 02 01:16:31.409509 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:31.409456 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ztmm\" (UniqueName: \"kubernetes.io/projected/2df97e6c-d5b2-4a64-9499-f2eeb25c397c-kube-api-access-7ztmm\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-vrxh5\" (UID: \"2df97e6c-d5b2-4a64-9499-f2eeb25c397c\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vrxh5" Jun 02 01:16:31.477727 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:31.477691 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vrxh5" Jun 02 01:16:31.618587 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:31.618478 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vrxh5"] Jun 02 01:16:31.621429 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:16:31.621398 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2df97e6c_d5b2_4a64_9499_f2eeb25c397c.slice/crio-98b384dd235d687fb0b6e37ce5f1625ade373de94665d4e1982e3867ec8f2d0c WatchSource:0}: Error finding container 98b384dd235d687fb0b6e37ce5f1625ade373de94665d4e1982e3867ec8f2d0c: Status 404 returned error can't find the container with id 98b384dd235d687fb0b6e37ce5f1625ade373de94665d4e1982e3867ec8f2d0c Jun 02 01:16:32.436901 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:32.436858 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vrxh5" event={"ID":"2df97e6c-d5b2-4a64-9499-f2eeb25c397c","Type":"ContainerStarted","Data":"98b384dd235d687fb0b6e37ce5f1625ade373de94665d4e1982e3867ec8f2d0c"} Jun 02 01:16:34.444835 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:34.444752 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vrxh5" event={"ID":"2df97e6c-d5b2-4a64-9499-f2eeb25c397c","Type":"ContainerStarted","Data":"8ad5f589f8d1110c681fcc3bcac5f13440346130b8411a6d31c7e5c5fdb3ac8c"} Jun 02 01:16:35.448689 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:35.448653 2576 generic.go:358] "Generic (PLEG): container finished" podID="2df97e6c-d5b2-4a64-9499-f2eeb25c397c" containerID="8ad5f589f8d1110c681fcc3bcac5f13440346130b8411a6d31c7e5c5fdb3ac8c" exitCode=0 Jun 02 01:16:35.449068 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:35.448708 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vrxh5" event={"ID":"2df97e6c-d5b2-4a64-9499-f2eeb25c397c","Type":"ContainerDied","Data":"8ad5f589f8d1110c681fcc3bcac5f13440346130b8411a6d31c7e5c5fdb3ac8c"} Jun 02 01:16:36.453672 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:36.453633 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vrxh5" event={"ID":"2df97e6c-d5b2-4a64-9499-f2eeb25c397c","Type":"ContainerStarted","Data":"5eab961d85559f8258b628ee0185f29a58e061d760bf15bf91d61567198342d9"} Jun 02 01:16:36.454176 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:36.453761 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vrxh5" Jun 02 01:16:36.476076 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:36.476013 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vrxh5" podStartSLOduration=1.286008598 podStartE2EDuration="5.475994702s" podCreationTimestamp="2026-06-02 01:16:31 +0000 UTC" firstStartedPulling="2026-06-02 01:16:31.623141892 +0000 UTC m=+335.793684056" lastFinishedPulling="2026-06-02 01:16:35.813127993 +0000 UTC m=+339.983670160" observedRunningTime="2026-06-02 01:16:36.47421197 +0000 UTC m=+340.644754154" watchObservedRunningTime="2026-06-02 01:16:36.475994702 +0000 UTC m=+340.646536887" Jun 02 01:16:47.459525 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:47.459493 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vrxh5" Jun 02 01:16:50.314838 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:50.314803 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-549c788894-cwgdw"] Jun 02 01:16:50.319179 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:50.319159 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-549c788894-cwgdw" Jun 02 01:16:50.322612 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:50.322589 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 02 01:16:50.322924 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:50.322594 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 02 01:16:50.323073 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:50.322595 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 01:16:50.323212 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:50.322608 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8g79f\"" Jun 02 01:16:50.323322 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:50.322669 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 01:16:50.328533 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:50.328508 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-549c788894-cwgdw"] Jun 02 01:16:50.456637 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:50.456599 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49161927-e4b0-4e88-b7cb-cc7ad395a21f-tmp\") pod \"kube-auth-proxy-549c788894-cwgdw\" (UID: \"49161927-e4b0-4e88-b7cb-cc7ad395a21f\") " pod="openshift-ingress/kube-auth-proxy-549c788894-cwgdw" Jun 02 01:16:50.456637 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:50.456639 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lt79\" (UniqueName: \"kubernetes.io/projected/49161927-e4b0-4e88-b7cb-cc7ad395a21f-kube-api-access-4lt79\") pod \"kube-auth-proxy-549c788894-cwgdw\" (UID: \"49161927-e4b0-4e88-b7cb-cc7ad395a21f\") " pod="openshift-ingress/kube-auth-proxy-549c788894-cwgdw" Jun 02 01:16:50.456877 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:50.456661 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49161927-e4b0-4e88-b7cb-cc7ad395a21f-tls-certs\") pod \"kube-auth-proxy-549c788894-cwgdw\" (UID: \"49161927-e4b0-4e88-b7cb-cc7ad395a21f\") " pod="openshift-ingress/kube-auth-proxy-549c788894-cwgdw" Jun 02 01:16:50.468267 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:50.468230 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-76588b95-qjb25"] Jun 02 01:16:50.471028 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:50.471009 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-qjb25" Jun 02 01:16:50.473896 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:50.473874 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 02 01:16:50.474010 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:50.473923 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-kqk22\"" Jun 02 01:16:50.481145 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:50.481112 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-qjb25"] Jun 02 01:16:50.558038 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:50.558001 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/35788916-3d12-4853-a10f-9777ae6437f0-cert\") pod \"odh-model-controller-76588b95-qjb25\" (UID: \"35788916-3d12-4853-a10f-9777ae6437f0\") " pod="opendatahub/odh-model-controller-76588b95-qjb25" Jun 02 01:16:50.558227 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:50.558054 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49161927-e4b0-4e88-b7cb-cc7ad395a21f-tmp\") pod \"kube-auth-proxy-549c788894-cwgdw\" (UID: \"49161927-e4b0-4e88-b7cb-cc7ad395a21f\") " pod="openshift-ingress/kube-auth-proxy-549c788894-cwgdw" Jun 02 01:16:50.558227 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:50.558082 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn827\" (UniqueName: \"kubernetes.io/projected/35788916-3d12-4853-a10f-9777ae6437f0-kube-api-access-nn827\") pod \"odh-model-controller-76588b95-qjb25\" (UID: \"35788916-3d12-4853-a10f-9777ae6437f0\") " pod="opendatahub/odh-model-controller-76588b95-qjb25" Jun 02 01:16:50.558227 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:50.558110 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4lt79\" (UniqueName: \"kubernetes.io/projected/49161927-e4b0-4e88-b7cb-cc7ad395a21f-kube-api-access-4lt79\") pod \"kube-auth-proxy-549c788894-cwgdw\" (UID: \"49161927-e4b0-4e88-b7cb-cc7ad395a21f\") " pod="openshift-ingress/kube-auth-proxy-549c788894-cwgdw" Jun 02 01:16:50.558381 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:50.558309 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49161927-e4b0-4e88-b7cb-cc7ad395a21f-tls-certs\") pod \"kube-auth-proxy-549c788894-cwgdw\" (UID: \"49161927-e4b0-4e88-b7cb-cc7ad395a21f\") " pod="openshift-ingress/kube-auth-proxy-549c788894-cwgdw" Jun 02 01:16:50.561099 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:50.561071 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49161927-e4b0-4e88-b7cb-cc7ad395a21f-tmp\") pod \"kube-auth-proxy-549c788894-cwgdw\" (UID: \"49161927-e4b0-4e88-b7cb-cc7ad395a21f\") " pod="openshift-ingress/kube-auth-proxy-549c788894-cwgdw" Jun 02 01:16:50.561292 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:50.561274 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/49161927-e4b0-4e88-b7cb-cc7ad395a21f-tls-certs\") pod \"kube-auth-proxy-549c788894-cwgdw\" (UID: \"49161927-e4b0-4e88-b7cb-cc7ad395a21f\") " pod="openshift-ingress/kube-auth-proxy-549c788894-cwgdw" Jun 02 01:16:50.566055 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:50.565989 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lt79\" (UniqueName: \"kubernetes.io/projected/49161927-e4b0-4e88-b7cb-cc7ad395a21f-kube-api-access-4lt79\") pod \"kube-auth-proxy-549c788894-cwgdw\" (UID: \"49161927-e4b0-4e88-b7cb-cc7ad395a21f\") " pod="openshift-ingress/kube-auth-proxy-549c788894-cwgdw" Jun 02 01:16:50.630680 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:50.630645 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-549c788894-cwgdw" Jun 02 01:16:50.659858 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:50.659827 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/35788916-3d12-4853-a10f-9777ae6437f0-cert\") pod \"odh-model-controller-76588b95-qjb25\" (UID: \"35788916-3d12-4853-a10f-9777ae6437f0\") " pod="opendatahub/odh-model-controller-76588b95-qjb25" Jun 02 01:16:50.660027 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:50.659875 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nn827\" (UniqueName: \"kubernetes.io/projected/35788916-3d12-4853-a10f-9777ae6437f0-kube-api-access-nn827\") pod \"odh-model-controller-76588b95-qjb25\" (UID: \"35788916-3d12-4853-a10f-9777ae6437f0\") " pod="opendatahub/odh-model-controller-76588b95-qjb25" Jun 02 01:16:50.660027 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:16:50.660005 2576 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 02 01:16:50.660139 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:16:50.660084 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35788916-3d12-4853-a10f-9777ae6437f0-cert podName:35788916-3d12-4853-a10f-9777ae6437f0 nodeName:}" failed. No retries permitted until 2026-06-02 01:16:51.160062987 +0000 UTC m=+355.330605157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/35788916-3d12-4853-a10f-9777ae6437f0-cert") pod "odh-model-controller-76588b95-qjb25" (UID: "35788916-3d12-4853-a10f-9777ae6437f0") : secret "odh-model-controller-webhook-cert" not found Jun 02 01:16:50.671575 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:50.671512 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn827\" (UniqueName: \"kubernetes.io/projected/35788916-3d12-4853-a10f-9777ae6437f0-kube-api-access-nn827\") pod \"odh-model-controller-76588b95-qjb25\" (UID: \"35788916-3d12-4853-a10f-9777ae6437f0\") " pod="opendatahub/odh-model-controller-76588b95-qjb25" Jun 02 01:16:50.764924 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:50.764893 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-549c788894-cwgdw"] Jun 02 01:16:50.768783 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:16:50.768755 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49161927_e4b0_4e88_b7cb_cc7ad395a21f.slice/crio-c55122da417016dcaf672a607fcf41ad743bb8e2c2a79a3a8a896dda0c25c7b4 WatchSource:0}: Error finding container c55122da417016dcaf672a607fcf41ad743bb8e2c2a79a3a8a896dda0c25c7b4: Status 404 returned error can't find the container with id c55122da417016dcaf672a607fcf41ad743bb8e2c2a79a3a8a896dda0c25c7b4 Jun 02 01:16:51.102872 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:51.102843 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c7648845d-zt2x5"] Jun 02 01:16:51.105534 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:51.105516 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c7648845d-zt2x5" Jun 02 01:16:51.109188 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:51.109163 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 02 01:16:51.109296 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:51.109169 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 02 01:16:51.110125 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:51.110099 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zmz2t\"" Jun 02 01:16:51.110231 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:51.110126 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 02 01:16:51.110231 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:51.110131 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 02 01:16:51.110231 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:51.110181 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:16:51.120691 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:51.120669 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c7648845d-zt2x5"] Jun 02 01:16:51.164546 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:51.164515 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/35788916-3d12-4853-a10f-9777ae6437f0-cert\") pod \"odh-model-controller-76588b95-qjb25\" (UID: \"35788916-3d12-4853-a10f-9777ae6437f0\") " pod="opendatahub/odh-model-controller-76588b95-qjb25" Jun 02 01:16:51.167031 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:51.167008 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/35788916-3d12-4853-a10f-9777ae6437f0-cert\") pod \"odh-model-controller-76588b95-qjb25\" (UID: \"35788916-3d12-4853-a10f-9777ae6437f0\") " pod="opendatahub/odh-model-controller-76588b95-qjb25" Jun 02 01:16:51.265722 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:51.265684 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7016eaf8-41f7-485b-9118-21b05fe96787-manager-config\") pod \"lws-controller-manager-5c7648845d-zt2x5\" (UID: \"7016eaf8-41f7-485b-9118-21b05fe96787\") " pod="openshift-lws-operator/lws-controller-manager-5c7648845d-zt2x5" Jun 02 01:16:51.265918 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:51.265761 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q88g5\" (UniqueName: \"kubernetes.io/projected/7016eaf8-41f7-485b-9118-21b05fe96787-kube-api-access-q88g5\") pod \"lws-controller-manager-5c7648845d-zt2x5\" (UID: \"7016eaf8-41f7-485b-9118-21b05fe96787\") " pod="openshift-lws-operator/lws-controller-manager-5c7648845d-zt2x5" Jun 02 01:16:51.265918 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:51.265830 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7016eaf8-41f7-485b-9118-21b05fe96787-cert\") pod \"lws-controller-manager-5c7648845d-zt2x5\" (UID: \"7016eaf8-41f7-485b-9118-21b05fe96787\") " pod="openshift-lws-operator/lws-controller-manager-5c7648845d-zt2x5" Jun 02 01:16:51.266055 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:51.265916 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7016eaf8-41f7-485b-9118-21b05fe96787-metrics-cert\") pod \"lws-controller-manager-5c7648845d-zt2x5\" (UID: \"7016eaf8-41f7-485b-9118-21b05fe96787\") " pod="openshift-lws-operator/lws-controller-manager-5c7648845d-zt2x5" Jun 02 01:16:51.367229 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:51.367036 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7016eaf8-41f7-485b-9118-21b05fe96787-manager-config\") pod \"lws-controller-manager-5c7648845d-zt2x5\" (UID: \"7016eaf8-41f7-485b-9118-21b05fe96787\") " pod="openshift-lws-operator/lws-controller-manager-5c7648845d-zt2x5" Jun 02 01:16:51.367229 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:51.367143 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q88g5\" (UniqueName: \"kubernetes.io/projected/7016eaf8-41f7-485b-9118-21b05fe96787-kube-api-access-q88g5\") pod \"lws-controller-manager-5c7648845d-zt2x5\" (UID: \"7016eaf8-41f7-485b-9118-21b05fe96787\") " pod="openshift-lws-operator/lws-controller-manager-5c7648845d-zt2x5" Jun 02 01:16:51.367229 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:51.367223 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7016eaf8-41f7-485b-9118-21b05fe96787-cert\") pod \"lws-controller-manager-5c7648845d-zt2x5\" (UID: \"7016eaf8-41f7-485b-9118-21b05fe96787\") " pod="openshift-lws-operator/lws-controller-manager-5c7648845d-zt2x5" Jun 02 01:16:51.367815 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:51.367294 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7016eaf8-41f7-485b-9118-21b05fe96787-metrics-cert\") pod \"lws-controller-manager-5c7648845d-zt2x5\" (UID: \"7016eaf8-41f7-485b-9118-21b05fe96787\") " pod="openshift-lws-operator/lws-controller-manager-5c7648845d-zt2x5" Jun 02 01:16:51.367815 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:51.367722 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7016eaf8-41f7-485b-9118-21b05fe96787-manager-config\") pod \"lws-controller-manager-5c7648845d-zt2x5\" (UID: \"7016eaf8-41f7-485b-9118-21b05fe96787\") " pod="openshift-lws-operator/lws-controller-manager-5c7648845d-zt2x5" Jun 02 01:16:51.370266 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:51.370241 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7016eaf8-41f7-485b-9118-21b05fe96787-metrics-cert\") pod \"lws-controller-manager-5c7648845d-zt2x5\" (UID: \"7016eaf8-41f7-485b-9118-21b05fe96787\") " pod="openshift-lws-operator/lws-controller-manager-5c7648845d-zt2x5" Jun 02 01:16:51.370660 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:51.370631 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7016eaf8-41f7-485b-9118-21b05fe96787-cert\") pod \"lws-controller-manager-5c7648845d-zt2x5\" (UID: \"7016eaf8-41f7-485b-9118-21b05fe96787\") " pod="openshift-lws-operator/lws-controller-manager-5c7648845d-zt2x5" Jun 02 01:16:51.378152 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:51.378125 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q88g5\" (UniqueName: \"kubernetes.io/projected/7016eaf8-41f7-485b-9118-21b05fe96787-kube-api-access-q88g5\") pod \"lws-controller-manager-5c7648845d-zt2x5\" (UID: \"7016eaf8-41f7-485b-9118-21b05fe96787\") " pod="openshift-lws-operator/lws-controller-manager-5c7648845d-zt2x5" Jun 02 01:16:51.381895 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:51.381868 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-qjb25" Jun 02 01:16:51.414928 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:51.414819 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c7648845d-zt2x5" Jun 02 01:16:51.510433 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:51.510191 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-549c788894-cwgdw" event={"ID":"49161927-e4b0-4e88-b7cb-cc7ad395a21f","Type":"ContainerStarted","Data":"c55122da417016dcaf672a607fcf41ad743bb8e2c2a79a3a8a896dda0c25c7b4"} Jun 02 01:16:51.570946 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:51.570641 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-qjb25"] Jun 02 01:16:51.607280 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:51.607243 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c7648845d-zt2x5"] Jun 02 01:16:51.610739 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:16:51.610707 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7016eaf8_41f7_485b_9118_21b05fe96787.slice/crio-92cd80b3f749ba9090b56464b261bbe7034b9527fc9b3f76ed90edbc4de5877a WatchSource:0}: Error finding container 92cd80b3f749ba9090b56464b261bbe7034b9527fc9b3f76ed90edbc4de5877a: Status 404 returned error can't find the container with id 92cd80b3f749ba9090b56464b261bbe7034b9527fc9b3f76ed90edbc4de5877a Jun 02 01:16:52.516296 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:52.516258 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-qjb25" event={"ID":"35788916-3d12-4853-a10f-9777ae6437f0","Type":"ContainerStarted","Data":"645be22ac61b74c1c2b3a970801b6367955f856aa47c2de894603fe46e19872f"} Jun 02 01:16:52.517549 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:52.517505 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c7648845d-zt2x5" event={"ID":"7016eaf8-41f7-485b-9118-21b05fe96787","Type":"ContainerStarted","Data":"92cd80b3f749ba9090b56464b261bbe7034b9527fc9b3f76ed90edbc4de5877a"} Jun 02 01:16:55.531025 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:55.530984 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-549c788894-cwgdw" event={"ID":"49161927-e4b0-4e88-b7cb-cc7ad395a21f","Type":"ContainerStarted","Data":"ff31d324f0bbc32904c0018e480a140f2f420e2795d3f0926ab0f9313fb89a6d"} Jun 02 01:16:55.532975 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:55.532924 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-qjb25" event={"ID":"35788916-3d12-4853-a10f-9777ae6437f0","Type":"ContainerStarted","Data":"ea99b24c5471bcee350bcb405ef864ea31cd683820bc4587ed86776804be1c3a"} Jun 02 01:16:55.533124 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:55.533067 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-76588b95-qjb25" Jun 02 01:16:55.549728 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:55.548016 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-549c788894-cwgdw" podStartSLOduration=1.219903551 podStartE2EDuration="5.547996868s" podCreationTimestamp="2026-06-02 01:16:50 +0000 UTC" firstStartedPulling="2026-06-02 01:16:50.770600955 +0000 UTC m=+354.941143123" lastFinishedPulling="2026-06-02 01:16:55.098694258 +0000 UTC m=+359.269236440" observedRunningTime="2026-06-02 01:16:55.546870059 +0000 UTC m=+359.717412245" watchObservedRunningTime="2026-06-02 01:16:55.547996868 +0000 UTC m=+359.718539056" Jun 02 01:16:55.563700 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:55.563289 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-76588b95-qjb25" podStartSLOduration=2.037798522 podStartE2EDuration="5.563269285s" podCreationTimestamp="2026-06-02 01:16:50 +0000 UTC" firstStartedPulling="2026-06-02 01:16:51.582437395 +0000 UTC m=+355.752979563" lastFinishedPulling="2026-06-02 01:16:55.107908146 +0000 UTC m=+359.278450326" observedRunningTime="2026-06-02 01:16:55.560869502 +0000 UTC m=+359.731411701" watchObservedRunningTime="2026-06-02 01:16:55.563269285 +0000 UTC m=+359.733811472" Jun 02 01:16:57.542419 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:57.542356 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c7648845d-zt2x5" event={"ID":"7016eaf8-41f7-485b-9118-21b05fe96787","Type":"ContainerStarted","Data":"bebe3fc474a0d101aff1e6964cd2f757dd52b414db74a05702d6ed7371911760"} Jun 02 01:16:57.542875 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:57.542499 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5c7648845d-zt2x5" Jun 02 01:16:57.562213 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:16:57.562153 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5c7648845d-zt2x5" podStartSLOduration=1.295729221 podStartE2EDuration="6.56214049s" podCreationTimestamp="2026-06-02 01:16:51 +0000 UTC" firstStartedPulling="2026-06-02 01:16:51.613190942 +0000 UTC m=+355.783733109" lastFinishedPulling="2026-06-02 01:16:56.879602203 +0000 UTC m=+361.050144378" observedRunningTime="2026-06-02 01:16:57.560507707 +0000 UTC m=+361.731049890" watchObservedRunningTime="2026-06-02 01:16:57.56214049 +0000 UTC m=+361.732682676" Jun 02 01:17:06.539942 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:17:06.539900 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-76588b95-qjb25" Jun 02 01:17:08.548325 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:17:08.548295 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5c7648845d-zt2x5" Jun 02 01:18:08.313236 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:08.313152 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8697886764-5xvbv"] Jun 02 01:18:33.332839 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.332766 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-8697886764-5xvbv" podUID="19c50191-fc35-413d-a3d1-bd7ce1a0ef69" containerName="console" containerID="cri-o://237f0803b35ad6631de58b6b7c2555b76da842f99883d55397f82f54dbe3f5fc" gracePeriod=15 Jun 02 01:18:33.593591 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.593527 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8697886764-5xvbv_19c50191-fc35-413d-a3d1-bd7ce1a0ef69/console/0.log" Jun 02 01:18:33.593731 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.593592 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8697886764-5xvbv" Jun 02 01:18:33.706037 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.705994 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-trusted-ca-bundle\") pod \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\" (UID: \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\") " Jun 02 01:18:33.706235 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.706054 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-oauth-serving-cert\") pod \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\" (UID: \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\") " Jun 02 01:18:33.706235 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.706097 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-console-serving-cert\") pod \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\" (UID: \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\") " Jun 02 01:18:33.706235 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.706125 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tc26m\" (UniqueName: \"kubernetes.io/projected/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-kube-api-access-tc26m\") pod \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\" (UID: \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\") " Jun 02 01:18:33.706235 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.706179 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-console-oauth-config\") pod \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\" (UID: \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\") " Jun 02 01:18:33.706235 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.706202 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-service-ca\") pod \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\" (UID: \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\") " Jun 02 01:18:33.706235 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.706232 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-console-config\") pod \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\" (UID: \"19c50191-fc35-413d-a3d1-bd7ce1a0ef69\") " Jun 02 01:18:33.706606 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.706466 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "19c50191-fc35-413d-a3d1-bd7ce1a0ef69" (UID: "19c50191-fc35-413d-a3d1-bd7ce1a0ef69"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:18:33.706606 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.706578 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "19c50191-fc35-413d-a3d1-bd7ce1a0ef69" (UID: "19c50191-fc35-413d-a3d1-bd7ce1a0ef69"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:18:33.706715 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.706622 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-service-ca" (OuterVolumeSpecName: "service-ca") pod "19c50191-fc35-413d-a3d1-bd7ce1a0ef69" (UID: "19c50191-fc35-413d-a3d1-bd7ce1a0ef69"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:18:33.706770 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.706751 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-console-config" (OuterVolumeSpecName: "console-config") pod "19c50191-fc35-413d-a3d1-bd7ce1a0ef69" (UID: "19c50191-fc35-413d-a3d1-bd7ce1a0ef69"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:18:33.708397 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.708354 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "19c50191-fc35-413d-a3d1-bd7ce1a0ef69" (UID: "19c50191-fc35-413d-a3d1-bd7ce1a0ef69"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:18:33.708844 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.708819 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "19c50191-fc35-413d-a3d1-bd7ce1a0ef69" (UID: "19c50191-fc35-413d-a3d1-bd7ce1a0ef69"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:18:33.708910 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.708845 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-kube-api-access-tc26m" (OuterVolumeSpecName: "kube-api-access-tc26m") pod "19c50191-fc35-413d-a3d1-bd7ce1a0ef69" (UID: "19c50191-fc35-413d-a3d1-bd7ce1a0ef69"). InnerVolumeSpecName "kube-api-access-tc26m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:18:33.807307 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.807265 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tc26m\" (UniqueName: \"kubernetes.io/projected/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-kube-api-access-tc26m\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\"" Jun 02 01:18:33.807307 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.807299 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-console-oauth-config\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\"" Jun 02 01:18:33.807307 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.807310 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-service-ca\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\"" Jun 02 01:18:33.807307 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.807319 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-console-config\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\"" Jun 02 01:18:33.807594 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.807327 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-trusted-ca-bundle\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\"" Jun 02 01:18:33.807594 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.807336 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-oauth-serving-cert\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\"" Jun 02 01:18:33.807594 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.807344 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19c50191-fc35-413d-a3d1-bd7ce1a0ef69-console-serving-cert\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\"" Jun 02 01:18:33.850524 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.850453 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8697886764-5xvbv_19c50191-fc35-413d-a3d1-bd7ce1a0ef69/console/0.log" Jun 02 01:18:33.850524 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.850490 2576 generic.go:358] "Generic (PLEG): container finished" podID="19c50191-fc35-413d-a3d1-bd7ce1a0ef69" containerID="237f0803b35ad6631de58b6b7c2555b76da842f99883d55397f82f54dbe3f5fc" exitCode=2 Jun 02 01:18:33.850689 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.850554 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8697886764-5xvbv" Jun 02 01:18:33.850689 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.850589 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8697886764-5xvbv" event={"ID":"19c50191-fc35-413d-a3d1-bd7ce1a0ef69","Type":"ContainerDied","Data":"237f0803b35ad6631de58b6b7c2555b76da842f99883d55397f82f54dbe3f5fc"} Jun 02 01:18:33.850689 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.850628 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8697886764-5xvbv" event={"ID":"19c50191-fc35-413d-a3d1-bd7ce1a0ef69","Type":"ContainerDied","Data":"377a00e33b0b576ad9f238a8421c6998c2fa96589571f970560ece9e6a904370"} Jun 02 01:18:33.850689 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.850644 2576 scope.go:117] "RemoveContainer" containerID="237f0803b35ad6631de58b6b7c2555b76da842f99883d55397f82f54dbe3f5fc" Jun 02 01:18:33.859149 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.859133 2576 scope.go:117] "RemoveContainer" containerID="237f0803b35ad6631de58b6b7c2555b76da842f99883d55397f82f54dbe3f5fc" Jun 02 01:18:33.859394 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:18:33.859358 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"237f0803b35ad6631de58b6b7c2555b76da842f99883d55397f82f54dbe3f5fc\": container with ID starting with 237f0803b35ad6631de58b6b7c2555b76da842f99883d55397f82f54dbe3f5fc not found: ID does not exist" containerID="237f0803b35ad6631de58b6b7c2555b76da842f99883d55397f82f54dbe3f5fc" Jun 02 01:18:33.859466 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.859408 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"237f0803b35ad6631de58b6b7c2555b76da842f99883d55397f82f54dbe3f5fc"} err="failed to get container status \"237f0803b35ad6631de58b6b7c2555b76da842f99883d55397f82f54dbe3f5fc\": rpc error: code = NotFound desc = could not find container \"237f0803b35ad6631de58b6b7c2555b76da842f99883d55397f82f54dbe3f5fc\": container with ID starting with 237f0803b35ad6631de58b6b7c2555b76da842f99883d55397f82f54dbe3f5fc not found: ID does not exist" Jun 02 01:18:33.874900 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.874869 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8697886764-5xvbv"] Jun 02 01:18:33.879120 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:33.879088 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8697886764-5xvbv"] Jun 02 01:18:34.407073 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:34.407033 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19c50191-fc35-413d-a3d1-bd7ce1a0ef69" path="/var/lib/kubelet/pods/19c50191-fc35-413d-a3d1-bd7ce1a0ef69/volumes" Jun 02 01:18:35.284949 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:35.284917 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-8htjt"] Jun 02 01:18:35.285243 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:35.285229 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19c50191-fc35-413d-a3d1-bd7ce1a0ef69" containerName="console" Jun 02 01:18:35.285287 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:35.285244 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="19c50191-fc35-413d-a3d1-bd7ce1a0ef69" containerName="console" Jun 02 01:18:35.285320 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:35.285292 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="19c50191-fc35-413d-a3d1-bd7ce1a0ef69" containerName="console" Jun 02 01:18:35.288004 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:35.287987 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-8htjt" Jun 02 01:18:35.290645 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:35.290622 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 01:18:35.290765 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:35.290632 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 02 01:18:35.291710 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:35.291693 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zd7mt\"" Jun 02 01:18:35.291710 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:35.291701 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 02 01:18:35.291857 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:35.291693 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 01:18:35.296973 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:35.296954 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-8htjt"] Jun 02 01:18:35.418645 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:35.418605 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a19c1673-455c-4dcb-946c-f80ff1ecf71f-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-8htjt\" (UID: \"a19c1673-455c-4dcb-946c-f80ff1ecf71f\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-8htjt" Jun 02 01:18:35.419019 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:35.418660 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a19c1673-455c-4dcb-946c-f80ff1ecf71f-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-8htjt\" (UID: \"a19c1673-455c-4dcb-946c-f80ff1ecf71f\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-8htjt" Jun 02 01:18:35.419019 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:35.418708 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5frhs\" (UniqueName: \"kubernetes.io/projected/a19c1673-455c-4dcb-946c-f80ff1ecf71f-kube-api-access-5frhs\") pod \"kuadrant-console-plugin-6cb54b5c86-8htjt\" (UID: \"a19c1673-455c-4dcb-946c-f80ff1ecf71f\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-8htjt" Jun 02 01:18:35.519964 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:35.519922 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a19c1673-455c-4dcb-946c-f80ff1ecf71f-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-8htjt\" (UID: \"a19c1673-455c-4dcb-946c-f80ff1ecf71f\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-8htjt" Jun 02 01:18:35.520134 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:35.519978 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5frhs\" (UniqueName: \"kubernetes.io/projected/a19c1673-455c-4dcb-946c-f80ff1ecf71f-kube-api-access-5frhs\") pod \"kuadrant-console-plugin-6cb54b5c86-8htjt\" (UID: \"a19c1673-455c-4dcb-946c-f80ff1ecf71f\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-8htjt" Jun 02 01:18:35.520134 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:35.520019 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a19c1673-455c-4dcb-946c-f80ff1ecf71f-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-8htjt\" (UID: \"a19c1673-455c-4dcb-946c-f80ff1ecf71f\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-8htjt" Jun 02 01:18:35.520607 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:35.520576 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a19c1673-455c-4dcb-946c-f80ff1ecf71f-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-8htjt\" (UID: \"a19c1673-455c-4dcb-946c-f80ff1ecf71f\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-8htjt" Jun 02 01:18:35.522429 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:35.522405 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a19c1673-455c-4dcb-946c-f80ff1ecf71f-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-8htjt\" (UID: \"a19c1673-455c-4dcb-946c-f80ff1ecf71f\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-8htjt" Jun 02 01:18:35.530898 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:35.530872 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5frhs\" (UniqueName: \"kubernetes.io/projected/a19c1673-455c-4dcb-946c-f80ff1ecf71f-kube-api-access-5frhs\") pod \"kuadrant-console-plugin-6cb54b5c86-8htjt\" (UID: \"a19c1673-455c-4dcb-946c-f80ff1ecf71f\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-8htjt" Jun 02 01:18:35.598008 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:35.597916 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-8htjt" Jun 02 01:18:35.727699 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:35.727624 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-8htjt"] Jun 02 01:18:35.730345 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:18:35.730298 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda19c1673_455c_4dcb_946c_f80ff1ecf71f.slice/crio-d987b17a737ccf4f4c38111ec076167706c7dd73a0f5a6727660718c36b74abe WatchSource:0}: Error finding container d987b17a737ccf4f4c38111ec076167706c7dd73a0f5a6727660718c36b74abe: Status 404 returned error can't find the container with id d987b17a737ccf4f4c38111ec076167706c7dd73a0f5a6727660718c36b74abe Jun 02 01:18:35.859906 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:35.859816 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-8htjt" event={"ID":"a19c1673-455c-4dcb-946c-f80ff1ecf71f","Type":"ContainerStarted","Data":"d987b17a737ccf4f4c38111ec076167706c7dd73a0f5a6727660718c36b74abe"} Jun 02 01:18:57.934181 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:57.934139 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-8htjt" event={"ID":"a19c1673-455c-4dcb-946c-f80ff1ecf71f","Type":"ContainerStarted","Data":"f1e2da638fe6e19daf1cb139b50fa0dffc8c6bce4a5f70e4859a70a0bed6ba98"} Jun 02 01:18:57.959842 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:18:57.959785 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-8htjt" podStartSLOduration=1.090147883 podStartE2EDuration="22.95976993s" podCreationTimestamp="2026-06-02 01:18:35 +0000 UTC" firstStartedPulling="2026-06-02 01:18:35.731699972 +0000 UTC m=+459.902242139" lastFinishedPulling="2026-06-02 01:18:57.601322019 +0000 UTC m=+481.771864186" observedRunningTime="2026-06-02 01:18:57.957948558 +0000 UTC m=+482.128490744" watchObservedRunningTime="2026-06-02 01:18:57.95976993 +0000 UTC m=+482.130312116" Jun 02 01:19:20.644386 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:20.644338 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-5gwjn"] Jun 02 01:19:20.769973 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:20.769934 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-5gwjn"] Jun 02 01:19:20.770138 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:20.770073 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-5gwjn" Jun 02 01:19:20.772453 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:20.772424 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-28q7f\"" Jun 02 01:19:20.777289 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:20.777259 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-ngtbq"] Jun 02 01:19:20.806852 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:20.806819 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95k8n\" (UniqueName: \"kubernetes.io/projected/2d06caf5-d35d-496a-a9da-b67205830ef9-kube-api-access-95k8n\") pod \"authorino-f99f4b5cd-5gwjn\" (UID: \"2d06caf5-d35d-496a-a9da-b67205830ef9\") " pod="kuadrant-system/authorino-f99f4b5cd-5gwjn" Jun 02 01:19:20.814912 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:20.814889 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-ngtbq"] Jun 02 01:19:20.815000 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:20.814990 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-ngtbq" Jun 02 01:19:20.907830 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:20.907795 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-95k8n\" (UniqueName: \"kubernetes.io/projected/2d06caf5-d35d-496a-a9da-b67205830ef9-kube-api-access-95k8n\") pod \"authorino-f99f4b5cd-5gwjn\" (UID: \"2d06caf5-d35d-496a-a9da-b67205830ef9\") " pod="kuadrant-system/authorino-f99f4b5cd-5gwjn" Jun 02 01:19:20.907991 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:20.907906 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfzjz\" (UniqueName: \"kubernetes.io/projected/f143599d-0aec-4608-979a-dcb66c530211-kube-api-access-hfzjz\") pod \"authorino-7498df8756-ngtbq\" (UID: \"f143599d-0aec-4608-979a-dcb66c530211\") " pod="kuadrant-system/authorino-7498df8756-ngtbq" Jun 02 01:19:20.915860 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:20.915824 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95k8n\" (UniqueName: \"kubernetes.io/projected/2d06caf5-d35d-496a-a9da-b67205830ef9-kube-api-access-95k8n\") pod \"authorino-f99f4b5cd-5gwjn\" (UID: \"2d06caf5-d35d-496a-a9da-b67205830ef9\") " pod="kuadrant-system/authorino-f99f4b5cd-5gwjn" Jun 02 01:19:21.009225 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:21.009191 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hfzjz\" (UniqueName: \"kubernetes.io/projected/f143599d-0aec-4608-979a-dcb66c530211-kube-api-access-hfzjz\") pod \"authorino-7498df8756-ngtbq\" (UID: \"f143599d-0aec-4608-979a-dcb66c530211\") " pod="kuadrant-system/authorino-7498df8756-ngtbq" Jun 02 01:19:21.017332 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:21.017306 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfzjz\" (UniqueName: \"kubernetes.io/projected/f143599d-0aec-4608-979a-dcb66c530211-kube-api-access-hfzjz\") pod \"authorino-7498df8756-ngtbq\" (UID: \"f143599d-0aec-4608-979a-dcb66c530211\") " pod="kuadrant-system/authorino-7498df8756-ngtbq" Jun 02 01:19:21.079162 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:21.079126 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-5gwjn" Jun 02 01:19:21.123968 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:21.123927 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-ngtbq" Jun 02 01:19:21.214567 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:21.214498 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-5gwjn"] Jun 02 01:19:21.217535 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:19:21.217506 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d06caf5_d35d_496a_a9da_b67205830ef9.slice/crio-370ac478bdb29b391063007377b09a53415233dcbbb5e9fa9871c9eb7f08823d WatchSource:0}: Error finding container 370ac478bdb29b391063007377b09a53415233dcbbb5e9fa9871c9eb7f08823d: Status 404 returned error can't find the container with id 370ac478bdb29b391063007377b09a53415233dcbbb5e9fa9871c9eb7f08823d Jun 02 01:19:21.262467 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:21.262245 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-ngtbq"] Jun 02 01:19:21.265048 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:19:21.265019 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf143599d_0aec_4608_979a_dcb66c530211.slice/crio-21898950e87b3072aba81a0604e0c05bb3d4d1e4553598e59a7f646c4cb239d4 WatchSource:0}: Error finding container 21898950e87b3072aba81a0604e0c05bb3d4d1e4553598e59a7f646c4cb239d4: Status 404 returned error can't find the container with id 21898950e87b3072aba81a0604e0c05bb3d4d1e4553598e59a7f646c4cb239d4 Jun 02 01:19:22.010430 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:22.010388 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-5gwjn" event={"ID":"2d06caf5-d35d-496a-a9da-b67205830ef9","Type":"ContainerStarted","Data":"370ac478bdb29b391063007377b09a53415233dcbbb5e9fa9871c9eb7f08823d"} Jun 02 01:19:22.011340 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:22.011315 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-ngtbq" event={"ID":"f143599d-0aec-4608-979a-dcb66c530211","Type":"ContainerStarted","Data":"21898950e87b3072aba81a0604e0c05bb3d4d1e4553598e59a7f646c4cb239d4"} Jun 02 01:19:27.033565 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:27.033524 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-5gwjn" event={"ID":"2d06caf5-d35d-496a-a9da-b67205830ef9","Type":"ContainerStarted","Data":"9f9e61bbe9a5fc629ff8a9669a3a6c057341baef2ff7e20c9ca37500fda702b8"} Jun 02 01:19:27.034822 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:27.034797 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-ngtbq" event={"ID":"f143599d-0aec-4608-979a-dcb66c530211","Type":"ContainerStarted","Data":"e0789ab7ffdde6ce098dc0e6226a4c5c3d5a7e98388ef3c65c745860f04ebcee"} Jun 02 01:19:27.048602 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:27.048541 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-5gwjn" podStartSLOduration=2.026749112 podStartE2EDuration="7.048527667s" podCreationTimestamp="2026-06-02 01:19:20 +0000 UTC" firstStartedPulling="2026-06-02 01:19:21.219315368 +0000 UTC m=+505.389857537" lastFinishedPulling="2026-06-02 01:19:26.241093926 +0000 UTC m=+510.411636092" observedRunningTime="2026-06-02 01:19:27.047594735 +0000 UTC m=+511.218136921" watchObservedRunningTime="2026-06-02 01:19:27.048527667 +0000 UTC m=+511.219069850" Jun 02 01:19:27.061064 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:27.061013 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-ngtbq" podStartSLOduration=2.098998406 podStartE2EDuration="7.060998913s" podCreationTimestamp="2026-06-02 01:19:20 +0000 UTC" firstStartedPulling="2026-06-02 01:19:21.266356786 +0000 UTC m=+505.436898950" lastFinishedPulling="2026-06-02 01:19:26.228357285 +0000 UTC m=+510.398899457" observedRunningTime="2026-06-02 01:19:27.060300897 +0000 UTC m=+511.230843086" watchObservedRunningTime="2026-06-02 01:19:27.060998913 +0000 UTC m=+511.231541098" Jun 02 01:19:27.084603 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:27.084564 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-5gwjn"] Jun 02 01:19:29.041430 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:29.041351 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-5gwjn" podUID="2d06caf5-d35d-496a-a9da-b67205830ef9" containerName="authorino" containerID="cri-o://9f9e61bbe9a5fc629ff8a9669a3a6c057341baef2ff7e20c9ca37500fda702b8" gracePeriod=30 Jun 02 01:19:29.289385 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:29.289349 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-5gwjn" Jun 02 01:19:29.386773 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:29.386690 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95k8n\" (UniqueName: \"kubernetes.io/projected/2d06caf5-d35d-496a-a9da-b67205830ef9-kube-api-access-95k8n\") pod \"2d06caf5-d35d-496a-a9da-b67205830ef9\" (UID: \"2d06caf5-d35d-496a-a9da-b67205830ef9\") " Jun 02 01:19:29.388893 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:29.388870 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d06caf5-d35d-496a-a9da-b67205830ef9-kube-api-access-95k8n" (OuterVolumeSpecName: "kube-api-access-95k8n") pod "2d06caf5-d35d-496a-a9da-b67205830ef9" (UID: "2d06caf5-d35d-496a-a9da-b67205830ef9"). InnerVolumeSpecName "kube-api-access-95k8n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:19:29.487514 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:29.487480 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95k8n\" (UniqueName: \"kubernetes.io/projected/2d06caf5-d35d-496a-a9da-b67205830ef9-kube-api-access-95k8n\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\"" Jun 02 01:19:30.045967 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:30.045936 2576 generic.go:358] "Generic (PLEG): container finished" podID="2d06caf5-d35d-496a-a9da-b67205830ef9" containerID="9f9e61bbe9a5fc629ff8a9669a3a6c057341baef2ff7e20c9ca37500fda702b8" exitCode=0 Jun 02 01:19:30.046432 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:30.045987 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-5gwjn" Jun 02 01:19:30.046432 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:30.045985 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-5gwjn" event={"ID":"2d06caf5-d35d-496a-a9da-b67205830ef9","Type":"ContainerDied","Data":"9f9e61bbe9a5fc629ff8a9669a3a6c057341baef2ff7e20c9ca37500fda702b8"} Jun 02 01:19:30.046432 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:30.046090 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-5gwjn" event={"ID":"2d06caf5-d35d-496a-a9da-b67205830ef9","Type":"ContainerDied","Data":"370ac478bdb29b391063007377b09a53415233dcbbb5e9fa9871c9eb7f08823d"} Jun 02 01:19:30.046432 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:30.046115 2576 scope.go:117] "RemoveContainer" containerID="9f9e61bbe9a5fc629ff8a9669a3a6c057341baef2ff7e20c9ca37500fda702b8" Jun 02 01:19:30.054440 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:30.054415 2576 scope.go:117] "RemoveContainer" containerID="9f9e61bbe9a5fc629ff8a9669a3a6c057341baef2ff7e20c9ca37500fda702b8" Jun 02 01:19:30.054718 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:19:30.054700 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f9e61bbe9a5fc629ff8a9669a3a6c057341baef2ff7e20c9ca37500fda702b8\": container with ID starting with 9f9e61bbe9a5fc629ff8a9669a3a6c057341baef2ff7e20c9ca37500fda702b8 not found: ID does not exist" containerID="9f9e61bbe9a5fc629ff8a9669a3a6c057341baef2ff7e20c9ca37500fda702b8" Jun 02 01:19:30.054770 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:30.054728 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f9e61bbe9a5fc629ff8a9669a3a6c057341baef2ff7e20c9ca37500fda702b8"} err="failed to get container status \"9f9e61bbe9a5fc629ff8a9669a3a6c057341baef2ff7e20c9ca37500fda702b8\": rpc error: code = NotFound desc = could not find container \"9f9e61bbe9a5fc629ff8a9669a3a6c057341baef2ff7e20c9ca37500fda702b8\": container with ID starting with 9f9e61bbe9a5fc629ff8a9669a3a6c057341baef2ff7e20c9ca37500fda702b8 not found: ID does not exist" Jun 02 01:19:30.066146 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:30.066114 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-5gwjn"] Jun 02 01:19:30.067562 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:30.067543 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-5gwjn"] Jun 02 01:19:30.406037 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:30.406007 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d06caf5-d35d-496a-a9da-b67205830ef9" path="/var/lib/kubelet/pods/2d06caf5-d35d-496a-a9da-b67205830ef9/volumes" Jun 02 01:19:53.401142 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:53.401105 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-jf6mc"] Jun 02 01:19:53.401853 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:53.401429 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d06caf5-d35d-496a-a9da-b67205830ef9" containerName="authorino" Jun 02 01:19:53.401853 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:53.401440 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d06caf5-d35d-496a-a9da-b67205830ef9" containerName="authorino" Jun 02 01:19:53.401853 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:53.401518 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="2d06caf5-d35d-496a-a9da-b67205830ef9" containerName="authorino" Jun 02 01:19:53.403352 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:53.403336 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-jf6mc" Jun 02 01:19:53.406009 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:53.405985 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-g46hp\"" Jun 02 01:19:53.406132 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:53.406023 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 01:19:53.407186 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:53.407167 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 01:19:53.411899 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:53.411875 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-jf6mc"] Jun 02 01:19:53.487996 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:53.487961 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9pt7\" (UniqueName: \"kubernetes.io/projected/4b3aceb2-fd2a-4f68-b7ed-3c9e6f4b8dbb-kube-api-access-d9pt7\") pod \"keycloak-operator-7864d68cbd-jf6mc\" (UID: \"4b3aceb2-fd2a-4f68-b7ed-3c9e6f4b8dbb\") " pod="keycloak-system/keycloak-operator-7864d68cbd-jf6mc" Jun 02 01:19:53.588414 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:53.588361 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d9pt7\" (UniqueName: \"kubernetes.io/projected/4b3aceb2-fd2a-4f68-b7ed-3c9e6f4b8dbb-kube-api-access-d9pt7\") pod \"keycloak-operator-7864d68cbd-jf6mc\" (UID: \"4b3aceb2-fd2a-4f68-b7ed-3c9e6f4b8dbb\") " pod="keycloak-system/keycloak-operator-7864d68cbd-jf6mc" Jun 02 01:19:53.597008 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:53.596983 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9pt7\" (UniqueName: \"kubernetes.io/projected/4b3aceb2-fd2a-4f68-b7ed-3c9e6f4b8dbb-kube-api-access-d9pt7\") pod \"keycloak-operator-7864d68cbd-jf6mc\" (UID: \"4b3aceb2-fd2a-4f68-b7ed-3c9e6f4b8dbb\") " pod="keycloak-system/keycloak-operator-7864d68cbd-jf6mc" Jun 02 01:19:53.714162 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:53.714129 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-jf6mc" Jun 02 01:19:53.844833 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:53.844795 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-jf6mc"] Jun 02 01:19:53.848526 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:19:53.848493 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b3aceb2_fd2a_4f68_b7ed_3c9e6f4b8dbb.slice/crio-ec074bf1d370c6e160de708b1cbdfb623f330938ec234305bd526081f296e9be WatchSource:0}: Error finding container ec074bf1d370c6e160de708b1cbdfb623f330938ec234305bd526081f296e9be: Status 404 returned error can't find the container with id ec074bf1d370c6e160de708b1cbdfb623f330938ec234305bd526081f296e9be Jun 02 01:19:54.124926 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:54.124828 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-jf6mc" event={"ID":"4b3aceb2-fd2a-4f68-b7ed-3c9e6f4b8dbb","Type":"ContainerStarted","Data":"ec074bf1d370c6e160de708b1cbdfb623f330938ec234305bd526081f296e9be"} Jun 02 01:19:59.145628 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:59.145528 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-jf6mc" event={"ID":"4b3aceb2-fd2a-4f68-b7ed-3c9e6f4b8dbb","Type":"ContainerStarted","Data":"bc7a2fc46f64b8612ee05eef2f111ebbcd2ce785e4543c3db1e1fe6ca452af47"} Jun 02 01:19:59.164405 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:19:59.164311 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-jf6mc" podStartSLOduration=1.357328081 podStartE2EDuration="6.164291063s" podCreationTimestamp="2026-06-02 01:19:53 +0000 UTC" firstStartedPulling="2026-06-02 01:19:53.849991235 +0000 UTC m=+538.020533399" lastFinishedPulling="2026-06-02 01:19:58.656954213 +0000 UTC m=+542.827496381" observedRunningTime="2026-06-02 01:19:59.162912627 +0000 UTC m=+543.333454814" watchObservedRunningTime="2026-06-02 01:19:59.164291063 +0000 UTC m=+543.334833254" Jun 02 01:20:37.488325 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:37.488287 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-ljpnp"] Jun 02 01:20:37.490575 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:37.490554 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-ljpnp" Jun 02 01:20:37.495723 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:37.495692 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-ljpnp"] Jun 02 01:20:37.657489 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:37.657443 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsvf9\" (UniqueName: \"kubernetes.io/projected/f48fc705-d530-41e7-bd86-8914439ae38a-kube-api-access-vsvf9\") pod \"authorino-8b475cf9f-ljpnp\" (UID: \"f48fc705-d530-41e7-bd86-8914439ae38a\") " pod="kuadrant-system/authorino-8b475cf9f-ljpnp" Jun 02 01:20:37.677754 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:37.677719 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-ljpnp"] Jun 02 01:20:37.678009 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:20:37.677984 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-vsvf9], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8b475cf9f-ljpnp" podUID="f48fc705-d530-41e7-bd86-8914439ae38a" Jun 02 01:20:37.703365 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:37.703331 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56fdd757f5-f4ffw"] Jun 02 01:20:37.705430 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:37.705413 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-f4ffw" Jun 02 01:20:37.707725 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:37.707699 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 02 01:20:37.714005 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:37.713978 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-f4ffw"] Jun 02 01:20:37.737123 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:37.737081 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-f4ffw"] Jun 02 01:20:37.737364 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:20:37.737340 2576 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-d7xl8 tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-d7xl8 tls-cert]: context canceled" pod="kuadrant-system/authorino-56fdd757f5-f4ffw" podUID="9bea5344-1c53-476b-b83e-da5d817e7e81" Jun 02 01:20:37.758880 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:37.758791 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vsvf9\" (UniqueName: \"kubernetes.io/projected/f48fc705-d530-41e7-bd86-8914439ae38a-kube-api-access-vsvf9\") pod \"authorino-8b475cf9f-ljpnp\" (UID: \"f48fc705-d530-41e7-bd86-8914439ae38a\") " pod="kuadrant-system/authorino-8b475cf9f-ljpnp" Jun 02 01:20:37.766596 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:37.766564 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-587d97d5f5-kkptb"] Jun 02 01:20:37.768672 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:37.768643 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-587d97d5f5-kkptb" Jun 02 01:20:37.769591 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:37.769573 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsvf9\" (UniqueName: \"kubernetes.io/projected/f48fc705-d530-41e7-bd86-8914439ae38a-kube-api-access-vsvf9\") pod \"authorino-8b475cf9f-ljpnp\" (UID: \"f48fc705-d530-41e7-bd86-8914439ae38a\") " pod="kuadrant-system/authorino-8b475cf9f-ljpnp" Jun 02 01:20:37.778909 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:37.778880 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-587d97d5f5-kkptb"] Jun 02 01:20:37.859971 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:37.859938 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9bea5344-1c53-476b-b83e-da5d817e7e81-tls-cert\") pod \"authorino-56fdd757f5-f4ffw\" (UID: \"9bea5344-1c53-476b-b83e-da5d817e7e81\") " pod="kuadrant-system/authorino-56fdd757f5-f4ffw" Jun 02 01:20:37.860165 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:37.859979 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/794e312e-ba36-4f3d-b1c8-fa1034cedb8b-tls-cert\") pod \"authorino-587d97d5f5-kkptb\" (UID: \"794e312e-ba36-4f3d-b1c8-fa1034cedb8b\") " pod="kuadrant-system/authorino-587d97d5f5-kkptb" Jun 02 01:20:37.860165 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:37.860002 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6j6q\" (UniqueName: \"kubernetes.io/projected/794e312e-ba36-4f3d-b1c8-fa1034cedb8b-kube-api-access-n6j6q\") pod \"authorino-587d97d5f5-kkptb\" (UID: \"794e312e-ba36-4f3d-b1c8-fa1034cedb8b\") " pod="kuadrant-system/authorino-587d97d5f5-kkptb" Jun 02 01:20:37.860165 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:37.860094 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7xl8\" (UniqueName: \"kubernetes.io/projected/9bea5344-1c53-476b-b83e-da5d817e7e81-kube-api-access-d7xl8\") pod \"authorino-56fdd757f5-f4ffw\" (UID: \"9bea5344-1c53-476b-b83e-da5d817e7e81\") " pod="kuadrant-system/authorino-56fdd757f5-f4ffw" Jun 02 01:20:37.960842 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:37.960800 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/794e312e-ba36-4f3d-b1c8-fa1034cedb8b-tls-cert\") pod \"authorino-587d97d5f5-kkptb\" (UID: \"794e312e-ba36-4f3d-b1c8-fa1034cedb8b\") " pod="kuadrant-system/authorino-587d97d5f5-kkptb" Jun 02 01:20:37.960842 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:37.960848 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n6j6q\" (UniqueName: \"kubernetes.io/projected/794e312e-ba36-4f3d-b1c8-fa1034cedb8b-kube-api-access-n6j6q\") pod \"authorino-587d97d5f5-kkptb\" (UID: \"794e312e-ba36-4f3d-b1c8-fa1034cedb8b\") " pod="kuadrant-system/authorino-587d97d5f5-kkptb" Jun 02 01:20:37.961113 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:37.960891 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d7xl8\" (UniqueName: \"kubernetes.io/projected/9bea5344-1c53-476b-b83e-da5d817e7e81-kube-api-access-d7xl8\") pod \"authorino-56fdd757f5-f4ffw\" (UID: \"9bea5344-1c53-476b-b83e-da5d817e7e81\") " pod="kuadrant-system/authorino-56fdd757f5-f4ffw" Jun 02 01:20:37.961113 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:37.960975 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9bea5344-1c53-476b-b83e-da5d817e7e81-tls-cert\") pod \"authorino-56fdd757f5-f4ffw\" (UID: \"9bea5344-1c53-476b-b83e-da5d817e7e81\") " pod="kuadrant-system/authorino-56fdd757f5-f4ffw" Jun 02 01:20:37.963313 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:37.963289 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/794e312e-ba36-4f3d-b1c8-fa1034cedb8b-tls-cert\") pod \"authorino-587d97d5f5-kkptb\" (UID: \"794e312e-ba36-4f3d-b1c8-fa1034cedb8b\") " pod="kuadrant-system/authorino-587d97d5f5-kkptb" Jun 02 01:20:37.963313 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:37.963309 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9bea5344-1c53-476b-b83e-da5d817e7e81-tls-cert\") pod \"authorino-56fdd757f5-f4ffw\" (UID: \"9bea5344-1c53-476b-b83e-da5d817e7e81\") " pod="kuadrant-system/authorino-56fdd757f5-f4ffw" Jun 02 01:20:37.968122 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:37.968098 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7xl8\" (UniqueName: \"kubernetes.io/projected/9bea5344-1c53-476b-b83e-da5d817e7e81-kube-api-access-d7xl8\") pod \"authorino-56fdd757f5-f4ffw\" (UID: \"9bea5344-1c53-476b-b83e-da5d817e7e81\") " pod="kuadrant-system/authorino-56fdd757f5-f4ffw" Jun 02 01:20:37.968122 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:37.968122 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6j6q\" (UniqueName: \"kubernetes.io/projected/794e312e-ba36-4f3d-b1c8-fa1034cedb8b-kube-api-access-n6j6q\") pod \"authorino-587d97d5f5-kkptb\" (UID: \"794e312e-ba36-4f3d-b1c8-fa1034cedb8b\") " pod="kuadrant-system/authorino-587d97d5f5-kkptb" Jun 02 01:20:38.087018 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:38.086912 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-587d97d5f5-kkptb" Jun 02 01:20:38.218724 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:38.218700 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-587d97d5f5-kkptb"] Jun 02 01:20:38.221413 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:20:38.221379 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod794e312e_ba36_4f3d_b1c8_fa1034cedb8b.slice/crio-9f9feb01d41926825fe300643277a41c47181cd5525fed284c6a510a6706955f WatchSource:0}: Error finding container 9f9feb01d41926825fe300643277a41c47181cd5525fed284c6a510a6706955f: Status 404 returned error can't find the container with id 9f9feb01d41926825fe300643277a41c47181cd5525fed284c6a510a6706955f Jun 02 01:20:38.274089 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:38.274049 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-587d97d5f5-kkptb" event={"ID":"794e312e-ba36-4f3d-b1c8-fa1034cedb8b","Type":"ContainerStarted","Data":"9f9feb01d41926825fe300643277a41c47181cd5525fed284c6a510a6706955f"} Jun 02 01:20:38.274257 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:38.274117 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-f4ffw" Jun 02 01:20:38.274257 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:38.274124 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-ljpnp" Jun 02 01:20:38.278842 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:38.278819 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-f4ffw" Jun 02 01:20:38.282043 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:38.282021 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-ljpnp" Jun 02 01:20:38.364283 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:38.364192 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7xl8\" (UniqueName: \"kubernetes.io/projected/9bea5344-1c53-476b-b83e-da5d817e7e81-kube-api-access-d7xl8\") pod \"9bea5344-1c53-476b-b83e-da5d817e7e81\" (UID: \"9bea5344-1c53-476b-b83e-da5d817e7e81\") " Jun 02 01:20:38.364283 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:38.364237 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsvf9\" (UniqueName: \"kubernetes.io/projected/f48fc705-d530-41e7-bd86-8914439ae38a-kube-api-access-vsvf9\") pod \"f48fc705-d530-41e7-bd86-8914439ae38a\" (UID: \"f48fc705-d530-41e7-bd86-8914439ae38a\") " Jun 02 01:20:38.364283 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:38.364264 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9bea5344-1c53-476b-b83e-da5d817e7e81-tls-cert\") pod \"9bea5344-1c53-476b-b83e-da5d817e7e81\" (UID: \"9bea5344-1c53-476b-b83e-da5d817e7e81\") " Jun 02 01:20:38.366480 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:38.366451 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bea5344-1c53-476b-b83e-da5d817e7e81-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "9bea5344-1c53-476b-b83e-da5d817e7e81" (UID: "9bea5344-1c53-476b-b83e-da5d817e7e81"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:20:38.366480 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:38.366462 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bea5344-1c53-476b-b83e-da5d817e7e81-kube-api-access-d7xl8" (OuterVolumeSpecName: "kube-api-access-d7xl8") pod "9bea5344-1c53-476b-b83e-da5d817e7e81" (UID: "9bea5344-1c53-476b-b83e-da5d817e7e81"). InnerVolumeSpecName "kube-api-access-d7xl8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:20:38.366646 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:38.366486 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f48fc705-d530-41e7-bd86-8914439ae38a-kube-api-access-vsvf9" (OuterVolumeSpecName: "kube-api-access-vsvf9") pod "f48fc705-d530-41e7-bd86-8914439ae38a" (UID: "f48fc705-d530-41e7-bd86-8914439ae38a"). InnerVolumeSpecName "kube-api-access-vsvf9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:20:38.465491 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:38.465461 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7xl8\" (UniqueName: \"kubernetes.io/projected/9bea5344-1c53-476b-b83e-da5d817e7e81-kube-api-access-d7xl8\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\"" Jun 02 01:20:38.465491 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:38.465489 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsvf9\" (UniqueName: \"kubernetes.io/projected/f48fc705-d530-41e7-bd86-8914439ae38a-kube-api-access-vsvf9\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\"" Jun 02 01:20:38.465491 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:38.465500 2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9bea5344-1c53-476b-b83e-da5d817e7e81-tls-cert\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\"" Jun 02 01:20:39.278594 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:39.278545 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-587d97d5f5-kkptb" event={"ID":"794e312e-ba36-4f3d-b1c8-fa1034cedb8b","Type":"ContainerStarted","Data":"dac1c091cd6510cd9c901c6454a5e051ba7e5ebe4be5be648972ca8702f07486"} Jun 02 01:20:39.278594 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:39.278590 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-f4ffw" Jun 02 01:20:39.279056 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:39.278563 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-ljpnp" Jun 02 01:20:39.294738 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:39.294691 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-587d97d5f5-kkptb" podStartSLOduration=1.9962668639999999 podStartE2EDuration="2.294677602s" podCreationTimestamp="2026-06-02 01:20:37 +0000 UTC" firstStartedPulling="2026-06-02 01:20:38.222723677 +0000 UTC m=+582.393265841" lastFinishedPulling="2026-06-02 01:20:38.521134411 +0000 UTC m=+582.691676579" observedRunningTime="2026-06-02 01:20:39.293349993 +0000 UTC m=+583.463892179" watchObservedRunningTime="2026-06-02 01:20:39.294677602 +0000 UTC m=+583.465219788" Jun 02 01:20:39.318033 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:39.318000 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-ngtbq"] Jun 02 01:20:39.318284 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:39.318232 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-ngtbq" podUID="f143599d-0aec-4608-979a-dcb66c530211" containerName="authorino" containerID="cri-o://e0789ab7ffdde6ce098dc0e6226a4c5c3d5a7e98388ef3c65c745860f04ebcee" gracePeriod=30 Jun 02 01:20:39.322059 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:39.322003 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-ljpnp"] Jun 02 01:20:39.329814 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:39.329785 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-ljpnp"] Jun 02 01:20:39.352632 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:39.352600 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-f4ffw"] Jun 02 01:20:39.354596 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:39.354565 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-f4ffw"] Jun 02 01:20:39.563169 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:39.563143 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-ngtbq" Jun 02 01:20:39.674927 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:39.674885 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfzjz\" (UniqueName: \"kubernetes.io/projected/f143599d-0aec-4608-979a-dcb66c530211-kube-api-access-hfzjz\") pod \"f143599d-0aec-4608-979a-dcb66c530211\" (UID: \"f143599d-0aec-4608-979a-dcb66c530211\") " Jun 02 01:20:39.676965 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:39.676934 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f143599d-0aec-4608-979a-dcb66c530211-kube-api-access-hfzjz" (OuterVolumeSpecName: "kube-api-access-hfzjz") pod "f143599d-0aec-4608-979a-dcb66c530211" (UID: "f143599d-0aec-4608-979a-dcb66c530211"). InnerVolumeSpecName "kube-api-access-hfzjz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:20:39.776362 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:39.776324 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfzjz\" (UniqueName: \"kubernetes.io/projected/f143599d-0aec-4608-979a-dcb66c530211-kube-api-access-hfzjz\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\"" Jun 02 01:20:40.282572 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:40.282538 2576 generic.go:358] "Generic (PLEG): container finished" podID="f143599d-0aec-4608-979a-dcb66c530211" containerID="e0789ab7ffdde6ce098dc0e6226a4c5c3d5a7e98388ef3c65c745860f04ebcee" exitCode=0 Jun 02 01:20:40.283035 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:40.282585 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-ngtbq" Jun 02 01:20:40.283035 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:40.282624 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-ngtbq" event={"ID":"f143599d-0aec-4608-979a-dcb66c530211","Type":"ContainerDied","Data":"e0789ab7ffdde6ce098dc0e6226a4c5c3d5a7e98388ef3c65c745860f04ebcee"} Jun 02 01:20:40.283035 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:40.282664 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-ngtbq" event={"ID":"f143599d-0aec-4608-979a-dcb66c530211","Type":"ContainerDied","Data":"21898950e87b3072aba81a0604e0c05bb3d4d1e4553598e59a7f646c4cb239d4"} Jun 02 01:20:40.283035 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:40.282713 2576 scope.go:117] "RemoveContainer" containerID="e0789ab7ffdde6ce098dc0e6226a4c5c3d5a7e98388ef3c65c745860f04ebcee" Jun 02 01:20:40.291339 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:40.291321 2576 scope.go:117] "RemoveContainer" containerID="e0789ab7ffdde6ce098dc0e6226a4c5c3d5a7e98388ef3c65c745860f04ebcee" Jun 02 01:20:40.291618 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:20:40.291601 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0789ab7ffdde6ce098dc0e6226a4c5c3d5a7e98388ef3c65c745860f04ebcee\": container with ID starting with e0789ab7ffdde6ce098dc0e6226a4c5c3d5a7e98388ef3c65c745860f04ebcee not found: ID does not exist" containerID="e0789ab7ffdde6ce098dc0e6226a4c5c3d5a7e98388ef3c65c745860f04ebcee" Jun 02 01:20:40.291673 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:40.291625 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0789ab7ffdde6ce098dc0e6226a4c5c3d5a7e98388ef3c65c745860f04ebcee"} err="failed to get container status \"e0789ab7ffdde6ce098dc0e6226a4c5c3d5a7e98388ef3c65c745860f04ebcee\": rpc error: code = NotFound desc = could not find container \"e0789ab7ffdde6ce098dc0e6226a4c5c3d5a7e98388ef3c65c745860f04ebcee\": container with ID starting with e0789ab7ffdde6ce098dc0e6226a4c5c3d5a7e98388ef3c65c745860f04ebcee not found: ID does not exist" Jun 02 01:20:40.304706 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:40.304684 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-ngtbq"] Jun 02 01:20:40.308325 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:40.308301 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-ngtbq"] Jun 02 01:20:40.406604 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:40.406574 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bea5344-1c53-476b-b83e-da5d817e7e81" path="/var/lib/kubelet/pods/9bea5344-1c53-476b-b83e-da5d817e7e81/volumes" Jun 02 01:20:40.406791 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:40.406779 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f143599d-0aec-4608-979a-dcb66c530211" path="/var/lib/kubelet/pods/f143599d-0aec-4608-979a-dcb66c530211/volumes" Jun 02 01:20:40.407062 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:40.407051 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f48fc705-d530-41e7-bd86-8914439ae38a" path="/var/lib/kubelet/pods/f48fc705-d530-41e7-bd86-8914439ae38a/volumes" Jun 02 01:20:56.312530 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:56.312499 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lkf95_b6d9386e-1aeb-41d2-8b3d-0a088b8724cb/ovn-acl-logging/0.log" Jun 02 01:20:56.312965 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:20:56.312600 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lkf95_b6d9386e-1aeb-41d2-8b3d-0a088b8724cb/ovn-acl-logging/0.log" Jun 02 01:22:16.223572 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:16.223535 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-65df6ddff7-zftpf"] Jun 02 01:22:16.224043 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:16.223873 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f143599d-0aec-4608-979a-dcb66c530211" containerName="authorino" Jun 02 01:22:16.224043 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:16.223885 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f143599d-0aec-4608-979a-dcb66c530211" containerName="authorino" Jun 02 01:22:16.224043 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:16.223952 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="f143599d-0aec-4608-979a-dcb66c530211" containerName="authorino" Jun 02 01:22:16.226294 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:16.226276 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65df6ddff7-zftpf" Jun 02 01:22:16.228667 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:16.228649 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 02 01:22:16.236482 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:16.236460 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65df6ddff7-zftpf"] Jun 02 01:22:16.345232 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:16.345191 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d85549eb-6903-4a08-8787-b758a454f355-oidc-ca\") pod \"authorino-65df6ddff7-zftpf\" (UID: \"d85549eb-6903-4a08-8787-b758a454f355\") " pod="kuadrant-system/authorino-65df6ddff7-zftpf" Jun 02 01:22:16.345452 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:16.345265 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d85549eb-6903-4a08-8787-b758a454f355-tls-cert\") pod \"authorino-65df6ddff7-zftpf\" (UID: \"d85549eb-6903-4a08-8787-b758a454f355\") " pod="kuadrant-system/authorino-65df6ddff7-zftpf" Jun 02 01:22:16.345452 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:16.345364 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwzfm\" (UniqueName: \"kubernetes.io/projected/d85549eb-6903-4a08-8787-b758a454f355-kube-api-access-rwzfm\") pod \"authorino-65df6ddff7-zftpf\" (UID: \"d85549eb-6903-4a08-8787-b758a454f355\") " pod="kuadrant-system/authorino-65df6ddff7-zftpf" Jun 02 01:22:16.446831 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:16.446790 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d85549eb-6903-4a08-8787-b758a454f355-tls-cert\") pod \"authorino-65df6ddff7-zftpf\" (UID: \"d85549eb-6903-4a08-8787-b758a454f355\") " pod="kuadrant-system/authorino-65df6ddff7-zftpf" Jun 02 01:22:16.446831 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:16.446837 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rwzfm\" (UniqueName: \"kubernetes.io/projected/d85549eb-6903-4a08-8787-b758a454f355-kube-api-access-rwzfm\") pod \"authorino-65df6ddff7-zftpf\" (UID: \"d85549eb-6903-4a08-8787-b758a454f355\") " pod="kuadrant-system/authorino-65df6ddff7-zftpf" Jun 02 01:22:16.447088 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:16.446875 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d85549eb-6903-4a08-8787-b758a454f355-oidc-ca\") pod \"authorino-65df6ddff7-zftpf\" (UID: \"d85549eb-6903-4a08-8787-b758a454f355\") " pod="kuadrant-system/authorino-65df6ddff7-zftpf" Jun 02 01:22:16.447481 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:16.447461 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d85549eb-6903-4a08-8787-b758a454f355-oidc-ca\") pod \"authorino-65df6ddff7-zftpf\" (UID: \"d85549eb-6903-4a08-8787-b758a454f355\") " pod="kuadrant-system/authorino-65df6ddff7-zftpf" Jun 02 01:22:16.449445 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:16.449420 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d85549eb-6903-4a08-8787-b758a454f355-tls-cert\") pod \"authorino-65df6ddff7-zftpf\" (UID: \"d85549eb-6903-4a08-8787-b758a454f355\") " pod="kuadrant-system/authorino-65df6ddff7-zftpf" Jun 02 01:22:16.454697 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:16.454677 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwzfm\" (UniqueName: \"kubernetes.io/projected/d85549eb-6903-4a08-8787-b758a454f355-kube-api-access-rwzfm\") pod \"authorino-65df6ddff7-zftpf\" (UID: \"d85549eb-6903-4a08-8787-b758a454f355\") " pod="kuadrant-system/authorino-65df6ddff7-zftpf" Jun 02 01:22:16.535607 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:16.535511 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65df6ddff7-zftpf" Jun 02 01:22:16.661451 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:16.661423 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65df6ddff7-zftpf"] Jun 02 01:22:16.664089 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:22:16.664046 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd85549eb_6903_4a08_8787_b758a454f355.slice/crio-5eac1547de7a28f0665de0a223590737e0ccccb4cfe902c5a34fd455e641fb41 WatchSource:0}: Error finding container 5eac1547de7a28f0665de0a223590737e0ccccb4cfe902c5a34fd455e641fb41: Status 404 returned error can't find the container with id 5eac1547de7a28f0665de0a223590737e0ccccb4cfe902c5a34fd455e641fb41 Jun 02 01:22:16.665403 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:16.665364 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 01:22:17.592882 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:17.592843 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65df6ddff7-zftpf" event={"ID":"d85549eb-6903-4a08-8787-b758a454f355","Type":"ContainerStarted","Data":"65c1c6d4ca556ad130148a88982d185606bc1c18857b0d3eb57c97f709dfd5e3"} Jun 02 01:22:17.592882 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:17.592883 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65df6ddff7-zftpf" event={"ID":"d85549eb-6903-4a08-8787-b758a454f355","Type":"ContainerStarted","Data":"5eac1547de7a28f0665de0a223590737e0ccccb4cfe902c5a34fd455e641fb41"} Jun 02 01:22:17.611285 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:17.611232 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-65df6ddff7-zftpf" podStartSLOduration=1.293209112 podStartE2EDuration="1.611217396s" podCreationTimestamp="2026-06-02 01:22:16 +0000 UTC" firstStartedPulling="2026-06-02 01:22:16.665569832 +0000 UTC m=+680.836111997" lastFinishedPulling="2026-06-02 01:22:16.983578113 +0000 UTC m=+681.154120281" observedRunningTime="2026-06-02 01:22:17.609740229 +0000 UTC m=+681.780282419" watchObservedRunningTime="2026-06-02 01:22:17.611217396 +0000 UTC m=+681.781759579" Jun 02 01:22:17.641053 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:17.641008 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-587d97d5f5-kkptb"] Jun 02 01:22:17.641300 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:17.641275 2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-587d97d5f5-kkptb" podUID="794e312e-ba36-4f3d-b1c8-fa1034cedb8b" containerName="authorino" containerID="cri-o://dac1c091cd6510cd9c901c6454a5e051ba7e5ebe4be5be648972ca8702f07486" gracePeriod=30 Jun 02 01:22:17.896638 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:17.896615 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-587d97d5f5-kkptb" Jun 02 01:22:17.961566 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:17.961523 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/794e312e-ba36-4f3d-b1c8-fa1034cedb8b-tls-cert\") pod \"794e312e-ba36-4f3d-b1c8-fa1034cedb8b\" (UID: \"794e312e-ba36-4f3d-b1c8-fa1034cedb8b\") " Jun 02 01:22:17.961566 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:17.961573 2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6j6q\" (UniqueName: \"kubernetes.io/projected/794e312e-ba36-4f3d-b1c8-fa1034cedb8b-kube-api-access-n6j6q\") pod \"794e312e-ba36-4f3d-b1c8-fa1034cedb8b\" (UID: \"794e312e-ba36-4f3d-b1c8-fa1034cedb8b\") " Jun 02 01:22:17.963663 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:17.963632 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/794e312e-ba36-4f3d-b1c8-fa1034cedb8b-kube-api-access-n6j6q" (OuterVolumeSpecName: "kube-api-access-n6j6q") pod "794e312e-ba36-4f3d-b1c8-fa1034cedb8b" (UID: "794e312e-ba36-4f3d-b1c8-fa1034cedb8b"). InnerVolumeSpecName "kube-api-access-n6j6q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:22:17.971197 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:17.971174 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/794e312e-ba36-4f3d-b1c8-fa1034cedb8b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "794e312e-ba36-4f3d-b1c8-fa1034cedb8b" (UID: "794e312e-ba36-4f3d-b1c8-fa1034cedb8b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:22:18.062483 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:18.062446 2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/794e312e-ba36-4f3d-b1c8-fa1034cedb8b-tls-cert\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\"" Jun 02 01:22:18.062483 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:18.062478 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6j6q\" (UniqueName: \"kubernetes.io/projected/794e312e-ba36-4f3d-b1c8-fa1034cedb8b-kube-api-access-n6j6q\") on node \"ip-10-0-138-192.ec2.internal\" DevicePath \"\"" Jun 02 01:22:18.597681 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:18.597640 2576 generic.go:358] "Generic (PLEG): container finished" podID="794e312e-ba36-4f3d-b1c8-fa1034cedb8b" containerID="dac1c091cd6510cd9c901c6454a5e051ba7e5ebe4be5be648972ca8702f07486" exitCode=0 Jun 02 01:22:18.598134 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:18.597689 2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-587d97d5f5-kkptb" Jun 02 01:22:18.598134 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:18.597724 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-587d97d5f5-kkptb" event={"ID":"794e312e-ba36-4f3d-b1c8-fa1034cedb8b","Type":"ContainerDied","Data":"dac1c091cd6510cd9c901c6454a5e051ba7e5ebe4be5be648972ca8702f07486"} Jun 02 01:22:18.598134 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:18.597760 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-587d97d5f5-kkptb" event={"ID":"794e312e-ba36-4f3d-b1c8-fa1034cedb8b","Type":"ContainerDied","Data":"9f9feb01d41926825fe300643277a41c47181cd5525fed284c6a510a6706955f"} Jun 02 01:22:18.598134 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:18.597775 2576 scope.go:117] "RemoveContainer" containerID="dac1c091cd6510cd9c901c6454a5e051ba7e5ebe4be5be648972ca8702f07486" Jun 02 01:22:18.605487 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:18.605470 2576 scope.go:117] "RemoveContainer" containerID="dac1c091cd6510cd9c901c6454a5e051ba7e5ebe4be5be648972ca8702f07486" Jun 02 01:22:18.605738 ip-10-0-138-192 kubenswrapper[2576]: E0602 01:22:18.605722 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dac1c091cd6510cd9c901c6454a5e051ba7e5ebe4be5be648972ca8702f07486\": container with ID starting with dac1c091cd6510cd9c901c6454a5e051ba7e5ebe4be5be648972ca8702f07486 not found: ID does not exist" containerID="dac1c091cd6510cd9c901c6454a5e051ba7e5ebe4be5be648972ca8702f07486" Jun 02 01:22:18.605788 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:18.605746 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dac1c091cd6510cd9c901c6454a5e051ba7e5ebe4be5be648972ca8702f07486"} err="failed to get container status \"dac1c091cd6510cd9c901c6454a5e051ba7e5ebe4be5be648972ca8702f07486\": rpc error: code = NotFound desc = could not find container \"dac1c091cd6510cd9c901c6454a5e051ba7e5ebe4be5be648972ca8702f07486\": container with ID starting with dac1c091cd6510cd9c901c6454a5e051ba7e5ebe4be5be648972ca8702f07486 not found: ID does not exist" Jun 02 01:22:18.616471 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:18.616446 2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-587d97d5f5-kkptb"] Jun 02 01:22:18.620382 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:18.620355 2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-587d97d5f5-kkptb"] Jun 02 01:22:20.406291 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:22:20.406258 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="794e312e-ba36-4f3d-b1c8-fa1034cedb8b" path="/var/lib/kubelet/pods/794e312e-ba36-4f3d-b1c8-fa1034cedb8b/volumes" Jun 02 01:25:56.333483 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:25:56.333449 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lkf95_b6d9386e-1aeb-41d2-8b3d-0a088b8724cb/ovn-acl-logging/0.log" Jun 02 01:25:56.334301 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:25:56.334273 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lkf95_b6d9386e-1aeb-41d2-8b3d-0a088b8724cb/ovn-acl-logging/0.log" Jun 02 01:29:12.144349 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:12.144306 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65df6ddff7-zftpf_d85549eb-6903-4a08-8787-b758a454f355/authorino/0.log" Jun 02 01:29:17.285892 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:17.285853 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-qjb25_35788916-3d12-4853-a10f-9777ae6437f0/manager/0.log" Jun 02 01:29:17.632563 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:17.632485 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bc8cb464b-vrxh5_2df97e6c-d5b2-4a64-9499-f2eeb25c397c/copy-manifests/0.log" Jun 02 01:29:17.650330 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:17.650296 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bc8cb464b-vrxh5_2df97e6c-d5b2-4a64-9499-f2eeb25c397c/manager/0.log" Jun 02 01:29:18.972695 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:18.972665 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65df6ddff7-zftpf_d85549eb-6903-4a08-8787-b758a454f355/authorino/0.log" Jun 02 01:29:19.298606 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:19.298529 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-8htjt_a19c1673-455c-4dcb-946c-f80ff1ecf71f/kuadrant-console-plugin/0.log" Jun 02 01:29:20.294702 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:20.294659 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-549c788894-cwgdw_49161927-e4b0-4e88-b7cb-cc7ad395a21f/kube-auth-proxy/0.log" Jun 02 01:29:25.261698 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:25.261659 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2tbbt/must-gather-chbrk"] Jun 02 01:29:25.262124 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:25.261947 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="794e312e-ba36-4f3d-b1c8-fa1034cedb8b" containerName="authorino" Jun 02 01:29:25.262124 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:25.261957 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="794e312e-ba36-4f3d-b1c8-fa1034cedb8b" containerName="authorino" Jun 02 01:29:25.267271 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:25.262618 2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="794e312e-ba36-4f3d-b1c8-fa1034cedb8b" containerName="authorino" Jun 02 01:29:25.267271 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:25.266666 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2tbbt/must-gather-chbrk" Jun 02 01:29:25.271625 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:25.271604 2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2tbbt\"/\"default-dockercfg-w25v7\"" Jun 02 01:29:25.272148 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:25.272132 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2tbbt\"/\"kube-root-ca.crt\"" Jun 02 01:29:25.272732 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:25.272714 2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2tbbt\"/\"openshift-service-ca.crt\"" Jun 02 01:29:25.300095 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:25.300060 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2tbbt/must-gather-chbrk"] Jun 02 01:29:25.393280 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:25.393242 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsm9d\" (UniqueName: \"kubernetes.io/projected/cdc1a49d-99e3-406a-878b-98d7c91a1da8-kube-api-access-nsm9d\") pod \"must-gather-chbrk\" (UID: \"cdc1a49d-99e3-406a-878b-98d7c91a1da8\") " pod="openshift-must-gather-2tbbt/must-gather-chbrk" Jun 02 01:29:25.393280 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:25.393292 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cdc1a49d-99e3-406a-878b-98d7c91a1da8-must-gather-output\") pod \"must-gather-chbrk\" (UID: \"cdc1a49d-99e3-406a-878b-98d7c91a1da8\") " pod="openshift-must-gather-2tbbt/must-gather-chbrk" Jun 02 01:29:25.494108 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:25.494060 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cdc1a49d-99e3-406a-878b-98d7c91a1da8-must-gather-output\") pod \"must-gather-chbrk\" (UID: \"cdc1a49d-99e3-406a-878b-98d7c91a1da8\") " pod="openshift-must-gather-2tbbt/must-gather-chbrk" Jun 02 01:29:25.494312 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:25.494219 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nsm9d\" (UniqueName: \"kubernetes.io/projected/cdc1a49d-99e3-406a-878b-98d7c91a1da8-kube-api-access-nsm9d\") pod \"must-gather-chbrk\" (UID: \"cdc1a49d-99e3-406a-878b-98d7c91a1da8\") " pod="openshift-must-gather-2tbbt/must-gather-chbrk" Jun 02 01:29:25.494493 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:25.494469 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cdc1a49d-99e3-406a-878b-98d7c91a1da8-must-gather-output\") pod \"must-gather-chbrk\" (UID: \"cdc1a49d-99e3-406a-878b-98d7c91a1da8\") " pod="openshift-must-gather-2tbbt/must-gather-chbrk" Jun 02 01:29:25.502143 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:25.502124 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsm9d\" (UniqueName: \"kubernetes.io/projected/cdc1a49d-99e3-406a-878b-98d7c91a1da8-kube-api-access-nsm9d\") pod \"must-gather-chbrk\" (UID: \"cdc1a49d-99e3-406a-878b-98d7c91a1da8\") " pod="openshift-must-gather-2tbbt/must-gather-chbrk" Jun 02 01:29:25.576287 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:25.576187 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2tbbt/must-gather-chbrk" Jun 02 01:29:25.707462 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:25.707422 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2tbbt/must-gather-chbrk"] Jun 02 01:29:25.710706 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:29:25.710679 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcdc1a49d_99e3_406a_878b_98d7c91a1da8.slice/crio-e6ea5eb2a6bd1c8875237c27b832a81967ea2ae2264e4a8e00a886de2c60d0ab WatchSource:0}: Error finding container e6ea5eb2a6bd1c8875237c27b832a81967ea2ae2264e4a8e00a886de2c60d0ab: Status 404 returned error can't find the container with id e6ea5eb2a6bd1c8875237c27b832a81967ea2ae2264e4a8e00a886de2c60d0ab Jun 02 01:29:25.712545 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:25.712529 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 01:29:25.973537 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:25.973494 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2tbbt/must-gather-chbrk" event={"ID":"cdc1a49d-99e3-406a-878b-98d7c91a1da8","Type":"ContainerStarted","Data":"e6ea5eb2a6bd1c8875237c27b832a81967ea2ae2264e4a8e00a886de2c60d0ab"} Jun 02 01:29:26.979650 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:26.979613 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2tbbt/must-gather-chbrk" event={"ID":"cdc1a49d-99e3-406a-878b-98d7c91a1da8","Type":"ContainerStarted","Data":"04e094d96ff4fa6e300525fcd5759a9e743cc548e3abcdd6a86bcf080e0879c6"} Jun 02 01:29:26.979650 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:26.979652 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2tbbt/must-gather-chbrk" event={"ID":"cdc1a49d-99e3-406a-878b-98d7c91a1da8","Type":"ContainerStarted","Data":"b1c00a08f61e2f4b52b2ae8ddf053986adc2690eda6bdf24682c22c89e0acff9"} Jun 02 01:29:26.994168 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:26.994107 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-2tbbt/must-gather-chbrk" podStartSLOduration=1.190241892 podStartE2EDuration="1.994088692s" podCreationTimestamp="2026-06-02 01:29:25 +0000 UTC" firstStartedPulling="2026-06-02 01:29:25.712654918 +0000 UTC m=+1109.883197084" lastFinishedPulling="2026-06-02 01:29:26.51650172 +0000 UTC m=+1110.687043884" observedRunningTime="2026-06-02 01:29:26.993122859 +0000 UTC m=+1111.163665046" watchObservedRunningTime="2026-06-02 01:29:26.994088692 +0000 UTC m=+1111.164630878" Jun 02 01:29:28.196691 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:28.196655 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9vgbz_c1c5551b-2582-4854-a096-4f09a7acaf9b/global-pull-secret-syncer/0.log" Jun 02 01:29:28.367263 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:28.367235 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-k7hnj_f2d9cb2f-663e-4816-8cd2-9c197fe85ece/konnectivity-agent/0.log" Jun 02 01:29:28.491617 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:28.491546 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-192.ec2.internal_b03870c6e03d09f5797a675c8ae41336/haproxy/0.log" Jun 02 01:29:32.538113 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:32.538070 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65df6ddff7-zftpf_d85549eb-6903-4a08-8787-b758a454f355/authorino/0.log" Jun 02 01:29:32.627710 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:32.627674 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-8htjt_a19c1673-455c-4dcb-946c-f80ff1ecf71f/kuadrant-console-plugin/0.log" Jun 02 01:29:34.049609 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:34.049573 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4cdc0ac8-5fdf-4523-adb2-a473f1efedd1/alertmanager/0.log" Jun 02 01:29:34.071916 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:34.071882 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4cdc0ac8-5fdf-4523-adb2-a473f1efedd1/config-reloader/0.log" Jun 02 01:29:34.093617 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:34.093585 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4cdc0ac8-5fdf-4523-adb2-a473f1efedd1/kube-rbac-proxy-web/0.log" Jun 02 01:29:34.113661 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:34.113635 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4cdc0ac8-5fdf-4523-adb2-a473f1efedd1/kube-rbac-proxy/0.log" Jun 02 01:29:34.138446 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:34.138410 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4cdc0ac8-5fdf-4523-adb2-a473f1efedd1/kube-rbac-proxy-metric/0.log" Jun 02 01:29:34.162043 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:34.162004 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4cdc0ac8-5fdf-4523-adb2-a473f1efedd1/prom-label-proxy/0.log" Jun 02 01:29:34.185953 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:34.185918 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4cdc0ac8-5fdf-4523-adb2-a473f1efedd1/init-config-reloader/0.log" Jun 02 01:29:34.408725 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:34.408692 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-q2ccq_3e5324fd-cac0-4080-b8b0-57c22ef157d3/monitoring-plugin/0.log" Jun 02 01:29:34.624903 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:34.624872 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qkfx5_8ffd1ed4-f142-48a7-9362-86673790ae37/node-exporter/0.log" Jun 02 01:29:34.652732 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:34.652708 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qkfx5_8ffd1ed4-f142-48a7-9362-86673790ae37/kube-rbac-proxy/0.log" Jun 02 01:29:34.673978 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:34.673953 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qkfx5_8ffd1ed4-f142-48a7-9362-86673790ae37/init-textfile/0.log" Jun 02 01:29:35.004766 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:35.004673 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-f67sq_304f31db-e595-4938-9f6b-38430c39e135/prometheus-operator-admission-webhook/0.log" Jun 02 01:29:37.853728 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:37.853690 2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2tbbt/perf-node-gather-daemonset-vw7vj"] Jun 02 01:29:37.861942 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:37.861911 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-vw7vj" Jun 02 01:29:37.866324 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:37.866276 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2tbbt/perf-node-gather-daemonset-vw7vj"] Jun 02 01:29:38.021992 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:38.021946 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1-sys\") pod \"perf-node-gather-daemonset-vw7vj\" (UID: \"2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-vw7vj" Jun 02 01:29:38.022192 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:38.022006 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1-proc\") pod \"perf-node-gather-daemonset-vw7vj\" (UID: \"2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-vw7vj" Jun 02 01:29:38.022192 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:38.022035 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1-lib-modules\") pod \"perf-node-gather-daemonset-vw7vj\" (UID: \"2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-vw7vj" Jun 02 01:29:38.022192 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:38.022083 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1-podres\") pod \"perf-node-gather-daemonset-vw7vj\" (UID: \"2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-vw7vj" Jun 02 01:29:38.022192 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:38.022125 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx5pz\" (UniqueName: \"kubernetes.io/projected/2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1-kube-api-access-gx5pz\") pod \"perf-node-gather-daemonset-vw7vj\" (UID: \"2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-vw7vj" Jun 02 01:29:38.122947 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:38.122864 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1-sys\") pod \"perf-node-gather-daemonset-vw7vj\" (UID: \"2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-vw7vj" Jun 02 01:29:38.122947 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:38.122907 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1-proc\") pod \"perf-node-gather-daemonset-vw7vj\" (UID: \"2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-vw7vj" Jun 02 01:29:38.122947 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:38.122932 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1-lib-modules\") pod \"perf-node-gather-daemonset-vw7vj\" (UID: \"2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-vw7vj" Jun 02 01:29:38.123195 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:38.122965 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1-podres\") pod \"perf-node-gather-daemonset-vw7vj\" (UID: \"2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-vw7vj" Jun 02 01:29:38.123195 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:38.122978 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1-sys\") pod \"perf-node-gather-daemonset-vw7vj\" (UID: \"2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-vw7vj" Jun 02 01:29:38.123195 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:38.122995 2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gx5pz\" (UniqueName: \"kubernetes.io/projected/2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1-kube-api-access-gx5pz\") pod \"perf-node-gather-daemonset-vw7vj\" (UID: \"2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-vw7vj" Jun 02 01:29:38.123195 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:38.123049 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1-proc\") pod \"perf-node-gather-daemonset-vw7vj\" (UID: \"2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-vw7vj" Jun 02 01:29:38.123195 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:38.123101 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1-lib-modules\") pod \"perf-node-gather-daemonset-vw7vj\" (UID: \"2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-vw7vj" Jun 02 01:29:38.123195 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:38.123103 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1-podres\") pod \"perf-node-gather-daemonset-vw7vj\" (UID: \"2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-vw7vj" Jun 02 01:29:38.131984 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:38.131919 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx5pz\" (UniqueName: \"kubernetes.io/projected/2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1-kube-api-access-gx5pz\") pod \"perf-node-gather-daemonset-vw7vj\" (UID: \"2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-vw7vj" Jun 02 01:29:38.194583 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:38.194537 2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-vw7vj" Jun 02 01:29:38.369267 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:38.369231 2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2tbbt/perf-node-gather-daemonset-vw7vj"] Jun 02 01:29:38.374177 ip-10-0-138-192 kubenswrapper[2576]: W0602 01:29:38.374091 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2d2d2d3f_04f8_484a_9e34_5d4c507eb9e1.slice/crio-c0d744044d77a56ea9c83b9ce7cd27eaa5029ecbbc48cfa2886a55addef1a18b WatchSource:0}: Error finding container c0d744044d77a56ea9c83b9ce7cd27eaa5029ecbbc48cfa2886a55addef1a18b: Status 404 returned error can't find the container with id c0d744044d77a56ea9c83b9ce7cd27eaa5029ecbbc48cfa2886a55addef1a18b Jun 02 01:29:38.838668 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:38.838612 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z6c7d_b33e89ef-ae01-478f-b2ca-383234e07be1/dns/0.log" Jun 02 01:29:38.862321 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:38.862273 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z6c7d_b33e89ef-ae01-478f-b2ca-383234e07be1/kube-rbac-proxy/0.log" Jun 02 01:29:38.944624 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:38.944595 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-smvzg_ff5cd010-d35b-4b58-8008-5c3a1f22deec/dns-node-resolver/0.log" Jun 02 01:29:39.043825 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:39.043785 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-vw7vj" event={"ID":"2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1","Type":"ContainerStarted","Data":"3b8863b06c3e02fc03de49623532efba5edb26919d7fb6ef57cbf137012a1a0a"} Jun 02 01:29:39.044086 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:39.044062 2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-vw7vj" event={"ID":"2d2d2d3f-04f8-484a-9e34-5d4c507eb9e1","Type":"ContainerStarted","Data":"c0d744044d77a56ea9c83b9ce7cd27eaa5029ecbbc48cfa2886a55addef1a18b"} Jun 02 01:29:39.045013 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:39.044991 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-vw7vj" Jun 02 01:29:39.064385 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:39.064314 2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-vw7vj" podStartSLOduration=2.064295986 podStartE2EDuration="2.064295986s" podCreationTimestamp="2026-06-02 01:29:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:29:39.062638927 +0000 UTC m=+1123.233181137" watchObservedRunningTime="2026-06-02 01:29:39.064295986 +0000 UTC m=+1123.234838173" Jun 02 01:29:39.517998 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:39.517965 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h8fml_2200ba73-d59d-4591-8254-fe06a7ee0bde/node-ca/0.log" Jun 02 01:29:40.416523 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:40.416494 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-549c788894-cwgdw_49161927-e4b0-4e88-b7cb-cc7ad395a21f/kube-auth-proxy/0.log" Jun 02 01:29:41.050135 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:41.050108 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-864j4_b6dbdb36-49f7-4e85-90d1-72f90db62f96/serve-healthcheck-canary/0.log" Jun 02 01:29:41.628225 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:41.628197 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f8p5c_e78609df-27c6-49d6-a2f8-c1636aae8674/kube-rbac-proxy/0.log" Jun 02 01:29:41.647085 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:41.647056 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f8p5c_e78609df-27c6-49d6-a2f8-c1636aae8674/exporter/0.log" Jun 02 01:29:41.667062 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:41.667031 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f8p5c_e78609df-27c6-49d6-a2f8-c1636aae8674/extractor/0.log" Jun 02 01:29:43.855231 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:43.855179 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-qjb25_35788916-3d12-4853-a10f-9777ae6437f0/manager/0.log" Jun 02 01:29:44.059345 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:44.059309 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bc8cb464b-vrxh5_2df97e6c-d5b2-4a64-9499-f2eeb25c397c/manager/0.log" Jun 02 01:29:44.074107 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:44.074080 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bc8cb464b-vrxh5_2df97e6c-d5b2-4a64-9499-f2eeb25c397c/copy-manifests/0.log" Jun 02 01:29:45.433624 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:45.433580 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5c7648845d-zt2x5_7016eaf8-41f7-485b-9118-21b05fe96787/manager/0.log" Jun 02 01:29:46.060058 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:46.060029 2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-vw7vj" Jun 02 01:29:51.536243 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:51.536215 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8p5xf_c56a8f7e-11e7-4958-9d61-b56975c37dbe/kube-multus-additional-cni-plugins/0.log" Jun 02 01:29:51.557627 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:51.557603 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8p5xf_c56a8f7e-11e7-4958-9d61-b56975c37dbe/egress-router-binary-copy/0.log" Jun 02 01:29:51.576080 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:51.576053 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8p5xf_c56a8f7e-11e7-4958-9d61-b56975c37dbe/cni-plugins/0.log" Jun 02 01:29:51.595291 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:51.595260 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8p5xf_c56a8f7e-11e7-4958-9d61-b56975c37dbe/bond-cni-plugin/0.log" Jun 02 01:29:51.614175 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:51.614149 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8p5xf_c56a8f7e-11e7-4958-9d61-b56975c37dbe/routeoverride-cni/0.log" Jun 02 01:29:51.634277 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:51.634216 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8p5xf_c56a8f7e-11e7-4958-9d61-b56975c37dbe/whereabouts-cni-bincopy/0.log" Jun 02 01:29:51.655950 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:51.655920 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8p5xf_c56a8f7e-11e7-4958-9d61-b56975c37dbe/whereabouts-cni/0.log" Jun 02 01:29:52.003737 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:52.003702 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-svwjt_c2983f4a-20eb-4157-81bf-6d793bc6038e/kube-multus/0.log" Jun 02 01:29:52.117963 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:52.117924 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gntp5_b0c654e7-08a1-4ca8-81c4-5164c7c30e26/network-metrics-daemon/0.log" Jun 02 01:29:52.136705 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:52.136672 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gntp5_b0c654e7-08a1-4ca8-81c4-5164c7c30e26/kube-rbac-proxy/0.log" Jun 02 01:29:53.285472 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:53.285436 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lkf95_b6d9386e-1aeb-41d2-8b3d-0a088b8724cb/ovn-controller/0.log" Jun 02 01:29:53.300763 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:53.300737 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lkf95_b6d9386e-1aeb-41d2-8b3d-0a088b8724cb/ovn-acl-logging/0.log" Jun 02 01:29:53.311012 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:53.310983 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lkf95_b6d9386e-1aeb-41d2-8b3d-0a088b8724cb/ovn-acl-logging/1.log" Jun 02 01:29:53.330640 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:53.330610 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lkf95_b6d9386e-1aeb-41d2-8b3d-0a088b8724cb/kube-rbac-proxy-node/0.log" Jun 02 01:29:53.352110 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:53.352087 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lkf95_b6d9386e-1aeb-41d2-8b3d-0a088b8724cb/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 01:29:53.367930 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:53.367903 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lkf95_b6d9386e-1aeb-41d2-8b3d-0a088b8724cb/northd/0.log" Jun 02 01:29:53.388605 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:53.388575 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lkf95_b6d9386e-1aeb-41d2-8b3d-0a088b8724cb/nbdb/0.log" Jun 02 01:29:53.408625 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:53.408603 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lkf95_b6d9386e-1aeb-41d2-8b3d-0a088b8724cb/sbdb/0.log" Jun 02 01:29:53.580567 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:53.580488 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lkf95_b6d9386e-1aeb-41d2-8b3d-0a088b8724cb/ovnkube-controller/0.log" Jun 02 01:29:55.080039 ip-10-0-138-192 kubenswrapper[2576]: I0602 01:29:55.080009 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-55g5j_629ae262-2447-41a6-b07c-0dd56b001344/network-check-target-container/0.log"